FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support

被引：0

作者：

Guan, Zhitong ^{[1
]}

Xiong, Zeyu ^{[1
]}

Fan, Mingming ^{[1
,2
,3
]}

机构：

[1] Hong Kong Univ Sci & Technol Guangzhou, Computat Media & Arts Thrust, Guangzhou, Peoples R China

[2] Hong Kong Univ Sci & Technol, Div Integrat Syst & Design, Hong Kong, Peoples R China

[3] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Peoples R China

来源：

PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024 | 2024年

关键词：

Package delivery; KuaiDiGui; Blind and low vision; People with vision impairments; Accessibility; Mobile devices; Object detection; Computer vision; Augmented reality; Assistive technology; OBJECT RECOGNITION;

D O I：

10.1145/3613904.3642213

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Parcel lockers have become an increasingly prevalent last-mile delivery method. Yet, a recent study revealed its accessibility challenges to blind and low-vision people (BLV). Informed by the study, we designed FetchAid, a standalone intelligent mobile app assisting BLV in using a parcel locker in real-time by integrating computer vision and augmented reality (AR) technologies. FetchAid first uses a deep network to detect the user's fingertip and relevant buttons on the touch screen of the parcel locker to guide the user to reveal and scan the QR code to open the target compartment door and then guide the user to reach the door safely with AR-based context-aware audio feedback. Moreover, FetchAid provides an error-recovery mechanism and real-time feedback to keep the user on track. We show that FetchAid substantially improved task accomplishment and efficiency, and reduced frustration and overall effort in a study with 12 BLV participants, regardless of their vision conditions and previous experience.

引用

页数：15