LensGesture: Augmenting Mobile Interactions with Back-of-Device Finger Gestures

被引：24

作者：

Xiao, Xiang ^{[1
]}

Han, Teng ^{[2
]}

Wang, Jingtao ^{[1
]}

机构：

[1] Univ Pittsburgh, Dept Comp Sci, 210 S Bouquet St, Pittsburgh, PA 15260 USA

[2] Univ Pittsburgh, Intelligent Syst Program, Pittsburgh, PA 15260 USA

来源：

ICMI'13: PROCEEDINGS OF THE 2013 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION | 2013年

关键词：

Mobile Interfaces; Gestures; Motion Sensing; Camera Phones; LensGesture; Text Input;

D O I：

10.1145/2522848.2522850

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

We present LensGesture, a pure software approach for augmenting mobile interactions with back-of-device finger gestures. LensGesture detects full and partial occlusion as well as the dynamic swiping of fingers on the camera lens by analyzing image sequences captured by the built-in camera in real time. We report the feasibility and implementation of LensGesture as well as newly supported interactions. Through offline benchmarking and a 16-subject user study, we found that 1) LensGesture is easy to learn, intuitive to use, and can serve as an effective supplemental input channel for today's smartphones; 2) LensGesture can be detected reliably in real time; 3) LensGesture based target acquisition conforms to Fitts' Law and the information transmission rate is 0.53 bits/sec; and 4) LensGesture applications can improve the usability and the performance of existing mobile interfaces.

引用

页码：287 / 294

页数：8

共 50 条

[1] BackAssist: Augmenting Mobile Touch Manipulation with Back-of-Device Assistance
Chen, Liang
Chen, Dongyi
Chen, Xiao
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (06): : 1682 - 1685
[2] JoyHolder: Tangible Back-of-Device Mobile Interactions
Yadav, Amit
Eady, Alexander Keith
Nabil, Sara
Girouard, Audrey
PROCEEDINGS OF THE 2019 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE SURFACES AND SPACES (ISS '19), 2019, : 343 - 346
[3] BackC&P: Augmenting Copy and Paste Operations on Mobile Touch Devices Through Back-of-device Interaction
Chen, Liang
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (11) : 945 - 953
[4] BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones
Corsten, Christian
Daehlmann, Bjoern
Voelker, Simon
Borchers, Jan
PROCEEDINGS OF THE 2017 ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'17), 2017, : 4654 - 4666
[5] Woodpecker: Secret Back-of-Device Tap Rhythms to Authenticate Mobile Users
Kulshreshtha, Satvik
Arif, Ahmed Sabbir
2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 2727 - 2733
[6] Back-of-Device Force Feedback Improves Touchscreen Interaction for Mobile Devices
Maiero, Jens
Eibich, David
Kruijff, Ernst
Hinkenjann, Andre
Stuerzlinger, Wolfgang
Benko, Hrvoje
Ghinea, Gheorghita
IEEE TRANSACTIONS ON HAPTICS, 2019, 12 (04) : 483 - 496
[7] The performance of hand postures in front- and back-of-device interaction for mobile computing
Wobbrock, Jacob O.
Myers, Brad A.
Aung, Htet Htet
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2008, 66 (12) : 857 - 875
[8] Expanding One-Handed Touch Input Vocabulary Using Index Finger on and Above Back-of-Device
Sei, Yusuke
Funakoshi, Minto
Shizuki, Buntarou
PROCEEDINGS OF THE 31ST AUSTRALIAN CONFERENCE ON HUMAN-COMPUTER-INTERACTION (OZCHI'19), 2020, : 585 - 589
[9] Back-of-Device Authentication with BoD Taps and BoD Shapes
Catala, Alejandro
Leiva, Luis A.
PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES (MOBILEHCI'14), 2014, : 425 - 425
[10] BackSwipe: Back-of-device Word-Gesture Interaction on Smartphones
Cui, Wenzhe
Zhu, Suwen
Li, Zhi
Xu, Zheer
Yang, Xing-Dong
Ramakrishnan, I., V
Bi, Xiaojun
CHI '21: PROCEEDINGS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2021,

← 1 2 3 4 5 →