LensGesture: Augmenting Mobile Interactions with Back-of-Device Finger Gestures

被引：24
|
作者：
Xiao, Xiang [1 ]
Han, Teng [2 ]
Wang, Jingtao [1 ]
机构：
[1] Univ Pittsburgh, Dept Comp Sci, 210 S Bouquet St, Pittsburgh, PA 15260 USA
[2] Univ Pittsburgh, Intelligent Syst Program, Pittsburgh, PA 15260 USA
来源：
ICMI'13: PROCEEDINGS OF THE 2013 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION | 2013年
关键词：
Mobile Interfaces; Gestures; Motion Sensing; Camera Phones; LensGesture; Text Input;
D O I：
10.1145/2522848.2522850
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
We present LensGesture, a pure software approach for augmenting mobile interactions with back-of-device finger gestures. LensGesture detects full and partial occlusion as well as the dynamic swiping of fingers on the camera lens by analyzing image sequences captured by the built-in camera in real time. We report the feasibility and implementation of LensGesture as well as newly supported interactions. Through offline benchmarking and a 16-subject user study, we found that 1) LensGesture is easy to learn, intuitive to use, and can serve as an effective supplemental input channel for today's smartphones; 2) LensGesture can be detected reliably in real time; 3) LensGesture based target acquisition conforms to Fitts' Law and the information transmission rate is 0.53 bits/sec; and 4) LensGesture applications can improve the usability and the performance of existing mobile interfaces.
引用
收藏
页码：287 / 294
页数：8
相关论文
共 50 条
  • [21] Dynamic gestures as an input device for directing a mobile platform
    Ehrenmann, M
    Lütticke, T
    Dillmann, R
    2001 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS I-IV, PROCEEDINGS, 2001, : 2596 - 2601
  • [22] An Evaluation of a Wearable Assistive Device for Augmenting Social Interactions
    Qiu, Shi
    Hu, Jun
    Han, Ting
    Osawa, Hirotaka
    Rauterberg, Matthias
    IEEE ACCESS, 2020, 8 : 164661 - 164677
  • [23] Magic Ring: A Finger-Worn Device for Multiple Appliances Control Using Static Finger Gestures
    Jing, Lei
    Zhou, Yinghui
    Cheng, Zixue
    Huang, Tongjun
    SENSORS, 2012, 12 (05) : 5775 - 5790
  • [24] Byte.it: Discreet Teeth Gestures for Mobile Device Interaction
    Galvez, Tomas Vega
    Sapkota, Shardul
    Dancu, Alexandru
    Maes, Pattie
    CHI EA '19 EXTENDED ABSTRACTS: EXTENDED ABSTRACTS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
  • [25] Differences and Similarities between Finger and Pen Stroke Gestures on Stationary and Mobile devices
    Tu, Huawei
    Ren, Xiangshi
    Zhai, Shumin
    ACM TRANSACTIONS ON COMPUTER-HUMAN INTERACTION, 2015, 22 (05)
  • [26] Less Is More: Efficient Back-of-Device Tap Input Detection Using Built-in Smartphone Sensors
    Granell, Emilio
    Leiva, Luis A.
    PROCEEDINGS OF THE 2016 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE SURFACES AND SPACES, (ISS 2016), 2016, : 5 - 11
  • [27] Comparing Eyes-free Gestures to Gestures Produced in the Presence or Absence of Visual Feedback on Mobile Device
    Rekik, Yosra
    Guettaf, Adnane
    Jamalzadeh, Milad
    Grisoni, Laurent
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES, AVI 2024, 2024,
  • [28] Development of a finger printing device for use on a mobile robot
    Dixon, K
    Wu, J
    Brennan, RW
    Goldsmith, P
    JOURNAL OF FORENSIC SCIENCES, 2004, 49 (02) : 290 - 299
  • [29] A Neuro-Fuzzy Hybrid Framework for Augmenting Resources of Mobile Device
    Anitha, S.
    Padma, T.
    INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING, 2021, 20 (05) : 1519 - 1555
  • [30] Abacus Gestures: A Large Set of Math-Based Usable Finger-Counting Gestures for Mid-Air Interactions
    Ehtesham-Ul-Haque, Md
    Billah, Syed Masum
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2023, 7 (03):
12345