LensGesture: Augmenting Mobile Interactions with Back-of-Device Finger Gestures

被引：24
|
作者：
Xiao, Xiang [1 ]
Han, Teng [2 ]
Wang, Jingtao [1 ]
机构：
[1] Univ Pittsburgh, Dept Comp Sci, 210 S Bouquet St, Pittsburgh, PA 15260 USA
[2] Univ Pittsburgh, Intelligent Syst Program, Pittsburgh, PA 15260 USA
来源：
ICMI'13: PROCEEDINGS OF THE 2013 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION | 2013年
关键词：
Mobile Interfaces; Gestures; Motion Sensing; Camera Phones; LensGesture; Text Input;
D O I：
10.1145/2522848.2522850
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
We present LensGesture, a pure software approach for augmenting mobile interactions with back-of-device finger gestures. LensGesture detects full and partial occlusion as well as the dynamic swiping of fingers on the camera lens by analyzing image sequences captured by the built-in camera in real time. We report the feasibility and implementation of LensGesture as well as newly supported interactions. Through offline benchmarking and a 16-subject user study, we found that 1) LensGesture is easy to learn, intuitive to use, and can serve as an effective supplemental input channel for today's smartphones; 2) LensGesture can be detected reliably in real time; 3) LensGesture based target acquisition conforms to Fitts' Law and the information transmission rate is 0.53 bits/sec; and 4) LensGesture applications can improve the usability and the performance of existing mobile interfaces.
引用
收藏
页码：287 / 294
页数：8
相关论文
共 50 条
  • [41] TimeTilt: Using Sensor-Based Gestures to Travel through Multiple Applications on a Mobile Device
    Roudaut, Anne
    Baglioni, Mathias
    Lecolinet, Eric
    HUMAN-COMPUTER INTERACTION - INTERACT 2009, PT I, 2009, 5726 : 830 - 834
  • [42] A New Mobile Multimodal Biometric Device Integrating Finger Vein and Fingerprint Recognition
    Lee, Hyeon Chang
    Park, Kang Ryoung
    Kang, Byung Jun
    Park, Sung Joo
    PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION TECHNOLOGIES & APPLICATIONS (ICUT 2009), 2009, : 307 - +
  • [43] Online Finger-Writing Signature Verification on Mobile Device for Local Authentication
    Tang, Lei
    Fang, Yuxun
    Wu, Qiuxia
    Kang, Wenxiong
    Zhao, Junhong
    BIOMETRIC RECOGNITION, 2016, 9967 : 409 - 416
  • [44] WorldPoint: Finger Pointing as a Rapid and Natural Trigger for In-The-Wild Mobile Interactions
    Kim D.
    Mollyn V.
    Harrison C.
    Proceedings of the ACM on Human-Computer Interaction, 2023, 7 (ISS) : 357 - 375
  • [45] Gesture On: Enabling Always-On Touch Gestures for Fast Mobile Access from the Device Standby Mode
    Lu, Hao
    Li, Yang
    CHI 2015: PROCEEDINGS OF THE 33RD ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2015, : 3355 - 3364
  • [46] The effects of screen size on rotating 3D contents using compound gestures on a mobile device
    Hu, Chi-Yuan
    Lin, Heng-Yi
    Chen, Li-Chieh
    DISPLAYS, 2016, 41 : 25 - 32
  • [47] MOBILE DEVICE TO CLOUD CO-PROCESSING OF ASL FINGER SPELLING TO TEXT CONVERSION
    Hays, Philip
    Ptucha, Raymond
    Melton, Roy
    2013 IEEE WESTERN NEW YORK IMAGE PROCESSING WORKSHOP (WNYIPW), 2013, : 39 - 43
  • [48] Finger Gesture Estimation for Mobile Device User Interface Using a Rear-Facing Camera
    An, Jun-Ho
    Min, Jin-Hong
    Hong, Kwang-Seok
    FUTURE INFORMATION TECHNOLOGY, PT II, 2011, 185 : 230 - 237
  • [49] Quantification of Users' Visual Attention During Everyday Mobile Device Interactions
    Bace, Mihai
    Staal, Sander
    Bulling, Andreas
    PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20), 2020,
  • [50] Implicit Authentication for Mobile Device based on 3D Magnetic Finger Motion Pattern
    Liu, Yaowen
    Yang, Ming
    Ling, Zhen
    Luo, Junzhou
    2017 IEEE 21ST INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2017, : 325 - 330
12345