LensGesture: Augmenting Mobile Interactions with Back-of-Device Finger Gestures

被引：24
|
作者：
Xiao, Xiang [1 ]
Han, Teng [2 ]
Wang, Jingtao [1 ]
机构：
[1] Univ Pittsburgh, Dept Comp Sci, 210 S Bouquet St, Pittsburgh, PA 15260 USA
[2] Univ Pittsburgh, Intelligent Syst Program, Pittsburgh, PA 15260 USA
来源：
ICMI'13: PROCEEDINGS OF THE 2013 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION | 2013年
关键词：
Mobile Interfaces; Gestures; Motion Sensing; Camera Phones; LensGesture; Text Input;
D O I：
10.1145/2522848.2522850
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
We present LensGesture, a pure software approach for augmenting mobile interactions with back-of-device finger gestures. LensGesture detects full and partial occlusion as well as the dynamic swiping of fingers on the camera lens by analyzing image sequences captured by the built-in camera in real time. We report the feasibility and implementation of LensGesture as well as newly supported interactions. Through offline benchmarking and a 16-subject user study, we found that 1) LensGesture is easy to learn, intuitive to use, and can serve as an effective supplemental input channel for today's smartphones; 2) LensGesture can be detected reliably in real time; 3) LensGesture based target acquisition conforms to Fitts' Law and the information transmission rate is 0.53 bits/sec; and 4) LensGesture applications can improve the usability and the performance of existing mobile interfaces.
引用
收藏
页码：287 / 294
页数：8
相关论文
共 50 条
  • [31] Phone Sleight of Hand: Finger-Based Dexterous Gestures for Physical Interaction with Mobile Phones
    Yeh, Yen-Ting
    Matulic, Fabrice
    Vogel, Daniel
    PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2023, 2023,
  • [32] FirstVR: A Muscle Deformation Sensors Array Device to Detect Finger Gestures and Noise Reduction Case
    Tamaki, Emi
    Hosono, Satoshi
    Iwasaki, Ken
    ICECC 2019: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRONICS, COMMUNICATIONS AND CONTROL ENGINEERING, 2019, : 21 - 24
  • [33] vARitouch: Back of the Finger Device for adding Variable Compliance to Rigid Objects
    Vega, Gabriela
    Martinez-Missir, Valetin
    Wittchen, Dennis
    Sabnis, Nihar
    Cochrane, Karen Anne
    Girouard, Audrey
    Strohmeier, Paul
    PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS (CHI 2024), 2024,
  • [34] A mobile device application applied to low back disorders
    Juan C. Guerri
    Ana Belén Antón
    Ana Pajares
    Manuel Monfort
    Daniel Sánchez
    Multimedia Tools and Applications, 2009, 42 : 317 - 340
  • [35] A mobile device application applied to low back disorders
    Guerri, Juan C.
    Anton, Ana Belen
    Pajares, Ana
    Monfort, Manuel
    Sanchez, Daniel
    MULTIMEDIA TOOLS AND APPLICATIONS, 2009, 42 (03) : 317 - 340
  • [36] Supporting Cross-Device Interactions with Gestures between Personal and Public Devices
    Pulina, Francesca
    Paterno, Fabio
    MUM 2019: 18TH INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS MULTIMEDIA, 2019,
  • [37] SecTap: Secure Back of Device Input System for Mobile Devices
    Ling, Zhen
    Luo, Junzhou
    Liu, Yaowen
    Yang, Ming
    Wu, Kui
    Fu, Xinwen
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2018), 2018, : 1520 - 1528
  • [38] Does Human Finger's Pressure Sensing Improve User Text Input on Mobile Device? A Study on Input Performance Improvement Based on Human Finger's Pressure on Mobile Device
    Kim, Yoon Sang
    Ko, Junho
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2014,
  • [39] Ubicorder: A Mobile Device for Situated Interactions With Sensor Networks
    Mittal, Manas
    Paradiso, Joseph A.
    IEEE SENSORS JOURNAL, 2011, 11 (03) : 818 - 828
  • [40] Maternal Mobile Device Use and Mealtime Interactions With Children
    Radesky, Jenny S.
    Weeks, Heidi M.
    Mccaffery, Harlan
    Kaciroti, Niko
    Lumeng, Julie C.
    Miller, Alison L.
    JOURNAL OF DEVELOPMENTAL AND BEHAVIORAL PEDIATRICS, 2024, 45 (06): : e545 - e551
12345