Deep Learning UI Design Patterns of Mobile Apps

被引:8
|
作者
Tam The Nguyen [1 ]
Phong Minh Vu [1 ]
Hung Viet Pham [2 ]
Tung Thanh Nguyen [1 ]
机构
[1] Auburn Univ, Auburn, AL 36849 USA
[2] Utah State Univ, Logan, UT 84322 USA
关键词
D O I
10.1145/3183399.3183422
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
User interface (UI) is one of the most important components of a mobile app and strongly influences users' perception of the app. However, UI design tasks are typically manual and time-consuming. This paper proposes a novel approach to (semi)-automate those tasks. Our key idea is to develop and deploy advanced deep learning models based on recurrent neural networks (RNN) and generative adversarial networks (GAN) to learn UI design patterns from millions of currently available mobile apps. Once trained, those models can be used to search for UI design samples given user-provided descriptions written in natural language and generate professional-looking UI designs from simpler, less elegant design drafts.
引用
收藏
页码:65 / 68
页数:4
相关论文
共 50 条
  • [41] RUCID: Rapid Usable Consistent Interaction Design Patterns-Based Mobile Phone UI Design Library, Process and Tool
    Raj, Avinash
    Komaragiri, Vihari
    HUMAN-COMPUTER INTERACTION, PT I, 2009, 5610 : 677 - 686
  • [42] Integrating Project Based Learning Environment into the Design and Development of Mobile Apps for Learning 2D-Animation
    Jumaat, Nurul Farhana
    Tasir, Zaidatun
    13TH INTERNATIONAL EDUCATIONAL TECHNOLOGY CONFERENCE, 2013, 103 : 526 - 533
  • [43] A First Look at Deep Learning Apps on Smartphones
    Xu, Mengwei
    Liu, Jiawei
    Liu, Yuanqiang
    Lin, Felix Xiaozhu
    Liu, Yunxin
    Liu, Xuanzhe
    WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 2125 - 2136
  • [44] Interactive teaching design of mobile English based on deep learning
    Zhang Yan
    Yan Bing
    Pan Shimeng
    Journal of Ambient Intelligence and Humanized Computing, 2025, 16 (1) : 1 - 14
  • [45] Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning
    Chen, Jieshan
    Chen, Chunyang
    Xing, Zhenchang
    Xu, Xiwei
    Zhu, Liming
    Li, Guoqiang
    Wang, Jinshui
    2020 ACM/IEEE 42ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2020), 2020, : 322 - 334
  • [46] DEEPINTENT: Deep Icon-Behavior Learning for Detecting Intention-Behavior Discrepancy in Mobile Apps
    Xi, Shengqu
    Yang, Shao
    Xiao, Xusheng
    Yao, Yuan
    Xiong, Yayuan
    Xu, Fengyuan
    Wang, Haoyu
    Gao, Peng
    Liu, Zhuotao
    Xu, Feng
    Lu, Jian
    PROCEEDINGS OF THE 2019 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY (CCS'19), 2019, : 2421 - 2436
  • [47] The design and evaluation of a mobile UI for personalized dietary food selection
    Liu, Ying-Chieh
    Tsou, Ya-Chi
    Chen, Chien-Hung
    Chen, Hsin-Yun
    Lin, Yu-Sheng
    Lo, Cheng-Hung
    INDUSTRIAL ENGINEERING AND MANAGEMENT SCIENCE, 2015, : 87 - 90
  • [48] Testing approach for mobile applications through reverse engineering of UI Patterns
    Morgado, Ines Coimbra
    Paiva, Ana C. R.
    2015 30TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING WORKSHOP (ASEW), 2015, : 42 - 49
  • [49] Mobile learning with patterns
    Breuer, Henning
    Zurita, Gustavo
    Baloian, Nelson
    Matsumoto, Mitsuji
    8TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES, PROCEEDINGS, 2008, : 626 - +
  • [50] Development Trend of Mobile UI Design in Big Data Age
    Rui, Dong
    PROCEEDINGS OF THE 2017 2ND INTERNATIONAL CONFERENCE ON MACHINERY, ELECTRONICS AND CONTROL SIMULATION (MECS 2017), 2017, 138 : 631 - 635