Deep Learning UI Design Patterns of Mobile Apps

被引:8
|
作者
Tam The Nguyen [1 ]
Phong Minh Vu [1 ]
Hung Viet Pham [2 ]
Tung Thanh Nguyen [1 ]
机构
[1] Auburn Univ, Auburn, AL 36849 USA
[2] Utah State Univ, Logan, UT 84322 USA
关键词
D O I
10.1145/3183399.3183422
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
User interface (UI) is one of the most important components of a mobile app and strongly influences users' perception of the app. However, UI design tasks are typically manual and time-consuming. This paper proposes a novel approach to (semi)-automate those tasks. Our key idea is to develop and deploy advanced deep learning models based on recurrent neural networks (RNN) and generative adversarial networks (GAN) to learn UI design patterns from millions of currently available mobile apps. Once trained, those models can be used to search for UI design samples given user-provided descriptions written in natural language and generate professional-looking UI designs from simpler, less elegant design drafts.
引用
收藏
页码:65 / 68
页数:4
相关论文
共 50 条
  • [31] Mobile Apps and computational systems as learning tools
    Iglesias Rodriguez, Ana
    Garcia Riaza, Blanca
    Paulo Cravino, Jose
    THIRD INTERNATIONAL CONFERENCE ON TECHNOLOGICAL ECOSYSTEMS FOR ENHANCING MULTICULTURALITY, PROCEEDINGS TEEM'15, 2015, : 287 - 289
  • [32] LEARNING WITH UNIQUE MOBILE APPS: PRINCIPLES AND IMPLICATIONS
    Shafriri, Yuval
    Levy, Dalit
    10TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION (ICERI2017), 2017, : 8073 - 8083
  • [33] Mobile apps for science learning: Review of research
    Zydney, Janet Mannheimer
    Warner, Zachary
    COMPUTERS & EDUCATION, 2016, 94 : 1 - 17
  • [34] PUMA: Programmable UI-Automation for Large-Scale Dynamic Analysis of Mobile Apps
    Hao, Shuai
    Liu, Bin
    Nath, Suman
    Halfond, William G. J.
    Govindan, Ramesh
    MOBISYS'14: PROCEEDINGS OF THE 12TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS, APPLICATIONS, AND SERVICES, 2014, : 204 - 217
  • [35] Inferring Mobile Apps from Resource Usage Patterns
    Nugroho, Amin R. S.
    Li, Qinghua
    2017 5TH IEEE INTERNATIONAL CONFERENCE ON MOBILE CLOUD COMPUTING, SERVICES, AND ENGINEERING (MOBILECLOUD), 2017, : 82 - 87
  • [36] Understanding Illicit UI in iOS Apps Through Hidden UI Analysis
    Lee, Yeonjoon
    Wang, Xueqiang
    Liao, Xiaojing
    Wang, XiaoFeng
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2021, 18 (05) : 2390 - 2402
  • [37] UI Obfuscation and Its Effects on Automated UI Analysis for Android Apps
    Zhou, Hao
    Chen, Ting
    Wang, Haoyu
    Yu, Le
    Luo, Xiapu
    Wang, Ting
    Zhang, Wei
    2020 35TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE 2020), 2020, : 199 - 210
  • [38] Design for Social Sharing: The Case of Mobile Apps
    Karanam, Subrahmanyam Aditya
    Agarwal, Ashish
    Barua, Anitesh
    INFORMATION SYSTEMS RESEARCH, 2023, 34 (02) : 721 - 743
  • [39] Security Audit in Mobile Apps Security Design
    Feng, Xiaohua
    Conrad, Marc
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2018), 2018,
  • [40] Implications of deep learning for the automation of design patterns organization
    Hussain, Shahid
    Keung, Jacky
    Khan, Arif Ali
    Ahmad, Awais
    Cuomo, Salvatore
    Piccialli, Francesco
    Jeon, Gwanggil
    Akhunzada, Adnan
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2018, 117 : 256 - 266