Extending reference architecture of big data systems towards machine learning in edge computing environments

被引:19
|
作者
Paakkonen, P. [1 ]
Pakkala, D. [1 ]
机构
[1] VTT Tech Res Ctr Finland, Kaitovayla 1, Oulu 90570, Finland
关键词
Neural networks; ArchiMate; Edge computing; DevOps; Inference; Machine learning; Reference architecture; MANAGEMENT; 5G;
D O I
10.1186/s40537-020-00303-y
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
BackgroundAugmented reality, computer vision and other (e.g. network functions, Internet-of-Things (IoT)) use cases can be realised in edge computing environments with machine learning (ML) techniques. For realisation of the use cases, it has to be understood how data is collected, stored, processed, analysed, and visualised in big data systems. In order to provide services with low latency for end users, often utilisation of ML techniques has to be optimized. Also, software/service developers have to understand, how to develop and deploy ML models in edge computing environments. Therefore, architecture design of big data systems to edge computing environments may be challenging.FindingsThe contribution of this paper is reference architecture (RA) design of a big data system utilising ML techniques in edge computing environments. An earlier version of the RA has been extended based on 16 realised implementation architectures, which have been developed to edge/distributed computing environments. Also, deployment of architectural elements in different environments is described. Finally, a system view is provided of the software engineering aspects of ML model development and deployment.ConclusionsThe presented RA may facilitate concrete architecture design of use cases in edge computing environments. The value of RAs is reduction of development and maintenance costs of systems, reduction of risks, and facilitation of communication between different stakeholders.
引用
收藏
页数:29
相关论文
共 50 条
  • [1] Extending reference architecture of big data systems towards machine learning in edge computing environments
    P. Pääkkönen
    D. Pakkala
    Journal of Big Data, 7
  • [2] A Reference Architecture for Big Data Systems
    Sang, Go Muan
    Xu, Lai
    de Vrieze, Paul
    PROCEEDINGS OF 2016 10TH INTERNATIONAL CONFERENCE ON SOFTWARE, KNOWLEDGE, INFORMATION MANAGEMENT & APPLICATIONS (SKIMA), 2016, : 370 - 375
  • [3] Fog computing: from architecture to edge computing and big data processing
    Simar Preet Singh
    Anand Nayyar
    Rajesh Kumar
    Anju Sharma
    The Journal of Supercomputing, 2019, 75 : 2070 - 2105
  • [4] Fog computing: from architecture to edge computing and big data processing
    Singh, Simar Preet
    Nayyar, Anand
    Kumar, Rajesh
    Sharma, Anju
    JOURNAL OF SUPERCOMPUTING, 2019, 75 (04): : 2070 - 2105
  • [5] Big Data Systems Meet Machine Learning Challenges: Towards Big Data Science as a Service
    Elshawi, Radwa
    Sakr, Sherif
    Talia, Domenico
    Trunfio, Paolo
    BIG DATA RESEARCH, 2018, 14 : 1 - 11
  • [6] Machine learning on big data for future computing
    Jeong, Young-Sik
    Hassan, Houcine
    Sangaiah, Arun Kumar
    JOURNAL OF SUPERCOMPUTING, 2019, 75 (06): : 2925 - 2929
  • [7] Machine learning on big data for future computing
    Young-Sik Jeong
    Houcine Hassan
    Arun Kumar Sangaiah
    The Journal of Supercomputing, 2019, 75 : 2925 - 2929
  • [8] Green Computing for Big Data and Machine Learning
    Barua, Hrishav Bakul
    Mondal, Kartick Chandra
    Khatua, Sunirmal
    PROCEEDINGS OF THE 5TH JOINT INTERNATIONAL CONFERENCE ON DATA SCIENCE & MANAGEMENT OF DATA, CODS COMAD 2022, 2022, : 348 - 351
  • [9] Towards a Reference Architecture for Smart and Personal Learning Environments
    Isaksson, Erik
    Naeve, Ambjorn
    Lefrere, Paul
    Wild, Fridolin
    INNOVATIONS IN SMART LEARNING, 2017, : 79 - 88
  • [10] An intelligent outlier detection with machine learning empowered big data analytics for mobile edge computing
    Mansour, Romany F.
    Abdel-Khalek, S.
    Hilali-Jaghdam, Ines
    Nebhen, Jamel
    Cho, Woong
    Joshi, Gyanendra Prasad
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2023, 26 (01): : 71 - 83