Extending reference architecture of big data systems towards machine learning in edge computing environments

被引:19
|
作者
Paakkonen, P. [1 ]
Pakkala, D. [1 ]
机构
[1] VTT Tech Res Ctr Finland, Kaitovayla 1, Oulu 90570, Finland
关键词
Neural networks; ArchiMate; Edge computing; DevOps; Inference; Machine learning; Reference architecture; MANAGEMENT; 5G;
D O I
10.1186/s40537-020-00303-y
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
BackgroundAugmented reality, computer vision and other (e.g. network functions, Internet-of-Things (IoT)) use cases can be realised in edge computing environments with machine learning (ML) techniques. For realisation of the use cases, it has to be understood how data is collected, stored, processed, analysed, and visualised in big data systems. In order to provide services with low latency for end users, often utilisation of ML techniques has to be optimized. Also, software/service developers have to understand, how to develop and deploy ML models in edge computing environments. Therefore, architecture design of big data systems to edge computing environments may be challenging.FindingsThe contribution of this paper is reference architecture (RA) design of a big data system utilising ML techniques in edge computing environments. An earlier version of the RA has been extended based on 16 realised implementation architectures, which have been developed to edge/distributed computing environments. Also, deployment of architectural elements in different environments is described. Finally, a system view is provided of the software engineering aspects of ML model development and deployment.ConclusionsThe presented RA may facilitate concrete architecture design of use cases in edge computing environments. The value of RAs is reduction of development and maintenance costs of systems, reduction of risks, and facilitation of communication between different stakeholders.
引用
收藏
页数:29
相关论文
共 50 条
  • [11] An intelligent outlier detection with machine learning empowered big data analytics for mobile edge computing
    Romany F. Mansour
    S. Abdel-Khalek
    Inès Hilali-Jaghdam
    Jamel Nebhen
    Woong Cho
    Gyanendra Prasad Joshi
    Cluster Computing, 2023, 26 : 71 - 83
  • [12] Simplifying Big Data Analytics Systems with a Reference Architecture
    Sang, Go Muan
    Xu, Lai
    de Vrieze, Paul
    COLLABORATION IN A DATA-RICH WORLD, 2017, 506 : 242 - 249
  • [13] Evaluating the Boundaries of Big Data Environments for Machine Learning
    Ismail, Fathima Nuzla
    Woodford, Brendon J.
    Licorish, Sherlock A.
    AI 2019: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, 11919 : 253 - 264
  • [14] Towards AIOps in Edge Computing Environments
    Becker, Soeren
    Schmidt, Florian
    Gulenko, Anton
    Acker, Alexander
    Kao, Odej
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3470 - 3475
  • [15] Defining a Reference Architecture for Edge Systems in Highly-Uncertain Environments
    Pitstick, Kevin
    Novakouski, Marc
    Lewis, Grace A.
    Ozkaya, Ipek
    IEEE 21ST INTERNATIONAL CONFERENCE ON SOFTWARE ARCHITECTURE COMPANION, ICSA-C 2024, 2024, : 356 - 361
  • [16] Towards an Architecture for Big Data Analytics Leveraging Edge/Fog Paradigms
    Diaz-de-Arcaya, Josu
    Minon, Raul
    Torre-Bastida, Ana, I
    13TH EUROPEAN CONFERENCE ON SOFTWARE ARCHITECTURE (ECSA 2019), VOL 2, 2019, : 173 - 176
  • [17] Data Locality in High Performance Computing, Big Data, and Converged Systems: An Analysis of the Cutting Edge and a Future System Architecture
    Usman, Sardar
    Mehmood, Rashid
    Katib, Iyad
    Albeshri, Aiiad
    ELECTRONICS, 2023, 12 (01)
  • [18] Granular computing based machine learning in the era of big data
    Hu, Qinghua
    Mi, Jusheng
    Chen, Degang
    Information Sciences, 2022, 591 : 422 - 423
  • [19] A Reference Architecture for Big Data Systems in the National Security Domain
    Klein, John
    Buglak, Ross
    Blockow, David
    Wuttke, Troy
    Cooper, Brenton
    2016 IEEE/ACM 2ND INTERNATIONAL WORKSHOP ON BIG DATA SOFTWARE ENGINEERING (BIGDSE 2016), 2016, : 51 - 57
  • [20] Edge Computing with Big Data Cloud Architecture: A Case Study in Smart Building
    Inibhunu, Catherine
    McGregor, Carolyn A. M.
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3387 - 3393