Distributed artificial intelligence: Taxonomy, review, framework, and reference architecture

被引:12
作者
Janbi, Nourah [1 ]
Katib, Iyad [2 ]
Mehmood, Rashid [3 ]
机构
[1] Univ Jeddah, Coll Comp & Informat Technol Khulais, Dept Informat Technol, Jeddah 21959, Saudi Arabia
[2] King Abdulaziz Univ, Fac Comp & Informat Technol, Dept Comp Sci, Jeddah 21589, Saudi Arabia
[3] King Abdulaziz Univ, High Performance Comp Ctr, Jeddah 21589, Saudi Arabia
来源
INTELLIGENT SYSTEMS WITH APPLICATIONS | 2023年 / 18卷
关键词
Artificial intelligence; Distributed artificial intelligence; Distributed pre-processing; Distributed training; Distributed inference; distributed decision making; Data parallelism; Model parallelism; Pipelined parallelism; Hybrid parallelism; Federated learning; Multi-layer architecture; 6th generation (6 g) networks; Future networking; Fog computing; edge computing; cloud computing; DEEP LEARNING-MODELS; EDGE; INFERENCE; HEALTH; CHALLENGES; 6G; COMMUNICATION; OPTIMIZATION; TRANSMISSION; CONVERGENCE;
D O I
10.1016/j.iswa.2023.200231
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial intelligence (AI) research and market have grown rapidly in the last few years, and this trend is expected to continue with many potential advancements and innovations in this field. One of the emerging AI research directions is Distributed Artificial Intelligence (DAI). It has been motivated by technological advances in communication, networking, and hardware, together with the nature of data being generated from connected, distributed, and diverse objects. DAI is expected to create a fertile environment for innovative, advanced, robust, and scalable approaches for AI supporting the vision of smart societies. In this paper, we explore state of the art on DAI and identify the opportunities and challenges of provisioning distributed AI as a service (DAIaaS). We provide a taxonomy and a comprehensive review covering the literature from 2016 to 2022. It comprises various aspects of DAI, including AI workflow, distribution paradigms, supporting infrastructure, management techniques, and applications. Based on the gained insights from the conducted review, we propose Imtidad, a framework for provisioning DAIaaS over the cloud, fog, and edge layers. We refine this framework and propose the Imtidad software Reference Architecture (RA) for designing and deploying DAI services. In addition, we extended the framework and developed a future networking infrastructure transformation framework, as it is one of the main enablers for DAI. This framework and RA can be used as guidance facilitating the transition to the future DAI, where DAI is decoupled from the design and development of smart applications. This paper, including the proposed framework, RA, taxonomy, and detailed review, is expected to have an extensive impact on DAI research and accelerate innovations in this area.
引用
收藏
页数:43
相关论文
共 274 条
[1]   Development and Testing of a Novel Game Theoretic De-Centralized Traffic Signal Controller [J].
Abdelghaffar, Hossam M. ;
Rakha, Hesham A. .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (01) :231-242
[2]  
Abdi A., 2020, arXiv
[3]   A Survey on Federated Learning: The Journey From Centralized to Distributed On-Site Learning and Beyond [J].
AbdulRahman, Sawsan ;
Tout, Hanine ;
Ould-Slimane, Hakima ;
Mourad, Azzam ;
Talhi, Chamseddine ;
Guizani, Mohsen .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (07) :5476-5497
[4]   Performance Analysis of Sparse Matrix-Vector Multiplication (SpMV) on Graphics Processing Units (GPUs) [J].
AlAhmadi, Sarah ;
Mohammed, Thaha ;
Albeshri, Aiiad ;
Katib, Iyad ;
Mehmood, Rashid .
ELECTRONICS, 2020, 9 (10) :1-30
[5]   TAAWUN: a Decision Fusion and Feature Specific Road Detection Approach for Connected Autonomous Vehicles [J].
Alam, Furqan ;
Mehmood, Rashid ;
Katib, Iyad ;
Altowaijri, Saleh M. ;
Albeshri, Aiiad .
MOBILE NETWORKS & APPLICATIONS, 2023, 28 (02) :636-652
[6]  
Alla S., 2021, Begin. MLOps with MLFlow, DOI DOI 10.1007/978-1-4842-6549-9
[7]   Iktishaf plus : A Big Data Tool with Automatic Labeling for Road Traffic Social Sensing and Event Detection Using Distributed Machine Learning [J].
Alomari, Ebtesam ;
Katib, Iyad ;
Albeshri, Aiiad ;
Yigitcanlar, Tan ;
Mehmood, Rashid .
SENSORS, 2021, 21 (09)
[8]   Sehaa: A Big Data Analytics Tool for Healthcare Symptoms and Diseases Detection Using Twitter, Apache Spark, and Machine Learning [J].
Alotaibi, Shoayee ;
Mehmood, Rashid ;
Katib, Iyad ;
Rana, Omer ;
Albeshri, Aiiad .
APPLIED SCIENCES-BASEL, 2020, 10 (04)
[9]   Artificial intelligence and multi agent based distributed ledger system for better privacy and security of electronic healthcare records [J].
Alruwaili, Fahad F. .
PEERJ COMPUTER SCIENCE, 2020,
[10]   Enabling distributed intelligence for the Internet of Things with IOTA and mobile agents [J].
Alsboui, Tariq ;
Qin, Yongrui ;
Hill, Richard ;
Al-Aqrabi, Hussain .
COMPUTING, 2020, 102 (06) :1345-1363