Assurance Guidance for Machine Learning in a Safety-Critical System

被引:2
|
作者
Feather, Martin S. [1 ]
Slingerland, Philip C. [2 ]
Guerrini, Steven [1 ]
Spolaor, Max [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Aerosp Corp, El Segundo, CA 90245 USA
基金
美国国家航空航天局;
关键词
assurance; guidance; machine learning; safety;
D O I
10.1109/ISSREW55968.2022.00098
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We are developing guidance for space domain assurance personnel on how to assure Artificial intelligence (AI) and Machine Learning (ML) systems. Key to such guidance will be an assurance process for these personnel, who may be unfamiliar with such systems, to follow. We are investigating one such process, the "Assurance of Machine Learning in Autonomous Systems (AMLAS)" from the University of York, UK. To gauge its suitability, we are (retrospectively) applying it to a safety critical AI/ML system in the space domain. We report here on our experience so far in applying this process.
引用
收藏
页码:394 / 401
页数:8
相关论文
共 50 条
  • [1] Editorial: Machine learning for safety-critical applications in engineering
    Kiran, Mariam
    Khan, Samir
    MACHINE LEARNING, 2020, 109 (05) : 1101 - 1102
  • [2] Machine Learning Approach in Heterogeneous Group of Algorithms for Transport Safety-Critical System
    An, Jaehyung
    Mikhaylov, Alexey
    Kim, Keunwoo
    APPLIED SCIENCES-BASEL, 2020, 10 (08):
  • [3] Sensitivity of Logic Learning Machine for Reliability in Safety-Critical Systems
    Narteni, Sara
    Orani, Vanessa
    Vaccari, Ivan
    Cambiaso, Enrico
    Mongelli, Maurizio
    IEEE INTELLIGENT SYSTEMS, 2022, 37 (05) : 66 - 74
  • [4] On the Evaluation Measures for Machine Learning Algorithms for Safety-critical Systems
    Gharib, Mohamad
    Bondavalli, Andrea
    2019 15TH EUROPEAN DEPENDABLE COMPUTING CONFERENCE (EDCC 2019), 2019, : 141 - 144
  • [5] Modeling Safety-Critical System Requirements with Hierarchical State Machine
    Wang, Zheng
    Geng, Chen-ge
    Chen, Xiang-xian
    Wang, Dong
    Huang, Hai
    Guan, Ai-ai
    2014 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE, ELECTRONICS AND ELECTRICAL ENGINEERING (ISEEE), VOLS 1-3, 2014, : 720 - 723
  • [6] Machine Learning Based Test Data Generation for Safety-Critical Software
    Cegin, Jan
    PROCEEDINGS OF THE 28TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '20), 2020, : 1678 - 1681
  • [7] The Methodology of Software Quality Assurance for Safety-Critical Systems
    Jharko, E. Ph.
    2015 INTERNATIONAL SIBERIAN CONFERENCE ON CONTROL AND COMMUNICATIONS (SIBCON), 2015,
  • [8] Quality Assurance in Agile Safety-Critical Systems Development
    McBride, Tom
    Lepmets, Marion
    PROCEEDINGS 2016 10TH INTERNATIONAL CONFERENCE ON THE QUALITY OF INFORMATION AND COMMUNICATIONS TECHNOLOGY (QUATIC), 2016, : 44 - 51
  • [9] Measure Confidence of Assurance Cases in Safety-Critical Domains
    Lin, Chung-Ling
    Shen, Wuwei
    Drager, Steven
    Cheng, Betty
    2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: NEW IDEAS AND EMERGING TECHNOLOGIES RESULTS (ICSE-NIER), 2018, : 13 - 16
  • [10] Understanding the Properness of Incorporating Machine Learning Algorithms in Safety-Critical Systems
    Gharib, Mohamad
    Zoppi, Tommaso
    Bondavalli, Andrea
    36TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2021, 2021, : 232 - 234