Assurance Guidance for Machine Learning in a Safety-Critical System

被引:2
|
作者
Feather, Martin S. [1 ]
Slingerland, Philip C. [2 ]
Guerrini, Steven [1 ]
Spolaor, Max [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Aerosp Corp, El Segundo, CA 90245 USA
基金
美国国家航空航天局;
关键词
assurance; guidance; machine learning; safety;
D O I
10.1109/ISSREW55968.2022.00098
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We are developing guidance for space domain assurance personnel on how to assure Artificial intelligence (AI) and Machine Learning (ML) systems. Key to such guidance will be an assurance process for these personnel, who may be unfamiliar with such systems, to follow. We are investigating one such process, the "Assurance of Machine Learning in Autonomous Systems (AMLAS)" from the University of York, UK. To gauge its suitability, we are (retrospectively) applying it to a safety critical AI/ML system in the space domain. We report here on our experience so far in applying this process.
引用
收藏
页码:394 / 401
页数:8
相关论文
共 50 条
  • [21] Applying Safety Case Pattern to Generate Assurance Cases for Safety-Critical Systems
    Lin, Chung-Ling
    Shen, Wuwei
    2015 IEEE 16TH INTERNATIONAL SYMPOSIUM ON HIGH ASSURANCE SYSTEMS ENGINEERING (HASE), 2015, : 255 - 262
  • [22] Reducing Software Assurance Risks for Security-Critical and Safety-Critical Systems
    Axelrod, C. Warren
    2014 IEEE LONG ISLAND SYSTEMS, APPLICATIONS AND TECHNOLOGY CONFERENCE (LISAT), 2014,
  • [23] PROVING PROPERTIES OF A SAFETY-CRITICAL SYSTEM
    ATKINSON, W
    CUNNINGHAM, J
    SOFTWARE ENGINEERING JOURNAL, 1991, 6 (02): : 41 - 50
  • [24] HMI Requirements Creation, as the Collaboration Work of Human and Machine in the Safety-Critical System
    Ito, Masao
    SYSTEMS, SOFTWARE AND SERVICES PROCESS IMPROVEMENT (EUROSPI 2017), 2017, 748 : 61 - 71
  • [25] Probabilistic Constraint for Safety-Critical Reinforcement Learning
    Chen, Weiqin
    Subramanian, Dharmashankar
    Paternain, Santiago
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (10) : 6789 - 6804
  • [26] Understanding the role of driver behaviors and performance in safety-critical events: Application of machine learning
    Ahmad, Numan
    Khattak, Asad J.
    Bozdogan, Hamparsum
    JOURNAL OF TRANSPORTATION SAFETY & SECURITY, 2025, 17 (01) : 57 - 96
  • [27] How to certify machine learning based safety-critical systems? A systematic literature review
    Florian Tambon
    Gabriel Laberge
    Le An
    Amin Nikanjam
    Paulina Stevia Nouwou Mindom
    Yann Pequignot
    Foutse Khomh
    Giulio Antoniol
    Ettore Merlo
    François Laviolette
    Automated Software Engineering, 2022, 29
  • [28] How to certify machine learning based safety-critical systems? A systematic literature review
    Tambon, Florian
    Laberge, Gabriel
    An, Le
    Nikanjam, Amin
    Mindom, Paulina Stevia Nouwou
    Pequignot, Yann
    Khomh, Foutse
    Antoniol, Giulio
    Merlo, Ettore
    Laviolette, Francois
    AUTOMATED SOFTWARE ENGINEERING, 2022, 29 (02)
  • [29] Quantification of the safety level of a safety-critical control system
    Rastocny, Karol
    Ilavsky, Juraj
    2010 INTERNATIONAL CONFERENCE ON APPLIED ELECTRONICS, 2010, : 285 - 288
  • [30] Assurance Benefits of ISO 26262 Compliant Microcontrollers for Safety-Critical Avionics
    Schwierz, Andreas
    Forsberg, Hakan
    COMPUTER SAFETY, RELIABILITY, AND SECURITY (SAFECOMP 2018), 2018, 11093 : 27 - 41