Assurance Guidance for Machine Learning in a Safety-Critical System

被引:2
|
作者
Feather, Martin S. [1 ]
Slingerland, Philip C. [2 ]
Guerrini, Steven [1 ]
Spolaor, Max [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Aerosp Corp, El Segundo, CA 90245 USA
基金
美国国家航空航天局;
关键词
assurance; guidance; machine learning; safety;
D O I
10.1109/ISSREW55968.2022.00098
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We are developing guidance for space domain assurance personnel on how to assure Artificial intelligence (AI) and Machine Learning (ML) systems. Key to such guidance will be an assurance process for these personnel, who may be unfamiliar with such systems, to follow. We are investigating one such process, the "Assurance of Machine Learning in Autonomous Systems (AMLAS)" from the University of York, UK. To gauge its suitability, we are (retrospectively) applying it to a safety critical AI/ML system in the space domain. We report here on our experience so far in applying this process.
引用
收藏
页码:394 / 401
页数:8
相关论文
共 50 条
  • [31] Model-based assurance evidence management for safety-critical systems
    Luis de la Vara, Jose
    Garcia, Arturo S.
    Valero, Jorge
    Ayora, Clara
    SOFTWARE AND SYSTEMS MODELING, 2022, 21 (06): : 2329 - 2365
  • [32] Modeling and verification of high-assurance properties of safety-critical systems
    Tsai, JJP
    Juan, EYT
    COMPUTER JOURNAL, 2001, 44 (06): : 504 - 530
  • [33] Safety assurance for safety-critical embedded systems: Qualification of tools for complex electronic hardware
    Komecki, Andrew
    Zalewski, Janusz
    PROCEEDINGS OF THE 2008 1ST INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY, 2008, : 99 - +
  • [34] Reliability Assessment and Safety Arguments for Machine Learning Components in System Assurance
    Dong, Yi
    Huang, Wei
    Bharti, Vibhav
    Cox, Victoria
    Banks, Alec
    Wang, Sen
    Zhao, Xingyu
    Schewe, Sven
    Huang, Xiaowei
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2023, 22 (03)
  • [35] Formal development method for safety-critical system
    Wang, Hai-Feng
    Chen, Jian-Ming
    Zheng, Zhong-Yi
    Beifang Jiaotong Daxue Xuebao/Journal of Northern Jiaotong University, 2002, 26 (06):
  • [36] Platform Independent Safety-Critical Operating System
    Delic, Emil
    Loeser, Karolin
    Hayek, Ali
    Boercsoek, Josef
    2015 INTERNATIONAL CONFERENCE ON INFORMATION AND DIGITAL TECHNOLOGIES (IDT), 2015, : 68 - 71
  • [37] ADVANCED INFORMATION SYSTEM FOR SAFETY-CRITICAL PROCESSES
    Kozak, Stefan
    Kajan, Slavomir
    Ciganek, Jan
    Ferencey, Viktor
    Belai, Igor
    COMPUTING AND INFORMATICS, 2014, 33 (06) : 1356 - 1376
  • [38] Automatic test generation for safety-critical system
    Xu, ZW
    Wu, FM
    ICEMI'2001: FIFTH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT AND INSTRUMENTS, VOL 1, CONFERENCE PROCEEDINGS, 2001, : 70 - 73
  • [39] Towards online prediction of safety-critical landing metrics in aviation using supervised machine learning
    Puranik, Tejas G.
    Rodriguez, Nicolas
    Mavris, Dimitri N.
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2020, 120
  • [40] Can we trust Machine Learning Results? Artificial Intelligence in Safety-Critical decision Support
    Holzinger, Katharina
    Mak, Klaus
    Kieseberg, Peter
    Holzinger, Andreas
    ERCIM NEWS, 2018, (112): : 42 - 43