A deep reinforcement learning method for structural dominant failure modes searching based on self-play strategy

被引:6
|
作者
Guan, Xiaoshu [1 ,2 ,3 ]
Sun, Huabin [1 ,2 ,3 ]
Hou, Rongrong [1 ,2 ,3 ]
Xu, Yang [1 ,2 ,3 ]
Bao, Yuequan [1 ,2 ,3 ]
Li, Hui [1 ,2 ,3 ]
机构
[1] Harbin Inst Technol, Minist Educ, Key Lab Struct Dynam Behav & Control, Harbin 150090, Peoples R China
[2] Harbin Inst Technol, Minist Ind & Informat Technol, Key Lab Smart Prevent & Mitigat Civil Engn Disaste, Harbin 150090, Peoples R China
[3] Harbin Inst Technol, Sch Civil Engn, Harbin 150090, Peoples R China
基金
中国国家自然科学基金;
关键词
Structural reliability analysis; Dominant failure modes; Deep reinforcement learning; Self-play strategy; Monte Carlo tree search; RELIABILITY; GAME; GO;
D O I
10.1016/j.ress.2023.109093
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In the research area of structural reliability analysis (SRA), the dominant failure modes (DFMs) of a structural system make significant contributions to life-span failure prediction and safety assessment. However, the high computational cost caused by the combinatorial explosion is the main problem in DFMs searching that hinders its application and further development. Recently, many successful applications have proved that the self-play deep reinforcement learning (DRL) has a strong ability to obtain action policy in the face of combinatorial explosion problems. Inspired by this, a self-play strategy is designed to optimize the DRL-based DFMs searching process and reduce the computational effort. A scoring function is designed and used as the refereeing standard of the self-play games and helps improve the efficiency of Monte Carlo tree search (MCTS) in an asynchronous training process. In comparison with the beta-unzipping method and exploration-based DFMs searching method, the pro-posed method significantly improved training efficiency with an accuracy of over 95% and a lower requirement of the number of finite element analysis (FEA), both of which contribute to the policy learning of failure component selection. In summary, the method shows potential applications for actual structures and makes valuable contributions to the problem with high computing costs.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] A Self-Play and Sentiment-Emphasized Comment Integration Framework Based on Deep Q-Learning in a Crowdsourcing Scenario
    Rong, Huan
    Sheng, Victor S.
    Ma, Tinghuai
    Zhou, Yang
    Al-Rodhaan, Mznah
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (03) : 1021 - 1037
  • [42] A transfer learning method for electric vehicles charging strategy based on deep reinforcement learning
    Wang, Kang
    Wang, Haixin
    Yang, Zihao
    Feng, Jiawei
    Li, Yanzhen
    Yang, Junyou
    Chen, Zhe
    APPLIED ENERGY, 2023, 343
  • [43] Mastering the Card Game of Jaipur Through Zero-Knowledge Self-Play Reinforcement Learning and Action Masks
    Department of Artificial Intelligence, Faculty of ICT, University of Malta, Msida, Malta
    Lect. Notes Comput. Sci., (231-244):
  • [44] Flipit Game Deception Strategy Selection Method Based on Deep Reinforcement Learning
    He, Weizhen
    Tan, Jinglei
    Guo, Yunfei
    Shang, Ke
    Kong, Guanhua
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023
  • [45] Deep reinforcement learning-based sampling method for structural reliability assessment
    Xiang, Zhengliang
    Bao, Yuequan
    Tang, Zhiyi
    Li, Hui
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2020, 199
  • [46] Deep reinforcement learning based parameter self-tuning control strategy for VSG
    Xiong, Kang
    Hu, Weihao
    Zhang, Guozhou
    Zhang, Zhenyuan
    Chen, Zhe
    ENERGY REPORTS, 2022, 8 : 219 - 226
  • [47] A Deep Reinforcement Learning Method for Self-driving
    Fang, Yong
    Gu, Jianfeng
    INTELLIGENT COMPUTING THEORIES AND APPLICATION, PT II, 2018, 10955 : 143 - 152
  • [48] A Precision Advertising Strategy Based on Deep Reinforcement Learning
    Liang H.
    Ingenierie des Systemes d'Information, 2020, 25 (03): : 397 - 403
  • [49] A Stock Trading Strategy Based on Deep Reinforcement Learning
    Khemlichi, Firdaous
    Chougrad, Hiba
    Khamlichi, Youness Idrissi
    El Boushaki, Abdessamad
    Ben Ali, Safae El Haj
    ADVANCED INTELLIGENT SYSTEMS FOR SUSTAINABLE DEVELOPMENT (AI2SD'2020), VOL 2, 2022, 1418 : 920 - 928
  • [50] Energy Management Strategy for Hybrid Electric Vehicle Based on the Deep Reinforcement Learning Method
    Chen Z.
    Fang Z.
    Yang R.
    Yu Q.
    Kang M.
    Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2022, 37 (23): : 6157 - 6168