The Evaluation on the Credit Risk of Enterprises with the CNN-LSTM-ATT Model

被引:7
|
作者
Zhang, Lei [1 ,2 ]
机构
[1] Chongqing Jiaotong Univ, Sch Math & Stat, Chongqing 400074, Peoples R China
[2] Chongqing Jiaotong Univ, Sch Econ & Management, Chongqing 400074, Peoples R China
基金
中国国家自然科学基金;
关键词
ATTENTION;
D O I
10.1155/2022/6826573
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Credit evaluation is a difficult problem in the process of financing and loan for small and medium-sized enterprises. Due to the high dimension and nonlinearity of enterprise behavior data, traditional logistic regression (LR), random forest (RF), and other methods, when the feature space is very large, it is easy to show low accuracy and lack of robustness. However, recurrent neural network (RNN) will have a serious gradient disappearance problem under long sequence training. This paper proposes a compound neural network model based on the attention mechanism to meet the needs of enterprise credit evaluation. The convolutional neural network (CNN) and the long short-term memory (LSTM) network were used to establish the model, using soft attention, the gradient propagates back to other parts of the model through the attention mechanism module. In the multimodel comparison experiment and three different enterprise data experiments, the CNN-LSTM-ATT model proposed in this paper is superior to the traditional models LR, RF, CNN, LSTM, and CNN-LSTM in most cases. The experimental results under multimodel comparison reflect the higher accuracy of the model, and the group test reflects the higher robustness of the model.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] A hybrid CNN-LSTM machine learning model for rock mechanical parameters evaluation
    Hu, Yating
    Zhang, Qiong
    GEOENERGY SCIENCE AND ENGINEERING, 2023, 225
  • [32] Internet Financial Credit Risk Assessment with Sliding Window and Attention Mechanism LSTM Model
    LI, Menggang
    Zhang, Zixuan
    Lu, Ming
    Jia, Xiaojun
    Liu, Rui
    Zhou, Xuan
    Zhang, Yingjie
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2023, 30 (01): : 1 - 7
  • [33] Research on the Foundation of Managing Credit Risk in Enterprises
    Hong Mei
    WSM: 2008 INTERNATIONAL WORKSHOP ON STRATEGY AND MARKETING, PROCEEDINGS, 2008, : 99 - 103
  • [34] Method of Evaluating and Warning on Enterprises Credit Risk
    Hong Mei
    PROCEEDINGS OF 2009 CONFERENCE ON SYSTEMS SCIENCE, MANAGEMENT SCIENCE & SYSTEM DYNAMICS, VOL 5, 2009, : 71 - 77
  • [35] The Importance of Construction Enterprises' Credit Risk Management
    Li Tingting
    Liu Shuqi
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON CONSTRUCTION & REAL ESTATE MANAGEMENT, VOLS 1 AND 2, 2009, : 375 - 378
  • [36] Credit Evaluation Index System of Construction Enterprises
    Ma, Chunjie
    Ma, Yanting
    SUSTAINABLE CITIES DEVELOPMENT AND ENVIRONMENT, PTS 1-3, 2012, 209-211 : 1423 - 1428
  • [37] Credit Risk Evaluation of Supply Chain Financing of Small and Medium-Sized Enterprises
    Liu Xueying
    Lian Fenghui
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON LOGISTICS, ENGINEERING, MANAGEMENT AND COMPUTER SCIENCE, 2014, 101 : 652 - 655
  • [38] Discrete Choice Model Application to the Credit Risk Evaluation
    Witkowska, Dorota
    INTERNATIONAL ADVANCES IN ECONOMIC RESEARCH, 2006, 12 (01) : 33 - 42
  • [39] Application of Logit Model in Credit Risk Evaluation of Corporations
    Zhao Qingxia
    Wang Bifeng
    Lai Zhihua
    COMPREHENSIVE EVALUATION OF ECONOMY AND SOCIETY WITH STATISTICAL SCIENCE, 2010, : 125 - 129
  • [40] Default barrier intensity model for credit risk evaluation
    Elhiwi, Majdi
    STATISTICS & PROBABILITY LETTERS, 2014, 95 : 125 - 131