Predicting low-performance government-sponsored R&D project: comprehensive framework and machine learning approach

被引:1
|
作者
Ma, Hyoung Ryul [1 ]
Lee, Jae-Hoon [2 ]
Lee, Cheol-Ju [2 ,3 ]
机构
[1] Minist Trade Ind & Energy, Off Strateg R&D Planning, Seoul, South Korea
[2] Korea Evaluat Inst Ind Technol, Div Ind Technol Innovat, Daejeon, South Korea
[3] Korea Evaluat Inst Ind Technol, Daejeon 35262, South Korea
关键词
Project success factors; government R&D project; machine learning; SHapley Additive exPlanations; DEVELOPMENT COOPERATION; SUCCESS FACTORS; INNOVATION; DETERMINANTS; IMPACT;
D O I
10.1080/09537325.2023.2264961
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
In response to the Korean R&D paradox, which has intensified during the post-global financial crisis, it would be critical to seek ways to improve the economic outcomes of R&D projects. In this context, this study aims to propose a framework and methodology to predict low-performance R&D projects. We considered various factors affecting the project's success, including funding, technological, environmental, organisational, and initial valuation factors. Our framework was applied to 797 R&D projects, introducing a novel BU ratio as a performance evaluation metric together with an F1 score. Then, the results of three machine learning algorithms were compared, and the XGBoost algorithm showed the best performance for predicting low-performance R&D projects. This study gained insight into the behaviour of the selected models through the SHAP value. Government funding, in terms of ratio and amount, was revealed as the most dominant feature in predicting performance groups. Organisational factors were crucial for high-performance projects, whereas funding factors dominantly affected low-performance projects. Our analytical framework and findings will contribute to academic knowledge, as no research has yet explored this. Moreover, this study will provide practical implications for funding agencies to proactively manage low-performance R&D projects and improve their economic success.
引用
收藏
页码:4643 / 4656
页数:14
相关论文
共 26 条
  • [21] Internal and external discipline: The effect of project leadership and government monitoring on the performance of publicly funded R&D consortia
    Nishimura, Junichi
    Okamuro, Hiroyuki
    RESEARCH POLICY, 2018, 47 (05) : 840 - 853
  • [22] A machine learning framework for predicting device performance in 2D metal halide perovskite photodetector
    Pandey, Siddhi Vinayak
    Parikh, Nishi
    Kalam, Abul
    Prochowicz, Daniel
    Satapathi, Soumitra
    Akin, Seckin
    Tavakoli, Mohammad Mahdi
    Yadav, Pankaj
    SOLAR ENERGY, 2024, 270
  • [23] Measuring and comparing the R&D performance of government research institutes: A bottom-up data envelopment analysis approach
    Lee, Seonghee
    Lee, Hakyeon
    JOURNAL OF INFORMETRICS, 2015, 9 (04) : 942 - 953
  • [24] The impacts of economy policy uncertainty on peer effects of firms R&D investment: Based on LDA machine learning and regression statistical modeling approach
    Wang, Shanshan
    Yang, Xingxing
    Zhu, Xia
    Ge, Xiangyu
    PLOS ONE, 2024, 19 (06):
  • [25] An Adversarial Machine Learning Framework and Biomechanical Model Guided Approach for Generating 3D Lung Tissue Elasticity from Low Dose End-Exhalation CT
    Santhanam, A.
    Stiehl, B.
    Lauria, M.
    Barjaktarevic, I.
    Hsieh, S.
    Low, D.
    MEDICAL PHYSICS, 2020, 47 (06) : E408 - E408
  • [26] Experimental comparison and optimal machine learning technique for predicting the thermo-hydraulic performance of Low-GWP refrigerants (R1234yf, R290, and R13I1/R290) during evaporation in plate heat exchanger
    Prabakaran, Rajendran
    Mohanraj, Thangamuthu
    Dhamodharan, Palanisamy
    Kim, Sung Chul
    CASE STUDIES IN THERMAL ENGINEERING, 2024, 64