Predicting low-performance government-sponsored R&D project: comprehensive framework and machine learning approach

被引:1
|
作者
Ma, Hyoung Ryul [1 ]
Lee, Jae-Hoon [2 ]
Lee, Cheol-Ju [2 ,3 ]
机构
[1] Minist Trade Ind & Energy, Off Strateg R&D Planning, Seoul, South Korea
[2] Korea Evaluat Inst Ind Technol, Div Ind Technol Innovat, Daejeon, South Korea
[3] Korea Evaluat Inst Ind Technol, Daejeon 35262, South Korea
关键词
Project success factors; government R&D project; machine learning; SHapley Additive exPlanations; DEVELOPMENT COOPERATION; SUCCESS FACTORS; INNOVATION; DETERMINANTS; IMPACT;
D O I
10.1080/09537325.2023.2264961
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
In response to the Korean R&D paradox, which has intensified during the post-global financial crisis, it would be critical to seek ways to improve the economic outcomes of R&D projects. In this context, this study aims to propose a framework and methodology to predict low-performance R&D projects. We considered various factors affecting the project's success, including funding, technological, environmental, organisational, and initial valuation factors. Our framework was applied to 797 R&D projects, introducing a novel BU ratio as a performance evaluation metric together with an F1 score. Then, the results of three machine learning algorithms were compared, and the XGBoost algorithm showed the best performance for predicting low-performance R&D projects. This study gained insight into the behaviour of the selected models through the SHAP value. Government funding, in terms of ratio and amount, was revealed as the most dominant feature in predicting performance groups. Organisational factors were crucial for high-performance projects, whereas funding factors dominantly affected low-performance projects. Our analytical framework and findings will contribute to academic knowledge, as no research has yet explored this. Moreover, this study will provide practical implications for funding agencies to proactively manage low-performance R&D projects and improve their economic success.
引用
收藏
页码:4643 / 4656
页数:14
相关论文
共 26 条
  • [1] EXPLORING THE DETERMINANTS OF GOVERNMENT-SPONSORED R&D PERFORMANCE IN KOREA
    Ryu, Youngsoo
    Choi, Sang Ok
    PUBLIC PERFORMANCE & MANAGEMENT REVIEW, 2015, 39 (02) : 337 - 357
  • [2] The determinants of government-sponsored R&D alliances
    Lin, Feng-Jyh
    Wu, Shang-He
    Hsu, Maw-Shin
    Perng, Chyuan
    JOURNAL OF BUSINESS RESEARCH, 2016, 69 (11) : 5192 - 5195
  • [3] A fuzzy AHP application in government-sponsored R&D project selection
    Huang, Chi-Cheng
    Chu, Pin-Yu
    Chiang, Yu-Hsiu
    OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE, 2008, 36 (06): : 1038 - 1052
  • [4] Efficiency of Government-Sponsored R&D Projects: A Metafrontier DEA Approach
    Park, Jung Ho
    Shin, Kwangsoo
    SUSTAINABILITY, 2018, 10 (07)
  • [5] Evaluation of government-sponsored R&D consortia in Japan
    Sakakibara, M
    POLICY EVALUATION IN INNOVATION AND TECHNOLOGY: TOWARDS BEST PRACTICES, 1997, : 225 - 253
  • [6] Strategic management of government-sponsored R&D portfolios
    Bozeman, B
    Rogers, J
    ENVIRONMENT AND PLANNING C-GOVERNMENT AND POLICY, 2001, 19 (03): : 413 - 442
  • [7] Estimating the benefits of government-sponsored energy R&D
    Lee, R
    Jordan, G
    Leiby, PN
    Owens, B
    Wolf, JL
    RESEARCH EVALUATION, 2003, 12 (03) : 183 - 195
  • [8] Payoffs from government-sponsored R&D in the US and Japan
    Rubenstein, AH
    TECHNOLOGY MANAGEMENT FOR RESHAPING THE WORLD, 2003, : 133 - 139
  • [9] Knowledge and rent spillovers through government-sponsored R&D consortia
    Nishimura, Junichi
    Okamuro, Hiroyuki
    SCIENCE AND PUBLIC POLICY, 2016, 43 (02) : 207 - 225
  • [10] Measuring relative efficiency of government-sponsored R&D projects: A three-stage approach
    Hsu, Fang-Ming
    Hsueh, Chao-Chih
    EVALUATION AND PROGRAM PLANNING, 2009, 32 (02) : 178 - 186