Data race detection via few-shot parameter-efficient fine-tuning

被引:0
|
作者
Shen, Yuanyuan [1 ]
Peng, Manman [2 ]
Zhang, Fan [2 ]
Wu, Qiang [2 ]
机构
[1] North Univ China, Sch Data Sci & Technol, Taiyuan 030051, Peoples R China
[2] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha 410082, Peoples R China
关键词
Data race detection; Parallelization; Few-shot parameter-efficient fine-tuning; Adapter; Neural architecture search;
D O I
10.1016/j.jss.2024.112289
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The OpenMP programming model is playing an increasing role in parallelization on shared-memory systems owing to its simplicity of operation and portability. OpenMP provides the semantic equivalent of a parallel program for the original sequential program. Though it is easier to write parallel programs using OpenMP, writing them correctly is a challenge. Data race conditions errors can easily occur during the writing process, particularly by inexperienced programmers. Some data race checkers have been developed to help programmers check for data race in parallel programs. However, several of them have constraints on the input and thread configuration, time overhead, and scope of program analysis. In this study, we target data race detection in OpenMP parallel programs to address the issues of constraints from checkers. We propose a few-shot parameter-efficient fine-tuning method using adapter module to address data race detection issue. The proposed method does not require a large labeled dataset, and it makes data efficient. A generic dataset is constructed with a limited number of labeled data, containing diverse OpenMP patterns for data race detection. A neural architecture search approach is employed to improve the performance of detection. The experimental results on the generated and open-source datasets demonstrate that our method is effective and improves race detection compared with traditional methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Strong Baselines for Parameter-Efficient Few-Shot Fine-Tuning
    Basu, Samyadeep
    Hu, Shell
    Massiceti, Daniela
    Feizi, Soheil
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 10, 2024, : 11024 - 11031
  • [2] Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
    Liu, Haokun
    Tam, Derek
    Muqeeth, Mohammed
    Mohta, Jay
    Huang, Tenghao
    Raffel, Mohit Bansal Colin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [3] Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentation
    Silva-Rodriguez, Julio
    Dolz, Jose
    Ben Ayed, Ismail
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023 WORKSHOPS, 2023, 14393 : 213 - 224
  • [4] Incremental Few-Shot Object Detection via Simple Fine-Tuning Approach
    Choi, Tae-Min
    Kim, Jong-Hwan
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9289 - 9295
  • [5] On the Effectiveness of Parameter-Efficient Fine-Tuning
    Fu, Zihao
    Yang, Haoran
    So, Anthony Man-Cho
    Lam, Wai
    Bing, Lidong
    Collier, Nigel
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 12799 - 12807
  • [6] EFTNet: an efficient fine-tuning method for few-shot segmentation
    Li, Jiaguang
    Wang, Yubo
    Gao, Zihan
    Wei, Ying
    APPLIED INTELLIGENCE, 2024, 54 (19) : 9488 - 9507
  • [7] PROTECT: Parameter-Efficient Tuning for Few-Shot Robust Chinese Text Correction
    Feng, Xuan
    Gu, Tianlong
    Chang, Liang
    Liu, Xiaoli
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 3270 - 3282
  • [8] Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning
    Zhang, Jian-Guo
    Bui, Trung
    Yoon, Seunghyun
    Chen, Xiang
    Liu, Zhiwei
    Xia, Congying
    Tran, Quan Hung
    Chang, Walter
    Yu, Philip
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 1906 - 1912
  • [9] AirDet: Few-Shot Detection Without Fine-Tuning for Autonomous Exploration
    Li, Bowen
    Wang, Chen
    Reddy, Pranay
    Kim, Seungchan
    Scherer, Sebastian
    COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 : 427 - 444
  • [10] AirDet: Few-Shot Detection without Fine-tuning for Autonomous Exploration
    Li, Bowen
    Wang, Chen
    Reddy, Pranay
    Kim, Seungchan
    Scherer, Sebastian
    arXiv, 2021,