Neural Language Models and Few Shot Learning for Systematic Requirements Processing in MDSE

被引:4
|
作者
Bertram, Vincent [1 ]
Boss, Miriam [1 ]
Kusmenko, Evgeny [1 ]
Nachmann, Imke Helene [1 ]
Rumpe, Bernhard [1 ]
Trotta, Danilo [1 ]
Wachtmeister, Louis [1 ]
机构
[1] Rhein Westfal TH Aachen, Aachen, Germany
关键词
model-driven requirements engineering; fewshot learning; natural language processing;
D O I
10.1145/3567512.3567534
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Systems engineering, in particular in the automotive domain, needs to cope with the massively increasing numbers of requirements that arise during the development process. The language in which requirements are written is mostly informal and highly individual. This hinders automated processing of requirements as well as the linking of requirements to models. Introducing formal requirement notations in existing projects leads to the challenge of translating masses of requirements and the necessity of training for requirements engineers. In this paper, we derive domain-specific language constructs helping us to avoid ambiguities in requirements and increase the level of formality. The main contribution is the adoption and evaluation of few-shot learning with large pretrained language models for the automated translation of informal requirements to structured languages such as a requirement DSL.
引用
收藏
页码:260 / 265
页数:6
相关论文
共 50 条
  • [31] Large Language Models for Few-Shot Automatic Term Extraction
    Banerjee, Shubhanker
    Chakravarthi, Bharathi Raja
    McCrae, John Philip
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS, PT I, NLDB 2024, 2024, 14762 : 137 - 150
  • [32] Large Language Models (LLMs) Enable Few-Shot Clustering
    Vijay, Viswanathan
    Kiril, Gashteovski
    Carolin, Lawrence
    Tongshuang, Wu
    Graham, Neubig
    NEC Technical Journal, 2024, 17 (02): : 80 - 90
  • [33] Task Contamination: Language Models May Not Be Few-Shot Anymore
    Li, Changmao
    Flanigan, Jeffrey
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 18471 - 18480
  • [34] Few-Shot Semantic Parsing with Language Models Trained on Code
    Shin, Richard
    Van Durme, Benjamin
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 5417 - 5425
  • [35] Unsupervised and few-shot parsing from pretrained language models
    Zeng, Zhiyuan
    Xiong, Deyi
    ARTIFICIAL INTELLIGENCE, 2022, 305
  • [36] Constrained Language Models Yield Few-Shot Semantic Parsers
    Shin, Richard
    Lin, Christopher H.
    Thomson, Sam
    Chen, Charles
    Roy, Subhro
    Platanios, Emmanouil Antonios
    Pauls, Adam
    Klein, Dan
    Eisner, Jason
    Van Durme, Benjamin
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 7699 - 7715
  • [37] Few-Shot Adaptation of Medical Vision-Language Models
    Shakeri, Fereshteh
    Huang, Yunshi
    Silva-Rodriguez, Julio
    Bahig, Houda
    Tang, An
    Dolz, Jose
    Ben Ayed, Ismail
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XII, 2024, 15012 : 553 - 563
  • [38] Getting to Production with Few-shot Natural Language Generation Models
    Heidari, Peyman
    Einolghozati, Arash
    Jain, Shashank
    Batra, Soumya
    Callender, Lee
    Arun, Ankit
    Mei, Shawn
    Gupta, Sonal
    Donmez, Pinar
    Bhardwaj, Vikas
    Kumar, Anuj
    White, Michael
    SIGDIAL 2021: 22ND ANNUAL MEETING OF THE SPECIAL INTEREST GROUP ON DISCOURSE AND DIALOGUE (SIGDIAL 2021), 2021, : 66 - 76
  • [39] JASMINE: Arabic GPT Models for Few-Shot Learning
    Nagoudi, El Moatez Billah
    Abdul-Mageed, Muhammad
    Elmadany, AbdelRahim
    Inciarte, Alcides Alcoba
    Khondaker, Tawkat Islam
    EMNLP 2023 - 2023 Conference on Empirical Methods in Natural Language Processing, Proceedings, 2023, : 16721 - 16744
  • [40] JASMINE: Arabic GPT Models for Few-Shot Learning
    Nagoudi, El Moatez Billah
    Abdul-Mageed, Muhammad
    Elmadany, AbdelRahim
    Inciarte, Alcides Alcoba
    Khondaker, Md Tawkat Islam
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 16721 - 16744