RESTest: Automated Black-Box Testing of RESTful Web APIs

被引:33
|
作者
Martin-Lopez, Alberto [1 ]
Segura, Sergio [1 ]
Ruiz-Cortes, Antonio [1 ]
机构
[1] Univ Seville, I3US Inst, SCORE Lab, Seville, Spain
关键词
REST; black-box testing; web APIs;
D O I
10.1145/3460319.3469082
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Testing RESTful APIs thoroughly is critical due to their key role in software integration. Existing tools for the automated generation of test cases in this domain have shown great promise, but their applicability is limited as they mostly rely on random inputs, i.e., fuzzing. In this paper, we present RESTest, an open source blackbox testing framework for RESTful web APIs. Based on the API specification, RESTest supports the generation of test cases using different testing techniques such as fuzzing and constraint-based testing, among others. RESTest is developed as a framework and can be easily extended with new test case generators and test writers for different programming languages. We evaluate the tool in two scenarios: offline and online testing. In the former, we show how RESTest can efficiently generate realistic test cases (test inputs and test oracles) that uncover bugs in real-world APIs. In the latter, we show RESTest's capabilities as a continuous testing and monitoring framework. Demo video: https://youtu.be/1f_tjdkaCKo.
引用
收藏
页码:682 / 685
页数:4
相关论文
共 50 条
  • [41] On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research
    Pozzobon, Luiza
    Ermis, Beyza
    Lewis, Patrick
    Hooker, Sara
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 7595 - 7609
  • [42] Enhancing White-Box Search-Based Testing of RESTful APIs
    Golmohammadi, Amid
    2023 IEEE 34TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS, ISSREW, 2023, : 9 - 12
  • [43] Is This the Lifecycle We Really Want? An Automated Black-Box Testing Approach for Android Activities
    Riccio, Vincenzo
    Amalfitano, Domenico
    Fasolino, Anna Rita
    COMPANION PROCEEDINGS FOR THE ISSTA/ECOOP 2018 WORKSHOPS, 2018, : 68 - 77
  • [44] ATOM: Automated Black-Box Testing of Multi-Label Image Classification Systems
    Hu, Shengyou
    Wu, Huayao
    Wang, Peng
    Chang, Jing
    Tu, Yongjun
    Jiang, Xiu
    Niu, Xintao
    Nie, Changhai
    2023 38TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING, ASE, 2023, : 230 - 242
  • [45] SOFIA: An Automated Security Oracle for Black-Box Testing of SQL-Injection Vulnerabilities
    Ceccato, Mariano
    Nguyen, Cu D.
    Appelt, Dennis
    Briand, Lionel C.
    2016 31ST IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE), 2016, : 167 - 177
  • [46] Recent Advances in Automatic Black-Box Testing
    Mariani, Leonardo
    Pezze, Mauro
    Zuddas, Daniele
    ADVANCES IN COMPUTERS, VOL 99, 2015, 99 : 157 - 193
  • [47] AutoBlackTest: A Tool for Automatic Black-Box Testing
    Mariani, Leonardo
    Pezze, Mauro
    Riganelli, Oliviero
    Santoro, Mauro
    2011 33RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2011, : 1013 - 1015
  • [48] Fine-grained Code Coverage Measurement in Automated Black-box Android Testing
    Pilgun, Aleksandr
    Gadyatskaya, Olga
    Zhauniarovich, Yury
    Dashevskyi, Stanislav
    Kushniarou, Artsiom
    Mauw, Sjouke
    ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2020, 29 (04)
  • [49] Evolving a Test Oracle in Black-Box Testing
    Wang, Farn
    Wu, Jung-Hsuan
    Huang, Chung-Hao
    Chang, Kai-Hsiang
    FUNDAMENTAL APPROACHES TO SOFTWARE ENGINEERING, 2011, 6603 : 310 - 325
  • [50] A stochastic theory of black-box software testing
    Meinke, Karl
    ALGEBRA, MEANING, AND COMPUTATION: ESSAYS DEDICATED TO JOSEPH A. GOGUEN ON THE OCCASION OF HIS 65TH BIRTHDAY, 2006, 4060 : 578 - 595