Securing IP in edge AI: neural network watermarking for multimodal models

被引:3
|
作者
Nie, Hewang [1 ]
Lu, Songfeng [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Cyber Sci & Engn, Wuhan 430074, Peoples R China
[2] Shenzhen Huazhong Univ Sci & Technol, Res Inst, Shenzhen 518057, Peoples R China
基金
国家重点研发计划;
关键词
Deep learning; Intellectual property; Model watermarking; Multimodal model;
D O I
10.1007/s10489-024-05746-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the realm of edge AI systems where deep learning is paramount, protecting the intellectual property (IP) of multimodal neural network models is crucial. Current watermarking solutions often bypass the intricacies of multimodal models and the unique constraints of edge environments. Addressing this, a novel watermarking scheme specifically devised for multimodal neural networks is introduced, marking a significant stride in securing these models against IP theft and unauthorized use. A discrete watermark is ingeniously embedded within each modality of a multimodal model, synthesizing a comprehensive watermark that spans the entire model. This method ensures IP protection across varied data types without hampering the model's performance or imposing undue computational demands, making it ideal for resource-limited edge devices. By leveraging the redundancies inherent in multimodal data, watermarks are embedded efficiently, maintaining model integrity and operational effectiveness. A robust verification mechanism is implemented, accurately identifying watermark presence across modalities with minimal computational overhead. Empirical validation on a benchmark dataset demonstrates the method's efficacy in embedding watermarks discreetly while preserving the model's original task performance, showing a 1 to 4% increase in watermark detection rates and a 6 to 10% reduction in false positives compared to existing approaches. This positions the scheme as an effective strategy for IP protection in multimodal neural network models, especially suited for the computational economy required in edge AI systems. The work advances neural network watermarking and addresses the urgent need for scalable IP protection solutions in the evolving AI landscape.
引用
收藏
页码:10455 / 10472
页数:18
相关论文
共 50 条
  • [1] Securing Biometric Authentication Through Multimodal Watermarking
    Abdul, Wadood
    2015 THIRD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, MODELLING AND SIMULATION (AIMS 2015), 2015, : 343 - 346
  • [2] Homomorphically Securing AI at the Edge
    Naucke, Jakob
    Hunt, Hamish
    Crawford, Jack
    Steffinlongo, Enrico
    Masters, Oliver
    Bergamaschi, Flavio
    PROCEEDINGS OF THE 2019 INTERNATIONAL WORKSHOP ON CHALLENGES IN ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR INTERNET OF THINGS (AICHALLENGEIOT '19), 2019, : 32 - 38
  • [3] Securing the Edge of the Network
    Andersen, Jason
    MANUFACTURING ENGINEERING, 2018, 161 (07): : 64 - 64
  • [4] Securing Multimodal Biometric Data through Watermarking and Steganography
    Whitelam, Cameron
    Osia, Nnamdi
    Bourlai, Thirimachos
    2013 IEEE INTERNATIONAL CONFERENCE ON TECHNOLOGIES FOR HOMELAND SECURITY (HST), 2013, : 61 - 66
  • [5] Robust Watermarking for Neural Network Models Using Residual Network
    Wang, Lecong
    Wang, Zichi
    Li, Xinran
    Qin, Chuan
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [6] Multiple watermarking technique for securing online social network contents using Back Propagation Neural Network
    Singh, Amit Kumar
    Kumar, Basant
    Singh, Sanjay Kumar
    Ghrera, S. P.
    Mohan, Anand
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 86 : 926 - 939
  • [7] Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing
    Li, En
    Zeng, Liekang
    Zhou, Zhi
    Chen, Xu
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (01) : 447 - 457
  • [8] Enabling Micro AI for Securing Edge Devices at Hardware Level
    Wang, Han
    Sayadi, Hossein
    Dinakarrao, Sai Manoj Pudukotai
    Sasan, Avesta
    Rafatirad, Setareh
    Homayoun, Houman
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2021, 11 (04) : 803 - 815
  • [9] Aedes-AI: Neural network models of mosquito abundance
    Kinney, Adrienne C.
    Current, Sean
    Lega, Joceline
    PLOS COMPUTATIONAL BIOLOGY, 2021, 17 (11)
  • [10] AIME: Watermarking AI Models by Leveraging Errors
    Mehta, Dhwani
    Mondol, Nurun
    Farahmandi, Farimah
    Tehranipoor, Mark
    PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 304 - 309