Securing IP in edge AI: neural network watermarking for multimodal models

被引:3
|
作者
Nie, Hewang [1 ]
Lu, Songfeng [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Cyber Sci & Engn, Wuhan 430074, Peoples R China
[2] Shenzhen Huazhong Univ Sci & Technol, Res Inst, Shenzhen 518057, Peoples R China
基金
国家重点研发计划;
关键词
Deep learning; Intellectual property; Model watermarking; Multimodal model;
D O I
10.1007/s10489-024-05746-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the realm of edge AI systems where deep learning is paramount, protecting the intellectual property (IP) of multimodal neural network models is crucial. Current watermarking solutions often bypass the intricacies of multimodal models and the unique constraints of edge environments. Addressing this, a novel watermarking scheme specifically devised for multimodal neural networks is introduced, marking a significant stride in securing these models against IP theft and unauthorized use. A discrete watermark is ingeniously embedded within each modality of a multimodal model, synthesizing a comprehensive watermark that spans the entire model. This method ensures IP protection across varied data types without hampering the model's performance or imposing undue computational demands, making it ideal for resource-limited edge devices. By leveraging the redundancies inherent in multimodal data, watermarks are embedded efficiently, maintaining model integrity and operational effectiveness. A robust verification mechanism is implemented, accurately identifying watermark presence across modalities with minimal computational overhead. Empirical validation on a benchmark dataset demonstrates the method's efficacy in embedding watermarks discreetly while preserving the model's original task performance, showing a 1 to 4% increase in watermark detection rates and a 6 to 10% reduction in false positives compared to existing approaches. This positions the scheme as an effective strategy for IP protection in multimodal neural network models, especially suited for the computational economy required in edge AI systems. The work advances neural network watermarking and addresses the urgent need for scalable IP protection solutions in the evolving AI landscape.
引用
收藏
页码:10455 / 10472
页数:18
相关论文
共 50 条
  • [21] Watermarking Neural Network with Compensation Mechanism
    Feng, Le
    Zhang, Xinpeng
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT II, 2020, 12275 : 363 - 375
  • [22] Quantum Neural Network for image watermarking
    Hu, SY
    ADVANCES IN NEURAL NETWORKS - ISNN 2004, PT 2, 2004, 3174 : 669 - 674
  • [23] Multimodal Neural Language Models
    Kiros, Ryan
    Salakhutdinov, Ruslan
    Zemel, Richard
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 32 (CYCLE 2), 2014, 32 : 595 - 603
  • [24] Copyright protection of deep neural network models using digital watermarking: a comparative study
    Alaa Fkirin
    Gamal Attiya
    Ayman El-Sayed
    Marwa A. Shouman
    Multimedia Tools and Applications, 2022, 81 : 15961 - 15975
  • [25] Copyright protection of deep neural network models using digital watermarking: a comparative study
    Fkirin, Alaa
    Attiya, Gamal
    El-Sayed, Ayman
    Shouman, Marwa A.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (11) : 15961 - 15975
  • [26] Condense: A Framework for Device and Frequency Adaptive Neural Network Models on the Edge
    Gong, Yifan
    Zhao, Pu
    Zhan, Zheng
    Wu, Yushu
    Wu, Chao
    Kong, Zhenglun
    Qin, Minghai
    Ding, Caiwen
    Wang, Yanzhi
    2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,
  • [27] A graph neural network model for the diagnosis of lung adenocarcinoma based on multimodal features and an edge-generation network
    Li, Ruihao
    Zhou, Lingxiao
    Wang, Yunpeng
    Shan, Fei
    Chen, Xinrong
    Liu, Lei
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2023, 13 (08) : 5333 - 5348
  • [28] A Multimodal Dataset for Automatic Edge-AI Cough Detection
    Orlandic, Lara
    Thevenot, Jerome
    Teijeiro, Tomas
    Atienza, David
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [29] Semantics of Multimodal Network Models
    Heath, Lenwood S.
    Sioson, Allan A.
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2009, 6 (02) : 271 - 280
  • [30] Oscillatory Neural Networks for Edge AI Computing
    Delacour, Corentin
    Carapezzi, Stefania
    Abernot, Madeleine
    Boschetto, Gabriele
    Azemard, Nadine
    Salles, Jeremie
    Gil, Thierry
    Todri-Sanial, Aida
    2021 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2021), 2021, : 326 - 331