TinyML-On-The-Fly: Real-Time Low-Power and Low-Cost MCU-Embedded On-Device Computer Vision for Aerial Image Classification

被引:0
|
作者
Samanta, Riya [1 ]
Saha, Bidyut [1 ]
Ghosh, Soumya K. [1 ]
机构
[1] Indian Inst Technol Kharagpur, Kharagpur, W Bengal, India
来源
2024 IEEE SPACE, AEROSPACE AND DEFENCE CONFERENCE, SPACE 2024 | 2024年
关键词
Aerial Image Classification; Computer Vision; MobileNet; TinyML; On-device Inference; UAV;
D O I
10.1109/SPACE63117.2024.10667906
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Aerial image classification is essential to intelligent surveillance and monitoring systems. Traditional computer vision methods either uses computational offloading to high-end servers or edge devices. However, unmanned aerial vehicles (UAVs) platforms have resource and power constraints. Aerial image classification is complicated and less-expensive UAVs lack processing power and cameras. Even with large-scale computing environments, methods for classifying images are difficult to apply to aerial imagery. We propose TinyAerialNet leveraging TinyML for real-time inference on a resource-constrained ESP32 CAM. The model tested on AIDER dataset, achieves 88% on-device accuracy in the micro-controller with 103.9 KB RAM and 850 milliseconds for inference.
引用
收藏
页码:194 / 198
页数:5
相关论文
共 50 条
  • [1] Low-power and Real-time Computer Vision On-chip
    Pang, Wei
    Huang, Hantao
    An, Fengwei
    Yu, Hao
    2016 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2016, : 43 - 44
  • [2] A Low-Cost Computer Vision System for Real-Time Tennis Analysis
    Messelodi, S.
    Modena, C. M.
    Ropele, V.
    Marcon, S.
    Sgro, M.
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2019, PT I, 2019, 11751 : 106 - 116
  • [3] Device-centric low-power scheduling for real-time embedded systems
    Hsiung, PA
    Kao, HC
    INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2005, 15 (02) : 461 - 466
  • [4] A Low-Cost, Low-Power and Real-Time Image Detector for Grape Leaf Esca Disease Based on a Compressed CNN
    Falaschetti, Laura
    Manoni, Lorenzo
    Rivera, Romel Calero Fuentes
    Pau, Danilo
    Romanazzi, Gianfranco
    Silvestroni, Oriana
    Tomaselli, Valeria
    Turchetti, Claudio
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2021, 11 (03) : 468 - 481
  • [5] Real-time and low-cost embedded platform for car's surrounding vision system
    Saponara, Sergio
    Franchi, Emilio
    REAL-TIME IMAGE AND VIDEO PROCESSING 2016, 2016, 9897
  • [6] A Hypervisor Architecture for Low-Power Real-Time Embedded Systems
    Onaindia, Peio
    Poggi, Tomaso
    Azkarate-askatsua, Mikel
    Gruttner, Kim
    Fakih, Maher
    Peiro, Salvador
    Balbastre, Patricia
    2018 21ST EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN (DSD 2018), 2018, : 252 - 259
  • [7] Real-time reconfigurable cache for low-power embedded systems
    Jheng, Geng-Cyuan
    Duh, Dyi-Rong
    Lai, Cheng-Nan
    INTERNATIONAL JOURNAL OF EMBEDDED SYSTEMS, 2010, 4 (3-4) : 235 - 247
  • [8] A Low-Cost Real-Time Embedded Stereo Vision System for Accurate Disparity Estimation Based on Guided Image Filtering
    Ttofis, Christos
    Kyrkou, Christos
    Theocharides, Theocharis
    IEEE TRANSACTIONS ON COMPUTERS, 2016, 65 (09) : 2678 - 2693
  • [9] Real-Time Low-Power FPGA Architecture for Stereo Vision
    Puglia, Luca
    Vigliar, Mario
    Raiconi, Giancarlo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2017, 64 (11) : 1307 - 1311
  • [10] Real-Time 3D Door Detection and Classification on a Low-Power Device
    Ramoa, Joao Gaspar
    Alexandre, Luis A.
    Mogo, S.
    2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2020), 2020, : 96 - 101