Hardware/software co-design of a real-time kernel based tracking system

被引:25
|
作者
Ali, Usman
Malik, Mohammad Bilal
机构
[1] Department of Electrical Engineering, College of Electrical and Mechanical Engineering, National University of Sciences and Technology
关键词
Mean shift; Tracking; Embedded; FPGA; Co-design; Real-time;
D O I
10.1016/j.sysarc.2010.04.008
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The probabilistic visual tracking methods using color histograms have been proven to be robust to target model variations and background illumination changes as shown by the recent research. However, the required computational cost is high due to intensive image data processing. The embedded solution of such algorithms become challenging due to high computational power demand and algorithm complexity. This paper presents a hardware/software co-design architecture for implementation of the well-known kernel based mean shift tracking algorithm. The design uses color histogram of the target as tracking feature. The target is searched in the consecutive images by maximizing the statistical match of the color distributions. The target localization is based on gradient based iterative search instead of exhaustive search which makes the system capable of achieving frame rate up to hundreds of frames per second while tracking multiple targets. The design, which is fully standalone, is implemented on a low-cost medium-size field programmable gate array (FPGA) device. The hardware cost of the design is compared with some other tracking systems. The performance of the system in terms of speed is evaluated and compared with the software based implementation. It is expected that the proposed solution will find its utility in applications like embedded automatic video surveillance systems. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:317 / 326
页数:10
相关论文
共 50 条
  • [41] Hardware/Software Co-Design of Fractal Features Based Fall Detection System
    Tahir, Ahsen
    Morison, Gordon
    Skelton, Dawn A.
    Gibson, Ryan M.
    SENSORS, 2020, 20 (08)
  • [42] A feature-based approach to embedded system hardware and software co-design
    Zha, Xuan F.
    Fenves, Steven J.
    Sriram, Ram D.
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE 2005, VOL 3, PTS A AND B, 2005, : 609 - 620
  • [43] I/O-GUARD: Hardware/Software Co-Design for I/O Virtualization with Guaranteed Real-time Performance
    Jiang, Zhe
    Yang, Kecheng
    Ma, Yunfeng
    Fisher, Nathan
    Audsley, Neil
    Dong, Zheng
    2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, : 1159 - 1164
  • [44] FPGA-based hardware/firmware co-design for real-time radiometric correction onboard microsatellite
    Ghelamallah, Youcef
    Rachedi, Azzeddine
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (05)
  • [45] Hardware-Software Co-Design for Real-Time Latency-Accuracy Navigation in Tiny Machine Learning Applications
    Behnam, Payman
    Tong, Jianming
    Khare, Alind
    Chen, Yangyu
    Pan, Yue
    Gadikar, Pranav
    Bambhaniya, Abhimanyu
    Krishna, Tushar
    Tumanov, Alexey
    IEEE MICRO, 2023, 43 (06) : 93 - 101
  • [46] Real-time multi-task diffractive deep neural networks via hardware-software co-design
    Yingjie Li
    Ruiyang Chen
    Berardi Sensale-Rodriguez
    Weilu Gao
    Cunxi Yu
    Scientific Reports, 11
  • [47] Real-time multi-task diffractive deep neural networks via hardware-software co-design
    Li, Yingjie
    Chen, Ruiyang
    Sensale-Rodriguez, Berardi
    Gao, Weilu
    Yu, Cunxi
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [48] Hardware-Software Co-design of 3D Data Compression for Real-time Ultrasonic Imaging Applications
    Govindan, Pramod
    Saniie, Jafar
    2014 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2014, : 564 - 567
  • [49] A Survey of Hardware and Software Co-design Issues for System on Chip Design
    Kokila, J.
    Ramasubramanian, N.
    Indrajeet, S.
    ADVANCED COMPUTING AND COMMUNICATION TECHNOLOGIES, 2016, 452 : 41 - 49
  • [50] FPGA-Based Software Profiler for Hardware/Software Co-design
    Saad, El-Sayed M.
    Awadalla, Medhat H. A.
    El-Deen, Kareem Ezz
    NRSC: 2009 NATIONAL RADIO SCIENCE CONFERENCE: NRSC 2009, VOLS 1 AND 2, 2009, : 475 - 482