Live Demonstration: CNN Inference on the Focal Plane with a Pixel Processor Array

被引:0
|
作者
Carey, Stephen J. [1 ]
Bose, Laurie [2 ]
Richardson, Thomas [2 ]
Mayol-Cuevas, Walterio [2 ]
Chen, Jianing [1 ]
Dudek, Piotr [1 ]
机构
[1] Univ Manchester, Sch Elect & Elect Engn, Manchester, Lancs, England
[2] Univ Bristol, Fac Engn Aerosp & Comp Sci, Bristol, Avon, England
基金
英国工程与自然科学研究理事会;
关键词
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We present a novel method of CNN inference on a pixel processor array device, demonstrating it using a handwritten digit (digits 0-9) classification task, with all steps of the neural network computation performed on the focal plane. The vision chip that we deploy (SCAMP-7) has a 256x256 array of processor elements (PE) integrated within the image sensor. The algorithm runs at over 3000 frames per second (FPS) and over 90% classification accuracy, with the sensor chip only outputting ten scalar values corresponding to the classification scores.
引用
收藏
页数:1
相关论文
共 50 条
  • [21] A 63-Pixel Plasmonic Photoconductive Terahertz Focal-Plane Array
    Li, Xurong
    Jarrahi, Mona
    PROCEEDINGS OF THE 2020 IEEE/MTT-S INTERNATIONAL MICROWAVE SYMPOSIUM (IMS), 2020, : 91 - 94
  • [22] 3D integrated scalable focal-plane processor array
    Foeldesy, Peter
    Zarandy, Akos
    Rekeczky, Csaba
    Roska, Tamas
    2007 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN, VOLS 1-3, 2007, : 954 - 957
  • [23] Demonstration of 640x512 pixel four-band quantum well infrared photodetector (QWIP) focal plane array
    Gunapala, SD
    Bandara, SV
    Liu, JK
    Rafol, SB
    Jhabvala, M
    Choi, KK
    COMPOUND SEMICONDUCTORS 2002, 2003, 174 : 393 - 396
  • [24] Focal Plane Array Doppler imaging with per-pixel CW-Doppler receiver array
    Takeuchi, Y
    2000 IEEE ULTRASONICS SYMPOSIUM PROCEEDINGS, VOLS 1 AND 2, 2000, : 1501 - 1504
  • [25] The Kilopixel Array Pathfinder Project (KAPPa), a 16-pixel integrated heterodyne focal plane array - Characterization of the Single Pixel Prototype
    Wheeler, Caleb H.
    Groppi, Christopher E.
    Mani, Hamdi
    McGarey, Patrick
    Kuenzi, Linda
    Weinreb, Sander
    Russell, Damon S.
    Kooi, Jacob W.
    Lichtenberger, Arthur W.
    Walker, Christopher K.
    Kulesa, Craig
    MILLIMETER, SUBMILLIMETER, AND FAR-INFRARED DETECTORS AND INSTRUMENTATION FOR ASTRONOMY VII, 2014, 9153
  • [26] The Kilopixel Array Pathfinder Project (KAPPa), a 16-pixel integrated heterodyne focal plane array - Characterization of the Single Pixel Prototype
    Wheeler, Caleb
    Groppi, Chris
    Mani, Hamdi
    Kuenzi, Linda
    McGarey, Patrick
    Weinreb, Sander
    Russell, Damon
    Kooi, Jacob W.
    Lichtenberger, Arthur W.
    Walker, Christopher K.
    Kulsea, Craig
    2014 39TH INTERNATIONAL CONFERENCE ON INFRARED, MILLIMETER, AND TERAHERTZ WAVES (IRMMW-THZ), 2014,
  • [27] Analytical expression for pixel-averaged point sources as observed by a focal plane array
    Nichols, J. M.
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2016, 33 (08) : 1569 - 1578
  • [28] First Demonstration of Megapixel Dual-band QWIP Focal Plane Array
    Gunapala, S. D.
    Bandara, S. V.
    Liu, J. K.
    Mumolo, J. M.
    Ting, D. Z.
    Hill, C. J.
    Nguyen, J.
    2009 IEEE SENSORS, VOLS 1-3, 2009, : 1609 - 1612
  • [29] Experimental results of simplicial CNN digital pixel processor
    Di Federico, M.
    Mandolesi, P. S.
    Julian, P.
    Andreou, A. G.
    ELECTRONICS LETTERS, 2008, 44 (01) : 27 - 28
  • [30] Uncooled Infrared Radiation Focal Plane Array with Low Noise Pixel Driving Circuit
    Ueno, Risako
    Honda, Hiroto
    Kwon, Honam
    Ishii, Koichi
    Ogata, Masako
    Yagi, Hitoshi
    Fujiwara, Ikuo
    Suzuki, Kazuhiro
    Sasaki, Keita
    Funaki, Hideyuki
    IEICE TRANSACTIONS ON ELECTRONICS, 2010, E93C (11) : 1577 - 1582