Live Demonstration: CNN Inference on the Focal Plane with a Pixel Processor Array

被引：0

作者：

Carey, Stephen J. ^{[1
]}

Bose, Laurie ^{[2
]}

Richardson, Thomas ^{[2
]}

Mayol-Cuevas, Walterio ^{[2
]}

Chen, Jianing ^{[1
]}

Dudek, Piotr ^{[1
]}

机构：

[1] Univ Manchester, Sch Elect & Elect Engn, Manchester, Lancs, England

[2] Univ Bristol, Fac Engn Aerosp & Comp Sci, Bristol, Avon, England

来源：

2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS) | 2020年

基金：

英国工程与自然科学研究理事会;

关键词：

D O I：

暂无

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

We present a novel method of CNN inference on a pixel processor array device, demonstrating it using a handwritten digit (digits 0-9) classification task, with all steps of the neural network computation performed on the focal plane. The vision chip that we deploy (SCAMP-7) has a 256x256 array of processor elements (PE) integrated within the image sensor. The algorithm runs at over 3000 frames per second (FPS) and over 90% classification accuracy, with the sensor chip only outputting ten scalar values corresponding to the classification scores.

引用

页数：1

共 50 条

[1] Live Demonstration: Digit Recognition On Pixel Processor Arrays
Bose, Laurie
Chen, Jianing
Carey, Stephen J.
Dudek, Piotr
Mayol-Cuevas, Walterio
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1705 - 1706
[2] Demonstration of a 1024 x 1024 Pixel InAs-GaSb Superlattice Focal Plane Array
Gunapala, S. D.
Ting, D. Z.
Hill, C. J.
Nguyen, J.
Soibel, A.
Rafol, S. B.
Keo, S. A.
Mumolo, J. M.
Lee, M. C.
Liu, J. K.
Yang, B.
IEEE PHOTONICS TECHNOLOGY LETTERS, 2010, 22 (24) : 1856 - 1858
[3] Live Demonstration: Depth from Focus on a Focal Plane Processor Using a Focus Tunable Liquid Lens
Martel, Julien N. P.
Mueller, Lorenz K.
Carey, Stephen J.
Mueller, Jonathan
Sandamirskaya, Yulia
Dudek, Piotr
2017 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2017,
[4] Digital-pixel Focal Plane Array Development
Brown, Matthew G.
Baker, Justin
Colonero, Curtis
Costa, Joe
Gardner, Tom
Kelly, Mike
Schultz, Ken
Tyrrell, Brian
Wey, Jim
QUANTUM SENSING AND NANOPHOTONIC DEVICES VII, 2010, 7608
[5] Benefits of small pixel focal plane array technology
Caulfield, John
Curzan, Jon
Lewis, Jay
OPTICAL SENSING, IMAGING, AND PHOTON COUNTING: NANOSTRUCTURED DEVICES AND APPLICATIONS, 2015, 9555
[6] Demonstration of 1024x1024 Pixel Dual-band QWIP Focal Plane Array
Gunapala, S. D.
Bandara, S. V.
Liu, J. K.
Mumolo, J. M.
Ting, D. Z.
Hill, C. J.
Nguyen, J.
Rafol, S. B.
INFRARED TECHNOLOGY AND APPLICATIONS XXXVI, PTS 1 AND 2, 2010, 7660
[7] Demonstration of Megapixel LWIR Superlattice Focal Plane Array
Gunapala, S. D.
Ting, D. Z.
Hill, C. J.
Nguyen, J.
Soibel, A.
Rafol, S. B.
Keo, S. A.
Mumolo, J. M.
Lee, M. C.
Liu, J. K.
Liao, A.
2010 23RD ANNUAL MEETING OF THE IEEE PHOTONICS SOCIETY, 2010, : 637 - 638
[8] INTERFACING A FOCAL PLANE INFRARED MOSAIC ARRAY AND AN OPTICAL PROCESSOR
CASASENT, D
HESTER, CF
PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1981, 317 : 185 - 195
[9] On-sensor binarized CNN inference with dynamic mode swapping in pixel processor arrays
Liu, Yanan
Bose, Laurie
Fan, Rui
Dudek, Piotr
Mayol-Cuevas, Walterio
FRONTIERS IN NEUROSCIENCE, 2022, 16
[10] Demonstration of High Performance LWIR Superlattice Focal Plane Array
Gunapala, S. D.
Ting, D. Z.
Nguyen, J.
Soibel, A.
Rafol, S. B.
Khoshakhlagh, A.
Mumolo, J. M.
Liu, J. K.
Keo, S. A.
Liao, A.
2011 IEEE PHOTONICS CONFERENCE (PHO), 2011, : 93 - 94

← 1 2 3 4 5 →