Object Storage for Deep Learning Frameworks

被引：4

作者：

Ozeri, Or ^{[1
]}

Ofer, Effi ^{[1
]}

Kat, Ronen ^{[1
]}

机构：

[1] IBM Res, Haifa, Israel

来源：

DIDL'18: PROCEEDINGS OF THE SECOND WORKSHOP ON DISTRIBUTED INFRASTRUCTURES FOR DEEP LEARNING | 2018年

关键词：

Machine Learning; Deep Learning; Object Storage;

D O I：

10.1145/3286490.3286562

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

The advent of big datasets and high speed GPUs is fueling the growth in machine and deep learning techniques. In this paper we explore storing the training data in object storage and demonstrate how this can be done effectively while providing sufficient throughput to high performance GPUs.

引用

页码：21 / 24

页数：4

共 50 条

[1] Comparative Study on Deep Learning Frameworks for Object Detection
Kurian, Elizebeth
Mathew, Justin
SECOND INTERNATIONAL CONFERENCE ON COMPUTER NETWORKS AND COMMUNICATION TECHNOLOGIES, ICCNCT 2019, 2020, 44 : 79 - 85
[2] Analysis of deep learning frameworks for object detection in motion
Gururaj, Vaishnavi
Ramesh, Shriya Varada
Satheesh, Sanjana
Kodipalli, Ashwini
Thimmaraju, Kusuma
INTERNATIONAL JOURNAL OF KNOWLEDGE-BASED AND INTELLIGENT ENGINEERING SYSTEMS, 2022, 26 (01) : 7 - 16
[3] The Case for Storage Optimization Decoupling in Deep Learning Frameworks
Macedo, Ricardo
Correia, Claudia
Dantas, Marco
Brito, Claudia
Xu, Weijia
Tanimura, Yusuke
Haga, Jason
Paulo, Joao
2021 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER 2021), 2021, : 649 - 656
[4] MONARCH: Hierarchical Storage Management for Deep Learning Frameworks
Dantas, Marco
Leitao, Diogo
Correia, Claudia
Macedo, Ricardo
Xu, Weijia
Paulo, Joao
2021 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER 2021), 2021, : 657 - 663
[5] A systematic review of deep learning frameworks for moving object segmentation
Dipika Gupta
Manish Kumar
Sachin Chaudhary
Multimedia Tools and Applications, 2024, 83 : 24715 - 24748
[6] A systematic review of deep learning frameworks for moving object segmentation
Gupta, Dipika
Kumar, Manish
Chaudhary, Sachin
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (8) : 24715 - 24748
[7] Review of Deep Learning Based Object Detection Methods and Their Mainstream Frameworks
Duan Zhongjing
Li Shaobo
Hu Jianjun
Yang Jing
Wang Zheng
LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (12)
[8] Is Using Deep Learning Frameworks Free? Characterizing Technical Debt in Deep Learning Frameworks
Liu, Jiakun
Huang, Qiao
Xia, Xin
Shihab, Emad
Lo, David
Li, Shanping
2020 IEEE/ACM 42ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: SOFTWARE ENGINEERING IN SOCIETY (ICSE-SEIS 2021), 2020, : 1 - 10
[9] POSTER: Keeping deep learning GPUs well fed using object storage
Ozeri, Or
Ofer, Effi
Kat, Ronen
SYSTOR'18: PROCEEDINGS OF THE 11TH ACM INTERNATIONAL SYSTEMS AND STORAGE CONFERENCE, 2018, : 128 - 128
[10] A Survey of Deep-learning Frameworks
Parvat, Aniruddha
Chavan, Jai
Kadam, Siddhesh
Dev, Souradeep
Pathak, Vidhi
PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON INVENTIVE SYSTEMS AND CONTROL (ICISC 2017), 2017, : 211 - 217

← 1 2 3 4 5 →