Optimal survey design for big data

被引:0
|
作者
Schlumberger PetroTechnical Services, Houston [1 ]
TX, United States
不详 [2 ]
MA, United States
机构
来源
| / 3卷 / P11-P22期
关键词
Acquisition geometry - Dimensionality reduction method - Optimal experimental designs - Orders of magnitude - Rank revealing QR factorizations - Reduced memory requirements - Source-receiver pairs - Technical challenges;
D O I
10.1190/geo2014-0425.1
中图分类号
学科分类号
摘要
The volume of data routinely acquired in many industrial geoscientific settings has increased to a point that it poses serious technical challenges to store and process. Optimal experimental design is a tool that can address some of these challenges. First, before data acquisition, optimal design can forecast optimum acquisition geometries and can thus be used to minimize the acquired data volume and reduce the cost of the data life cycle. Second, after data acquisition, optimal design can optimally select the best data to process, thus minimizing the data volume throughput in processing workflows. The catch is that optimal survey design is itself subject to the computational difficulties of big data. We have developed a parallelizable dimensionality reduction method, based on sparse rank-revealing QR-factorization to reduce computing and storage costs for optimal survey design. We implemented the distributable procedure for a guided Bayesian survey design and developed it as part of a workflow to optimize a marine seismic survey of more than 100 million source-receiver pairs in the Gulf of Mexico. The method improved computation times by more than an order of magnitude and reduced memory requirements by nearly two orders of magnitude. Although the procedure involves approximations in exchange for subsequent computational efficiency, the marine survey design results were identical to those achieved without compression. The distributable reduction method may be generally useful for matrix reduction problems in which the matrix data are distributed over multiple machines. © 2015 Society of Exploration Geophysicists.
引用
收藏
相关论文
共 50 条
  • [31] Big Data Augmentation with Data Warehouse: A Survey
    Aftab, Umar
    Siddiqui, Ghazanfar Farooq
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2775 - 2784
  • [32] A Survey of Biological Data in a Big Data Perspective
    Dall'Alba, Gabriel
    Casa, Pedro Lenz
    de Abreu, Fernanda Pessi
    Notari, Daniel Luis
    de Avila e Silva, Scheila
    BIG DATA, 2022, 10 (04) : 279 - 297
  • [33] Optimal city zoning and Big Data
    Colombo, Stefano
    JOURNAL OF URBAN MANAGEMENT, 2022, 11 (02) : 269 - 277
  • [34] Applications of Big Data in Tourism: A Survey
    Becha, Malika
    Riabi, Oumayma
    Benmessaoud, Yasmine
    Masri, Hela
    ADVANCED DATA MINING AND APPLICATIONS, 2020, 12447 : 533 - 546
  • [35] Survey on NoSQL for management of big data
    Shen, De-Rong
    Yu, Ge
    Wang, Xi-Te
    Nie, Tie-Zheng
    Kou, Yue
    Ruan Jian Xue Bao/Journal of Software, 2013, 24 (08): : 1786 - 1803
  • [36] A Survey of Tools and Applications in Big Data
    Menon, Sindhu P.
    Hegde, Nagaratna P.
    PROCEEDINGS OF 2015 IEEE 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND CONTROL (ISCO), 2015,
  • [37] A Survey on Big Data Security Algorithms
    Prasanna, K. Lakshmi
    Reddy, M. Thrilok
    Prakash, S. Shiva
    HELIX, 2018, 8 (02): : 3290 - 3293
  • [38] Big data storage technologies: a survey
    Aisha Siddiqa
    Ahmad Karim
    Abdullah Gani
    Frontiers of Information Technology & Electronic Engineering, 2017, 18 : 1040 - 1070
  • [39] A Survey on Big Data for Trajectory Analytics
    de Almeida, Damao Ribeiro
    Baptista, Claudio de Souza
    de Andrade, Fabio Gomes
    Soares, Amilcar
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (02)
  • [40] A Survey on Deep Learning in Big Data
    Gheisari, Mehdi
    Wang, Guojun
    Bhuiyan, Md Zakirul Alam
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE) AND IEEE/IFIP INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (EUC), VOL 2, 2017, : 173 - 180