Optimal survey design for big data

被引:0
|
作者
Schlumberger PetroTechnical Services, Houston [1 ]
TX, United States
不详 [2 ]
MA, United States
机构
来源
| / 3卷 / P11-P22期
关键词
Acquisition geometry - Dimensionality reduction method - Optimal experimental designs - Orders of magnitude - Rank revealing QR factorizations - Reduced memory requirements - Source-receiver pairs - Technical challenges;
D O I
10.1190/geo2014-0425.1
中图分类号
学科分类号
摘要
The volume of data routinely acquired in many industrial geoscientific settings has increased to a point that it poses serious technical challenges to store and process. Optimal experimental design is a tool that can address some of these challenges. First, before data acquisition, optimal design can forecast optimum acquisition geometries and can thus be used to minimize the acquired data volume and reduce the cost of the data life cycle. Second, after data acquisition, optimal design can optimally select the best data to process, thus minimizing the data volume throughput in processing workflows. The catch is that optimal survey design is itself subject to the computational difficulties of big data. We have developed a parallelizable dimensionality reduction method, based on sparse rank-revealing QR-factorization to reduce computing and storage costs for optimal survey design. We implemented the distributable procedure for a guided Bayesian survey design and developed it as part of a workflow to optimize a marine seismic survey of more than 100 million source-receiver pairs in the Gulf of Mexico. The method improved computation times by more than an order of magnitude and reduced memory requirements by nearly two orders of magnitude. Although the procedure involves approximations in exchange for subsequent computational efficiency, the marine survey design results were identical to those achieved without compression. The distributable reduction method may be generally useful for matrix reduction problems in which the matrix data are distributed over multiple machines. © 2015 Society of Exploration Geophysicists.
引用
收藏
相关论文
共 50 条
  • [41] Classification Techniques for Big Data: A Survey
    Pandey, Priyank
    Kumar, Manoj
    Srivastava, Prakhar
    PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 3625 - 3629
  • [42] Survey on Visualization Layout for Big Data
    Teng, Pengju
    Li, Hongjun
    Zhang, Xiaopeng
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: BIG DATA AND MACHINE LEARNING TECHNIQUES, ISCIDE 2015, PT II, 2015, 9243 : 384 - 394
  • [43] A Survey Paper on Big Data Analytics
    Praveena, M. D. Anto
    Bharathi, B.
    2017 INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND EMBEDDED SYSTEMS (ICICES), 2017,
  • [44] Big Data Reduction Methods: A Survey
    Rehman, Muhammad Habib ur
    Liew, Chee Sun
    Abbas, Assad
    Jayaraman, Prem Prakash
    Wah, Teh Ying
    Khan, Samee U.
    DATA SCIENCE AND ENGINEERING, 2016, 1 (04) : 265 - 284
  • [45] A Survey on Job Scheduling in Big Data
    Senthilkumar, M.
    Ilango, P.
    CYBERNETICS AND INFORMATION TECHNOLOGIES, 2016, 16 (03) : 35 - 51
  • [46] Big Data for Internet of Things: A Survey
    Ge, Mouzhi
    Bangui, Hind
    Buhnova, Barbora
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 87 : 601 - 614
  • [47] Geospatial Big Data: Survey and Challenges
    Wu, Jiayang
    Gan, Wensheng
    Chao, Han-Chieh
    Yu, Philip S.
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 17007 - 17020
  • [48] Survey of Big Data Warehousing Techniques
    Kaur, Jaspreet
    Shedge, Rajashree
    Joshi, Bharti
    INVENTIVE COMMUNICATION AND COMPUTATIONAL TECHNOLOGIES, ICICCT 2019, 2020, 89 : 471 - 481
  • [49] An experimental survey on big data frameworks
    Inoubli, Wissem
    Aridhi, Sabeur
    Mezni, Haithem
    Maddouri, Mondher
    Nguifo, Engelbert Mephu
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 86 : 546 - 564
  • [50] Big Data Layers and Analytics: A Survey
    Manikandan, G.
    Abirami, S.
    COMPUTER COMMUNICATION, NETWORKING AND INTERNET SECURITY, 2017, 5 : 383 - 393