Exploration-Exploitation Tradeoff in the Adaptive Information Sampling of Unknown Spatial Fields with Mobile Robots

被引:2
|
作者
Munir, Aiman [1 ]
Parasuraman, Ramviyas [1 ]
机构
[1] Univ Georgia, Sch Comp, Athens, GA 30602 USA
关键词
mobile robots; exploration; informative path planning; adaptive sampling; mapping; GAUSSIAN PROCESS REGRESSION; OPTIMIZATION;
D O I
10.3390/s23239600
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Adaptive information-sampling approaches enable efficient selection of mobile robots' waypoints through which the accurate sensing and mapping of a physical process, such as the radiation or field intensity, can be obtained. A key parameter in the informative sampling objective function could be optimized balance the need to explore new information where the uncertainty is very high and to exploit the data sampled so far, with which a great deal of the underlying spatial fields can be obtained, such as the source locations or modalities of the physical process. However, works in the literature have either assumed the robot's energy is unconstrained or used a homogeneous availability of energy capacity among different robots. Therefore, this paper analyzes the impact of the adaptive information-sampling algorithm's information function used in exploration and exploitation to achieve a tradeoff between balancing the mapping, localization, and energy efficiency objectives. We use Gaussian process regression (GPR) to predict and estimate confidence bounds, thereby determining each point's informativeness. Through extensive experimental data, we provide a deeper and holistic perspective on the effect of information function parameters on the prediction map's accuracy (RMSE), confidence bound (variance), energy consumption (distance), and time spent (sample count) in both single- and multi-robot scenarios. The results provide meaningful insights into choosing the appropriate energy-aware information function parameters based on sensing objectives (e.g., source localization or mapping). Based on our analysis, we can conclude that it would be detrimental to give importance only to the uncertainty of the information function (which would explode the energy needs) or to the predictive mean of the information (which would jeopardize the mapping accuracy). By assigning more importance to the information uncertainly with some non-zero importance to the information value (e.g., 75:25 ratio), it is possible to achieve an optimal tradeoff between exploration and exploitation objectives while keeping the energy requirements manageable.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Adaptive Exploration-Exploitation Tradeoff for Opportunistic Bandits
    Wu, Huasen
    Guo, Xueying
    Liu, Xin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [2] Social Learning and the Exploration-Exploitation Tradeoff
    Mintz, Brian
    Fu, Feng
    COMPUTATION, 2023, 11 (05)
  • [3] Adaptive exploration policy for exploration-exploitation tradeoff in continuous action control optimization
    Li, Min
    Huang, Tianyi
    Zhu, William
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2021, 12 (12) : 3491 - 3501
  • [4] Adaptive Genetic Algorithm with Exploration-Exploitation Tradeoff for Preprocessing Microarray Datasets
    Rajappan, Sivaraj
    Rangasamy, DeviPriya
    CURRENT BIOINFORMATICS, 2017, 12 (05) : 441 - 451
  • [5] The Exploration-Exploitation Tradeoff and Efficiency in Knowledge Production
    Sudhir, K.
    MARKETING SCIENCE, 2016, 35 (01) : 1 - 9
  • [6] Source Coding in the Presence of Exploration-Exploitation Tradeoff
    Akyol, Emrah
    Mitra, Urbashi
    Tuncel, Ertem
    Rose, Kenneth
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 2057 - 2061
  • [7] Dopamine, Locus of Control, and the Exploration-Exploitation Tradeoff
    Andrew S Kayser
    Jennifer M Mitchell
    Dawn Weinstein
    Michael J Frank
    Neuropsychopharmacology, 2015, 40 : 454 - 462
  • [8] Dopamine, Locus of Control, and the Exploration-Exploitation Tradeoff
    Kayser, Andrew S.
    Mitchell, Jennifer M.
    Weinstein, Dawn
    Frank, Michael J.
    NEUROPSYCHOPHARMACOLOGY, 2015, 40 (02) : 454 - 462
  • [9] Unpacking the exploration-exploitation tradeoff on Snapchat: The relationships between users' exploration-exploitation interests and server log data
    Gomez-Zara, Diego
    Liu, Yozen
    Neves, Leonardo
    Shah, Neil
    Bos, Maarten W.
    COMPUTERS IN HUMAN BEHAVIOR, 2024, 150
  • [10] The Empirical Analysis of Exploration-Exploitation Tradeoff for Uncertain Environment
    Li, Kun
    Li, Ming
    Chen, Hao
    2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 1, 2014, : 274 - 279