Studying Exploitation and Exploration Trade-Off of Cognitive Odour-Guided Search

被引:0
|
作者
Magalhaes, Hugo [1 ]
Baptista, Rui [1 ]
Marques, Lino [1 ]
机构
[1] Univ Coimbra, Inst Syst & Robot, P-3030790 Coimbra, Portugal
关键词
Odour Source Localisation; Information-theoretic; Field robotics;
D O I
10.1007/978-3-031-58676-7_16
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Cognitive search strategies are highly suitable for Odour Source Localisation (OSL) under turbulent flow conditions where continuous cues are not always available. While reliable, these methods have a known tendency to shift the weight of the search towards exploration, which increases the time and distance required to locate the source. Balancing the trade-off between exploration and exploitation (EE) is crucial since it can directly influence the efficiency and reliability of the mission. However, its understanding from a motion decision perspective still remains unclear with most conclusions being drawn from visual interpretation of the search trajectories or from results of performance metrics. This work aims to study the EE trade-off of cognitive OSL actions by identifying movement patterns and quantifying their values for multiple metrics associated with the decision. A large number of experiments were performed under realistic simulated environments, with the results showing the emergence of multiple well-defined movement patterns and EE tendencies that remain identical across different scenarios.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [41] Exploring new technologies for the future generation: exploration-exploitation trade-off in an intergenerational framework
    Nakawake, Yo
    Kobayashi, Yutaka
    ROYAL SOCIETY OPEN SCIENCE, 2024, 11 (05):
  • [42] Random-walk model to study cycles emerging from the exploration-exploitation trade-off
    Kazimierski, Laila D.
    Abramson, Guillermo
    Kuperman, Marcelo N.
    PHYSICAL REVIEW E, 2015, 91 (01)
  • [43] The exploration-exploitation trade-off in a foraging task is affected by mood-related arousal and valence
    Roel van Dooren
    Roy de Kleijn
    Bernhard Hommel
    Zsuzsika Sjoerds
    Cognitive, Affective, & Behavioral Neuroscience, 2021, 21 : 549 - 560
  • [44] Optimizing Exploration-Exploitation Trade-off in Continuous Action Spaces via Q-ensemble
    Xue, Wei
    Zhang, Haihong
    Wei, Xueyu
    Tao, Tao
    Li, Xue
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2022, 13631 : 148 - 160
  • [45] The exploration-exploitation trade-off in a foraging task is affected by mood-related arousal and valence
    van Dooren, Roel
    de Kleijn, Roy
    Hommel, Bernhard
    Sjoerds, Zsuzsika
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2021, 21 (03) : 549 - 560
  • [46] Sequential exploration-exploitation with dynamic trade-off for efficient reliability analysis of complex engineered systems
    MK Sadoughi
    Chao Hu
    Cameron A. MacKenzie
    Amin Toghi Eshghi
    Soobum Lee
    Structural and Multidisciplinary Optimization, 2018, 57 : 235 - 250
  • [47] Pupil Diameter Predicts Changes in the Exploration-Exploitation Trade-off: Evidence for the Adaptive Gain Theory
    Jepma, Marieke
    Nieuwenhuis, Sander
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (07) : 1587 - 1596
  • [48] Sequential exploration-exploitation with dynamic trade-off for efficient reliability analysis of complex engineered systems
    Sadoughi, M. K.
    Hu, Chao
    MacKenzie, Cameron A.
    Eshghi, Amin Toghi
    Lee, Soobum
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2018, 57 (01) : 235 - 250
  • [49] Finding the optimal exploration-exploitation trade-off online through Bayesian risk estimation and minimization
    Jamieson, Stewart
    How, Jonathan P.
    Girdhar, Yogesh
    ARTIFICIAL INTELLIGENCE, 2024, 330
  • [50] Informative path planner with exploration-exploitation trade-off for radiological surveys in non-convex scenarios
    Brouwer, Yoeri
    Vale, Alberto
    Ventura, Rodrigo
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 136