Studying Exploitation and Exploration Trade-Off of Cognitive Odour-Guided Search

被引:0
|
作者
Magalhaes, Hugo [1 ]
Baptista, Rui [1 ]
Marques, Lino [1 ]
机构
[1] Univ Coimbra, Inst Syst & Robot, P-3030790 Coimbra, Portugal
关键词
Odour Source Localisation; Information-theoretic; Field robotics;
D O I
10.1007/978-3-031-58676-7_16
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Cognitive search strategies are highly suitable for Odour Source Localisation (OSL) under turbulent flow conditions where continuous cues are not always available. While reliable, these methods have a known tendency to shift the weight of the search towards exploration, which increases the time and distance required to locate the source. Balancing the trade-off between exploration and exploitation (EE) is crucial since it can directly influence the efficiency and reliability of the mission. However, its understanding from a motion decision perspective still remains unclear with most conclusions being drawn from visual interpretation of the search trajectories or from results of performance metrics. This work aims to study the EE trade-off of cognitive OSL actions by identifying movement patterns and quantifying their values for multiple metrics associated with the decision. A large number of experiments were performed under realistic simulated environments, with the results showing the emergence of multiple well-defined movement patterns and EE tendencies that remain identical across different scenarios.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [1] Exploration - exploitation trade-off features a saltatory search behaviour
    Volchenkov, Dimitri
    Helbach, Jonathan
    Tscherepanow, Marko
    Kuehnel, Sina
    JOURNAL OF THE ROYAL SOCIETY INTERFACE, 2013, 10 (85)
  • [2] Exploration and exploitation trade-off in multiagent learning
    Takadama, K
    Shimohara, K
    ICCIMA 2001: FOURTH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND MULTIMEDIA APPLICATIONS, PROCEEDINGS, 2001, : 133 - 137
  • [3] Optimal trade-off between exploration and exploitation
    Simpkins, Alex
    de Callafon, Raymond
    Todorov, Emanuel
    2008 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2008, : 33 - +
  • [4] Uncertainty avoidance and the exploration-exploitation trade-off
    Broekhuizen, Thijs L. J.
    Giarratana, Marco S.
    Torres, Anna
    EUROPEAN JOURNAL OF MARKETING, 2017, 51 (11-12) : 2080 - 2100
  • [5] Uncertainty quantification and exploration–exploitation trade-off in humans
    Antonio Candelieri
    Andrea Ponti
    Francesco Archetti
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 6843 - 6876
  • [6] Protection From Uncertainty in the Exploration/Exploitation Trade-Off
    Walker, Adrian R.
    Navarro, Danielle J.
    Newell, Ben R.
    Beesley, Tom
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2022, 48 (04) : 547 - 568
  • [7] Rethinking exploration-exploitation trade-off in reinforcement learning via cognitive consistency
    Wang, Da
    Wei, Wei
    Li, Lin
    Wang, Xin
    Liang, Jiye
    NEURAL NETWORKS, 2025, 187
  • [8] The Exploration/Exploitation Trade-off in Reinforcement Learning for Dialogue Management
    Varges, Sebastian
    Riccardi, Giuseppe
    Quarteroni, Silvia
    Ivanov, Alexei V.
    2009 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION & UNDERSTANDING (ASRU 2009), 2009, : 479 - 484
  • [9] The trade-off between knowledge exploration and exploitation in technological innovation
    Li, Dehong
    Lin, Jun
    Cui, Wentian
    Qian, Yanjun
    JOURNAL OF KNOWLEDGE MANAGEMENT, 2018, 22 (04) : 781 - 801
  • [10] Uncertainty quantification and exploration-exploitation trade-off in humans
    Candelieri, Antonio
    Ponti, Andrea
    Archetti, Francesco
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 14 (6) : 6843 - 6876