Studying Exploitation and Exploration Trade-Off of Cognitive Odour-Guided Search

被引:0
|
作者
Magalhaes, Hugo [1 ]
Baptista, Rui [1 ]
Marques, Lino [1 ]
机构
[1] Univ Coimbra, Inst Syst & Robot, P-3030790 Coimbra, Portugal
关键词
Odour Source Localisation; Information-theoretic; Field robotics;
D O I
10.1007/978-3-031-58676-7_16
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Cognitive search strategies are highly suitable for Odour Source Localisation (OSL) under turbulent flow conditions where continuous cues are not always available. While reliable, these methods have a known tendency to shift the weight of the search towards exploration, which increases the time and distance required to locate the source. Balancing the trade-off between exploration and exploitation (EE) is crucial since it can directly influence the efficiency and reliability of the mission. However, its understanding from a motion decision perspective still remains unclear with most conclusions being drawn from visual interpretation of the search trajectories or from results of performance metrics. This work aims to study the EE trade-off of cognitive OSL actions by identifying movement patterns and quantifying their values for multiple metrics associated with the decision. A large number of experiments were performed under realistic simulated environments, with the results showing the emergence of multiple well-defined movement patterns and EE tendencies that remain identical across different scenarios.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [21] The role of the noradrenergic system in the exploration-exploitation trade-off: a psychopharmacological study
    Jepma, Marieke
    Beek, Erik T. Te
    Wagenmakers, Eric-Jan
    van Gerven, Joop M. A.
    Nieuwenhuis, Sander
    FRONTIERS IN HUMAN NEUROSCIENCE, 2010, 4
  • [22] Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off
    Huang, Shaoyi
    Lei, Bowen
    Xu, Dongkuan
    Peng, Hongwu
    Sun, Yue
    Xie, Mimi
    Ding, Caiwen
    2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,
  • [23] Bifurcation angles in ant foraging networks: A trade-off between exploration and exploitation?
    Berthouze, Luc
    Lorenzi, Alexander
    FROM ANIMALS TO ANIMATS 10, PROCEEDINGS, 2008, 5040 : 113 - 122
  • [24] Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia
    Humphries, Mark D.
    Khamassi, Mehdi
    Gurney, Kevin
    FRONTIERS IN NEUROSCIENCE, 2012, 6
  • [25] Adaptive network approach to exploration-exploitation trade-off in reinforcement learning
    Moradi, Mohammadamin
    Zhai, Zheng-Meng
    Panahi, Shirin
    Lai, Ying-Cheng
    CHAOS, 2024, 34 (12)
  • [26] Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making
    Chakroun, Karima
    Mathar, David
    Wiehler, Antonius
    Ganzer, Florian
    Peters, Jan
    ELIFE, 2020, 9 : 1 - 44
  • [27] A Novel Active Learning Regression Framework for Balancing the Exploration-Exploitation Trade-Off
    Elreedy, Dina
    Atiya, Amir E.
    Shaheen, Samir, I
    ENTROPY, 2019, 21 (07)
  • [28] Trade-off between exploration and exploitation with genetic algorithm using a novel selection operator
    Abid Hussain
    Yousaf Shad Muhammad
    Complex & Intelligent Systems, 2020, 6 : 1 - 14
  • [29] Boredom begets creativity: A solution to the exploitation-exploration trade-off in predictive coding
    Gomez-Ramirez, Jaime
    Costa, Tommaso
    BIOSYSTEMS, 2017, 162 : 168 - 176
  • [30] The effects of 24-hour sleep deprivation on the exploration-exploitation trade-off
    Glass, Brian D.
    Maddox, W. Todd
    Bowen, Christopher
    Savarie, Zachary R.
    Matthews, Michael D.
    Markman, Arthur B.
    Schnyer, David M.
    BIOLOGICAL RHYTHM RESEARCH, 2011, 42 (02) : 99 - 110