Mini-Batch Adaptive Random Search Method for the Parametric Identification of Dynamic Systems

被引:8
|
作者
Panteleev, A. V. [1 ]
Lobanov, A. V. [1 ]
机构
[1] Natl Res Univ, Moscow Aviat Inst, Moscow, Russia
关键词
parametric identification; dynamic system; gradient optimization methods; mini-batch method; adaptive random search;
D O I
10.1134/S0005117920110065
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A possible method for estimating the unknown parameters of dynamic models described by differential-algebraic equations is considered. The parameters are estimated using the observations of a mathematical model. The parameter values are found by minimizing a criterion written as the sum of the squared deviations of the values of the state vector's coordinates from their exact counterparts obtained through measurements at different time instants. Parallelepiped-type constraints are imposed on the parameter values. For solving the optimization problem, a mini-batch method of adaptive random search is proposed, which further develops the ideas of optimization methods used in machine learning. This method is applied for solving three model problems, and the results are compared with those obtained by gradient optimization methods of machine learning procedures and also with those obtained by metaheuristic algorithms.
引用
收藏
页码:2026 / 2045
页数:20
相关论文
共 50 条
  • [1] Mini-Batch Adaptive Random Search Method for the Parametric Identification of Dynamic Systems
    A. V. Panteleev
    A. V. Lobanov
    Automation and Remote Control, 2020, 81 : 2026 - 2045
  • [2] An adaptive mini-batch stochastic gradient method for AUC maximization
    Cheng, Fan
    Zhang, Xia
    Zhang, Chuang
    Qiu, Jianfeng
    Zhang, Lei
    NEUROCOMPUTING, 2018, 318 : 137 - 150
  • [3] Adaptive Natural Gradient Method for Learning of Stochastic Neural Networks in Mini-Batch Mode
    Park, Hyeyoung
    Lee, Kwanyong
    APPLIED SCIENCES-BASEL, 2019, 9 (21):
  • [4] Accelerate Mini-batch Machine Learning Training With Dynamic Batch Size Fitting
    Liu, Baohua
    Shen, Wenfeng
    Li, Peng
    Zhu, Xin
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [5] Mini-batch Dynamic Geometric Embedding for Unsupervised Domain Adaptation
    Khan, Siraj
    Guo, Yuxin
    Ye, Yuzhong
    Li, Chunshan
    Wu, Qingyao
    NEURAL PROCESSING LETTERS, 2023, 55 (03) : 2063 - 2080
  • [6] Mini-batch Dynamic Geometric Embedding for Unsupervised Domain Adaptation
    Siraj Khan
    Yuxin Guo
    Yuzhong Ye
    Chunshan Li
    Qingyao Wu
    Neural Processing Letters, 2023, 55 : 2063 - 2080
  • [7] Distributed Mini-batch Random Projection Algorithms For Reduced Communication Overhead
    Lee, Soomin
    Nedic, Angelia
    2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, : 559 - 562
  • [8] Mini-batch cutting plane method for regularized risk minimization
    Meng-long Lu
    Lin-bo Qiao
    Da-wei Feng
    Dong-sheng Li
    Xi-cheng Lu
    Frontiers of Information Technology & Electronic Engineering, 2019, 20 : 1551 - 1563
  • [9] A MINI-BATCH STOCHASTIC GRADIENT METHOD FOR SPARSE LEARNING TO RANK
    Cheng, Fan
    Wang, Dongliang
    Zhang, Lei
    Su, Yansen
    Qiu, Jianfeng
    Suo, Yi
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2018, 14 (04): : 1207 - 1221
  • [10] Random Barzilai-Borwein step size for mini-batch algorithms
    Yang, Zhuang
    Wang, Cheng
    Zhang, Zhemin
    Li, Jonathan
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2018, 72 : 124 - 135