Some guidelines for using iterate averaging in stochastic approximation

被引：0

作者：

Maryak, JL ^{[1
]}

机构：

[1] Johns Hopkins Univ, Appl Phys Lab, Laurel, MD 20723 USA

来源：

PROCEEDINGS OF THE 36TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5 | 1997年

关键词：

stochastic approximation; iterate averaging; mean square error; finite-difference stochastic approximation; simultaneous perturbation stochastic approximation;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Averaging of the output (iterates) from a stochastic approximation (SA) recursion has been shown to be a useful technique for the gradient-based Robbins-Monro, form of SA. For the gradient-free (e.g., Kiefer-Wolfowitz) form, iterate averaging can produce an improvement in the stability of the algorithm and competitive mean-square errors relative to the standard (unaveraged) recursion. We discuss guidelines on how and when to use averaging in this context.

引用

页码：2287 / 2290

页数：4

共 50 条

[41] STOCHASTIC-APPROXIMATION WITH AVERAGING AND FEEDBACK - RAPIDLY CONVERGENT ONLINE ALGORITHMS
KUSHNER, HJ
YANG, JC
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1995, 40 (01) : 24 - 34
[42] Some pathological traps for stochastic approximation
Brandiere, O
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1998, 36 (04) : 1293 - 1314
[43] Diffusion approximation for an overloaded X model via a stochastic averaging principle
Perry, Ohad
Whitt, Ward
QUEUEING SYSTEMS, 2014, 76 (04) : 347 - 401
[44] Asymptotic efficiency of perturbation-analysis-based stochastic approximation with averaging
Tang, Qian-Yu
L'Ecuyer, Pierre
Chen, Han-Fu
SIAM Journal on Control and Optimization, 37 (06): : 1822 - 1847
[45] Asymptotic efficiency of perturbation-analysis-based stochastic approximation with averaging
Tang, QY
L'Ecuyer, P
Chen, HF
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1999, 37 (06) : 1822 - 1847
[46] PERTURBED ITERATE ANALYSIS FOR ASYNCHRONOUS STOCHASTIC OPTIMIZATION
Mania, Horia
Pan, Xinghao
Papailiopoulos, Dimitris
Recht, Benjamin
Ramchandran, Kannan
Jordan, Michael I.
SIAM JOURNAL ON OPTIMIZATION, 2017, 27 (04) : 2202 - 2229
[47] SOME GENERALIZATIONS OF DYNAMIC STOCHASTIC APPROXIMATION PROCESSES
UOSAKI, K
ANNALS OF STATISTICS, 1974, 2 (05): : 1042 - 1048
[48] ON SOME REINFORCEMENT TECHNIQUES AND THEIR RELATION TO STOCHASTIC APPROXIMATION
FU, KS
NIKOLIC, ZJ
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1966, AC11 (04) : 756 - +
[49] Iterate averaging, the Kalman filter, and 3DVAR for linear inverse problems
Jones, Felix G.
Simpson, Gideon
NUMERICAL ALGORITHMS, 2023, 92 (02) : 1105 - 1125
[50] Iterate averaging, the Kalman filter, and 3DVAR for linear inverse problems
Felix G. Jones
Gideon Simpson
Numerical Algorithms, 2023, 92 : 1105 - 1125

← 1 2 3 4 5 →