Data Transmission Control Based on Hidden Markov Queuing Models

被引：0

作者：

Kuznetsov, Nikolay A. ^{[1
]}

Myasnikov, Dmitry V. ^{[1
]}

Semenikhin, Konstantin V. ^{[2
]}

机构：

[1] RAS, Kotelnikov Inst Radio Engn & Elect, Moscow, Russia

[2] Natl Res Univ, Moscow Aviat Inst, Moscow, Russia

来源：

2018 IEEE 12TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT) | 2018年

基金：

俄罗斯科学基金会;

关键词：

queuing system; data transmission; optimal control; unconstrained problem; control with incomplete information; filtering estimate;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

We consider a data transmission control problem for the communication network governed by a hidden Markov queuing model. The single-server finite-buffer queuing system is fed by a non-stationary Poisson stream of data packets transmitted over a stochastic channel. The service rate is proportional to the controlled transmission rate with a channel-dependent factor. Buffer overflow and channel state worsening lead to packet losses and decrease in service rate. The goal of the optimization problem is to minimize average losses tinder the constraint on the signal energy. We present an exact form for the optimal policy in the unconstrained control problem. Based on the optimal control and hidden channel state estimates, several control policies with incomplete information are proposed. They are based on two estimators (optimal filter and current queue state) and two operations (expectation and mode). Computer simulation results are presented to compare the controls obtained.

引用

页码：324 / 329

页数：6

共 50 条

[31] Fault Prognosis based on Hidden Markov Models
Soualhi, A.
Clerc, G.
Razik, H.
2015 IEEE WORKSHOP ON ELECTRICAL MACHINES DESIGN, CONTROL AND DIAGNOSIS (WEMDCD), 2015, : 271 - 278
[32] Optimal Control of Hidden Markov Models With Binary Observations
Komaee, Arash
Bensoussan, Alain
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (01) : 64 - 77
[33] Hidden Markov models
Eddy, SR
CURRENT OPINION IN STRUCTURAL BIOLOGY, 1996, 6 (03) : 361 - 365
[34] Delay-loss estimation and control for networked control systems based on hidden Markov models
Zhang, Yi
Wang, Shuqing
WCICA 2006: SIXTH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-12, CONFERENCE PROCEEDINGS, 2006, : 4415 - +
[35] Feature Selection for Hidden Markov Models and Hidden Semi-Markov Models
Adams, Stephen
Beling, Peter A.
Cogill, Randy
IEEE ACCESS, 2016, 4 : 1642 - 1657
[36] Markov models - training and evaluation of hidden Markov models
Grewal, Jasleen K.
Krzywinski, Martin
Altman, Naomi
NATURE METHODS, 2020, 17 (02) : 121 - 122
[37] Markov models — training and evaluation of hidden Markov models
Jasleen K. Grewal
Martin Krzywinski
Naomi Altman
Nature Methods, 2020, 17 : 121 - 122
[38] Dynamic Detection of Transmission Line Outages Using Hidden Markov Models
Huang, Qingqing
Shao, Leilai
Li, Na
2015 AMERICAN CONTROL CONFERENCE (ACC), 2015, : 5050 - 5055
[39] Mining gene expression data using a novel approach based on hidden Markov models
Ji, XL
Li-Ling, J
Sun, Z
FEBS LETTERS, 2003, 542 (1-3) : 125 - 131
[40] Dynamic Detection of Transmission Line Outages Using Hidden Markov Models
Huang, Qingqing
Shao, Leilai
Li, Na
IEEE TRANSACTIONS ON POWER SYSTEMS, 2016, 31 (03) : 2026 - 2033

← 1 2 3 4 5 →