Data Transmission Control Based on Hidden Markov Queuing Models

被引：0

作者：

Kuznetsov, Nikolay A. ^{[1
]}

Myasnikov, Dmitry V. ^{[1
]}

Semenikhin, Konstantin V. ^{[2
]}

机构：

[1] RAS, Kotelnikov Inst Radio Engn & Elect, Moscow, Russia

[2] Natl Res Univ, Moscow Aviat Inst, Moscow, Russia

来源：

2018 IEEE 12TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT) | 2018年

基金：

俄罗斯科学基金会;

关键词：

queuing system; data transmission; optimal control; unconstrained problem; control with incomplete information; filtering estimate;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

We consider a data transmission control problem for the communication network governed by a hidden Markov queuing model. The single-server finite-buffer queuing system is fed by a non-stationary Poisson stream of data packets transmitted over a stochastic channel. The service rate is proportional to the controlled transmission rate with a channel-dependent factor. Buffer overflow and channel state worsening lead to packet losses and decrease in service rate. The goal of the optimization problem is to minimize average losses tinder the constraint on the signal energy. We present an exact form for the optimal policy in the unconstrained control problem. Based on the optimal control and hidden channel state estimates, several control policies with incomplete information are proposed. They are based on two estimators (optimal filter and current queue state) and two operations (expectation and mode). Computer simulation results are presented to compare the controls obtained.

引用

页码：324 / 329

页数：6

共 50 条

[1] On Stochastic Control of Networked Control Systems Based on Hidden Markov Models
Pan, Weihua
Han, Pu
Zhang, Lijing
Wang, Tiankun
2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31, 2008, : 5217 - +
[2] Stability of Networked Control Systems Based on Hidden Markov Models
Ge, Yuan
Chen, Qigong
Jiang, Ming
Liu, Zhen-an
2008 7TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-23, 2008, : 5453 - +
[3] Classification of GPR data for mine detection based on Hidden Markov Models
Löhlein, O
Fritzsche, M
SECOND INTERNATIONAL CONFERENCE ON THE DETECTION OF ABANDONED LAND MINES, 1998, (458): : 96 - 100
[4] Hidden Markov models for multivariate panel data
Neal, Mackenzie R.
Sochaniwsky, Alexa A.
Mcnicholas, Paul D.
STATISTICS AND COMPUTING, 2024, 34 (06)
[5] MIXTURE OF HIDDEN MARKOV MODELS FOR ACCELEROMETER DATA
de Chaumaray, Marie Du Roy
Marbac, Matthieu
Navarro, Fabien
ANNALS OF APPLIED STATISTICS, 2020, 14 (04): : 1834 - 1855
[6] Bayesian Hidden Markov Models for Financial Data
Castellano, Rosella
Scaccia, Luisa
DATA ANALYSIS AND CLASSIFICATION, 2010, : 453 - 461
[7] Hidden Markov models for extended batch data
Cowen, Laura L. E.
Besbeas, Panagiotis
Morgan, Byron J. T.
Schwarz, Carl J.
BIOMETRICS, 2017, 73 (04) : 1321 - 1331
[8] Hidden Markov Models for multivariate functional data
Martino, Andrea
Guatteri, Giuseppina
Paganoni, Anna Maria
STATISTICS & PROBABILITY LETTERS, 2020, 167
[9] Mixed hidden Markov models: An extension of the hidden Markov model to the longitudinal data setting
Altman, Rachel MacKay
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2007, 102 (477) : 201 - 210
[10] Markov models - hidden Markov models
Grewal, Jasleen K.
Krzywinski, Martin
Altman, Naomi
NATURE METHODS, 2019, 16 (09) : 795 - 796

← 1 2 3 4 5 →