Design of Opportunistic Routing Based on Markov Decision Process

被引：0

作者：

Hao, Jun ^{[1
]}

Jia, Xinchun ^{[1
]}

Han, Zongyuan ^{[2
]}

Yang, Bo ^{[1
]}

Peng, Dengyong ^{[1
]}

机构：

[1] Shanxi Univ, Sch Math Sci, Taiyuan 030006, Shanxi, Peoples R China

[2] China Acad Railway Sci, Inst Comp Technol, Beijing 100081, Peoples R China

来源：

PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017) | 2017年

关键词：

Opportunistic Routing; Markov Decision Process; Optimal Forwarding Strategy; NETWORKS;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The instability of wireless links makes the choice of forwarding nodes have too many possibilities in opportunistic routing. In this paper, the Markov decision process (MDP) is used to model the whole packet forwarding process from the source node to the destination node, which facilitates making reasonable decisions when the sender selects the forwarding nodes. By solving a finite-state MDP problem, an optimal forwarding strategy is obtained to minimize the expected number of transmissions for each node. Further more, the properties of expected any-path transmissions (EAX) are used for the selection of candidate forwarder set, which can significantly reduce the feasible optimal solution space. Finally, An opportunistic routing protocol based on Markov decision process (MDP-OR) is designed, whose effectiveness is verified by an example and its simulation.

引用

页码：8976 / 8981

页数：6

共 50 条

[1] Markov Decision Process Based Wireless Multicast Opportunistic Routing
Ma Dianbo
Tan Xiaobin
Zhou Zijian
Yu Shanjin
2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 5509 - 5514
[2] A novel segmented routing algorithm based on the markov decision process in mobile opportunistic networks
Zhang, Yang
Wang, Xiaoming
Lin, Yaguang
Zhang, Lichen
Wang, Liang
IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2019, 14 (04) : 605 - 614
[3] A Markov Decision Process-Based Opportunistic Spectral Access
Arunthavanathan, Senthuran
Kandeepan, Sithamparanathan
Evans, Robin. J.
IEEE WIRELESS COMMUNICATIONS LETTERS, 2016, 5 (05) : 544 - 547
[4] Markov Decision Process Routing Games
Calderone, Dan
Sastry, S. Shankar
2017 ACM/IEEE 8TH INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SYSTEMS (ICCPS), 2017, : 273 - 279
[5] A secured MANET using position-based opportunistic routing and SEMI MARKOV process
Maragatharajan, M.
Balasubramanian, C.
Balakannan, S. P.
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2019, 31 (14):
[6] Load Balancing in WSNs using a Novel Markov Decision Process based Routing Algorithm
Tayeb, Shahab
Mirnabibaboli, Miresmaeil
Latifi, Shahram
2016 6TH INTERNATIONAL CONFERENCE ON IT CONVERGENCE AND SECURITY (ICITCS 2016), 2016, : 81 - 85
[7] A Markov decision process model on dynamic routing for target surveillance
Margolis, Joshua T.
Song, Yongjia
Mason, Scott J.
COMPUTERS & OPERATIONS RESEARCH, 2022, 141
[8] Markov Chain based Opportunistic Routing Protocol to enhance the Performance of the MANET
Lokare, Varsha T.
Jadhav, Prakash M.
PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON INVENTIVE SYSTEMS AND CONTROL (ICISC 2018), 2018, : 1055 - 1058
[9] Combinatorial Design of a Stochastic Markov Decision Process
Dimitrov, Nedialko B.
Morton, David P.
OPERATIONS RESEARCH AND CYBER-INFRASTRUCTURE, 2009, : 167 - 193
[10] Adaptive Model Design for Markov Decision Process
Chen, Siyu
Yang, Donglin
Li, Jiayang
Wang, Senmiao
Yang, Zhuoran
Wang, Zhaoran
INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,

← 1 2 3 4 5 →