國立虎尾科技大學 |

Reinforcement Learning-Based Data Rate Congestion Control for Vehicular Ad-Hoc Networks.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Reinforcement Learning-Based Data Rate Congestion Control for Vehicular Ad-Hoc Networks./
Author:	Nuthalapati, Gnana Shilpa.
Description:	1 online resource (76 pages)
Notes:	Source: Masters Abstracts International, Volume: 85-01.
Contained By:	Masters Abstracts International85-01.
Subject:	Computer science. -
Online resource:	click for full text (PQDT)
ISBN:	9798379774202

Reinforcement Learning-Based Data Rate Congestion Control for Vehicular Ad-Hoc Networks.
Nuthalapati, Gnana Shilpa.

Reinforcement Learning-Based Data Rate Congestion Control for Vehicular Ad-Hoc Networks. - 1 online resource (76 pages)

Source: Masters Abstracts International, Volume: 85-01.

Thesis (M.Sc.)--University of Windsor (Canada), 2023.

Includes bibliographical references

Vehicular Ad-Hoc Network(VANET) is an emerging wireless technology vital to the Intelligent Transportation System(ITS) for vehicle-to-vehicle and vehicle-to-infrastructure communication. An ITS is an advanced solution that aims to deliver innovative services pertaining to various transportation modes and traffic management. Its objective is to enhance user awareness, promote safety, and enable more efficient and coordinated utilization of transport networks. ITS aims to mitigate traffic problems and improve the safety of transport by preventing unexpected events. When the vehicle density, i.e., the number of vehicles communicating in a wireless channel, increases, the channel faces congestion resulting in unreliable safety applications. Various decentralized congestion control algorithms have been proposed to effectively decrease channel congestion by controlling transmission parameters such as message rate, transmission power, and data rate. This thesis proposes a data rate-based congestion control technique using the Q-Learning algorithm to maintain the channel load below the target threshold. The congestion problem is formulated as an MDP and solved using a Q-learning algorithm. Q-learning is a model-free Reinforcement Learning algorithm that learns the values of an action within a specific state without relying on an explicit model of the environment. Reinforcement Learning has a set of states and actions and will find the best action for each state. The target is to train the vehicle to select the most appropriate data rate to send out a Basic Safety Message(BSM) by maintaining the channel load below the target threshold value. We use the Q-Learning algorithm with data obtained from a simulated dynamic traffic environment. We define a reward function combining CBR and data rate to maintain the channel load below the target threshold with the least data rate possible. Simulation results show that the proposed algorithm performs better over other techniques such as Transmit Data rate Control(TDRC), Data Rate based Decentralized Congestion Control(DR-DCC) and Data Rate Control Algorithm (DRCA) in low and medium loads and better over TDRC and DR-DCC in heavy load in terms of the Channel Busy Ratio (CBR), packet loss and Beacon Error Rate (BER).

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798379774202Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

Ad-Hoc NetworkIndex Terms--Genre/Form:

554714
Electronic books.

Reinforcement Learning-Based Data Rate Congestion Control for Vehicular Ad-Hoc Networks.
LDR:03631ntm a22003857 4500 001 1143329
005 20240517100406.5
006 m o d
007 cr mn ---uuuuu
008 250605s2023 xx obm 000 0 eng d
020 $a 9798379774202
035 $a (MiAaPQ)AAI30530094
035 $a AAI30530094
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Nuthalapati, Gnana Shilpa. $3 1467978
245 1 0 $a Reinforcement Learning-Based Data Rate Congestion Control for Vehicular Ad-Hoc Networks.
264 0 $c 2023
300 $a 1 online resource (76 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Masters Abstracts International, Volume: 85-01.
500 $a Advisor: Jaekel, A.;Zhang, N.
502 $a Thesis (M.Sc.)--University of Windsor (Canada), 2023.
504 $a Includes bibliographical references
520 $a Vehicular Ad-Hoc Network(VANET) is an emerging wireless technology vital to the Intelligent Transportation System(ITS) for vehicle-to-vehicle and vehicle-to-infrastructure communication. An ITS is an advanced solution that aims to deliver innovative services pertaining to various transportation modes and traffic management. Its objective is to enhance user awareness, promote safety, and enable more efficient and coordinated utilization of transport networks. ITS aims to mitigate traffic problems and improve the safety of transport by preventing unexpected events. When the vehicle density, i.e., the number of vehicles communicating in a wireless channel, increases, the channel faces congestion resulting in unreliable safety applications. Various decentralized congestion control algorithms have been proposed to effectively decrease channel congestion by controlling transmission parameters such as message rate, transmission power, and data rate. This thesis proposes a data rate-based congestion control technique using the Q-Learning algorithm to maintain the channel load below the target threshold. The congestion problem is formulated as an MDP and solved using a Q-learning algorithm. Q-learning is a model-free Reinforcement Learning algorithm that learns the values of an action within a specific state without relying on an explicit model of the environment. Reinforcement Learning has a set of states and actions and will find the best action for each state. The target is to train the vehicle to select the most appropriate data rate to send out a Basic Safety Message(BSM) by maintaining the channel load below the target threshold value. We use the Q-Learning algorithm with data obtained from a simulated dynamic traffic environment. We define a reward function combining CBR and data rate to maintain the channel load below the target threshold with the least data rate possible. Simulation results show that the proposed algorithm performs better over other techniques such as Transmit Data rate Control(TDRC), Data Rate based Decentralized Congestion Control(DR-DCC) and Data Rate Control Algorithm (DRCA) in low and medium loads and better over TDRC and DR-DCC in heavy load in terms of the Channel Busy Ratio (CBR), packet loss and Beacon Error Rate (BER).
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer science. $3 573171
650 4 $a Transportation. $3 558117
653 $a Ad-Hoc Network
653 $a Traffic problems
653 $a Q-learning algorithm
653 $a Basic Safety Message
655 7 $a Electronic books. $2 local $3 554714
690 $a 0984
690 $a 0709
690 $a 0800
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a University of Windsor (Canada). $b COMPUTER SCIENCE. $3 1182526
773 0 $t Masters Abstracts International $g 85-01.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30530094 $z click for full text (PQDT)