Main document
Veins-Gym
Reinforcement Learning-based VANET simulations
Summary
Machine Learning is becoming ever more popular in many application domains, including vehicular networking. It has been shown already that Intelligent Transportation Systems can greatly benefit from this approach, particularly from Reinforcement Learning (RL). To implement Vehicular Ad-hoc Network environments for RL training, researchers often start from scratch, because up until now, there is neither an established interface to ML toolkits nor a common scenario for VANET applications. We developed Veins-Gym to provide this tooling.
Veins-Gym exports Veins simulations as Open AI Gyms. This enables the application of Reinforcement Learning algorithms to solve problems in the VANET domain, in particular popular frameworks such as Tensorflow or PyTorch.
If you are using Veins-Gym (or components of it) we would appreciate a citation:
Max Schettler, Dominik S. Buse, Anatolij Zubow and Falko Dressler, "How to Train your ITS? Integrating Machine Learning with Vehicular Network Simulation," Proceedings of 12th IEEE Vehicular Networking Conference (VNC 2020), Virtual Conference, December 2020. [DOI, BibTeX, PDF and Details...]
Source Code
The source code can be found on GitHub, along with a documented example on how to use it.
Changelog
Veins Gym 0.1
- Initial release.
Contact
Extras
Featured Paper
- Wi-Fi Meets ML: A Survey on Improving IEEE 802.11 Performance with
Machine Learning
The Wi-Fi community is currently deploying Wi-Fi 6 and developing Wi-Fi 7, which will bring higher data rates, better multi-user and multi-AP support, and, most import...
News
- June 13, 2022
Open PhD Position at TKN
We have several new fully funded PhD positions available ... - June 09, 2022
Keynote at EuCNC 2022 & 6G Summit
Falko Dressler gave a keynote on "Going Beyond RF: Nano C... - May 23, 2022
New IEEE Communications Surveys & Tutorials article
Our article "Wi-Fi Meets ML: A Survey on Improving IEEE 8... - May 05, 2022
Best Poster Award at IEEE INFOCOM 2022
Gurjashan Pannu presented our paper titled "Vehicular Vir... - May 05, 2022
New IEEE Wireless Communications Magazine article
Our article "Data-driven Flight Control of Internet-of-Dr...