Keywords
V2V, network simulator, mobility generator, simulations, connected vehicles, microscopic models
This article is included in the Research Synergy Foundation gateway.
V2V, network simulator, mobility generator, simulations, connected vehicles, microscopic models
The abstract and introduction were improved to highlight the focus of the study which contributes to the domain of Vehicular Adhoc Networks (VANET) by describing the mobility generators and network simulators suitable to be considered in the context of connected vehicles or V2V. The sections organization was added in the last paragraph of the Introduction section. The Method section has been re-written to provide better presentation and clarity. The Result section was also improved to describe the findings of the scoping review in a clearer way. Similarly, the Discussion section also has been improved, highlighting the contribution and benefit of this study. The conclusion includes the recommendation of simulators for real-time modelling and recommendation for extending this study.
The citations and references in the reference list are unified according to a Harvard referencing style, and the paper was proofread and edited accordingly.
See the authors' detailed response to the review by Lionel Nkenyereye
See the authors' detailed response to the review by Mahmoud Zaki Iskandarani
In recent decades, a significant increase in vehicle use has increased traffic congestion and fatalities1. According to the World Health Organization, 1.25 million people are killed and severely injured involving vehicle accidents2. Hence, connected vehicle technology responds to this constraint, aiming to leverage inter-vehicle communication to produce safe, user-friendly, and fuel-efficient vehicle assistive technologies3,4. One of the main aspects of connected vehicle research is to optimise traffic flow through the exchange of information5. This communication can be sorted in terms of vehicle (V2V), infrastructure (V2I), a pedestrian (V2P), and network (V2N)6,7. The exchange of information, collectively known as V2X communications, could assist drivers in preventing accidents by providing warnings of danger invisible to drivers and other sensors (e.g. collision avoidance, lane departure warning and speed limit alert)8,9.
Nevertheless, the adoption of connected vehicle technology poses a range of challenges, particularly in urban environments. It is challenging to analyse the effectiveness of the application of connected vehicles under traffic conditions10–12. As such, simulations using traffic and network simulators as well as mobility generators are viable alternatives to modelling and determining the effectiveness of such deployments in the real world13,14, as it provides an affordable and scalable method for analysing model compliance in various contexts and parameters.
Traffic simulations are categorised by level of detail into three separate categories15. First, the most precise information on each vehicle in the system is microscopic simulations16. Second, mesoscopic simulations exploit aggregate velocity-density functions to represent their behaviour and view traffic as a continuous stream of vehicles17. Finally, macroscopic simulation is the large-scale traffic model, which focuses on combined traffic status18. Microscopic simulations provide the highest degree of detail for modelling, although they are the slowest to execute19,20.
In addition, mobility generators are a possible option for modelling vehicle elements such as traffic, temporal and spatial mobility, and generating mobility traces21,22. These traces are then uploaded to a network simulator, which mimics vehicle-to-vehicle communication. Furthermore, these traces can be generated by observing real-world vehicles on the road and then used in network simulations23,24. The effect of network parameter modifications on traffic mobility is a strategic objective simulation25. It is also restricted to the use of the trace controlled by the mobility model. Another option is to use a simulator that directly integrates the mobility framework.
This study focuses on the Vehicular Adhoc Networks (VANET) which relies on network protocols to assess their performance22,23, given that actual experiments are not possible. Over the last decade, efforts have been made to produce a full transport simulator for VANET solutions, including a wireless network simulator for modelling and evaluation24,25. A wide range of simulators can be used for VANET simulation modelling, both commercial and open source. Older simulators provide a network simulator to communicate with stationary mobility models. Many researchers have examined various mobility models with simulation tools for several contexts. Such simulator tools are not yet well explored since many researchers base their simulations depending on their use case settings. Thus, this motivates the identification of different simulators do not yet exist. Therefore, this study conducted a systematic scoping review to identify the applicability and availability of existing mobility generators, network simulators, and combination simulators.
The rest of the paper is organised as follows. The following section explains the methods used for analysing existing mobility generators and network simulators. Further, the outcome of the review scoping is depicted with several discussions. The final section concludes by considering future directions.
This work involves identifying the research question, identifying relevant studies, selecting the studies, charting the data, collating, summarising, and reporting results. The review was carried out in compliance with the PRISMA Extension for Scoping Review26.
Under standard procedures for performing scoping reviews26, published primary studies on VANET were considered for inclusion. Although research may be conducted in any country without focusing on language restrictions, we only obtained data from studies published in English-language journals. Studies had to include mobility generators, network simulators, and vehicle network simulators. We included studies related to vehicular communications that investigated V2V safety applications, vehicle network performance, driver behaviour, and vehicle simulation tools. We excluded studies prior to the year 2015.
IEEE Xplore and Science Direct were used to perform in-depth searches of the information included in these databases.
The search method included controlled vocabulary and free-text word phrases generally linked to (1) network simulation, mobility generators, or network simulators, and (2) VANET, vehicle, or nodes. All searches were initiated in November 2019 and December 2020, when the database was updated. Endnote was used to import the search results27.
After removing duplicate studies, search results were exported for screening. This was done to filter references based on the above-mentioned inclusion criteria. To minimise the possibility of bias, each reference was checked twice by two team members, and the team addressed any inconsistencies. The first screening process ended in April 2020, and the outcomes were updated in January 2021.
To extract data from each included research, a spreadsheet was created using Microsoft Excel. Several rounds of piloting the data extraction spreadsheet was performed, during which all team members collected data from the same research, and the results were reviewed during team meetings to ascertain content consistency. The piloting extraction process guaranteed that all relevant data fields were collected and that the content was uniform across the research team. After familiarising all team members with the data extraction method, studies were allocated to each member, and the relevant data were extracted separately. Year, country, mobility generators, network simulators, active development, release date, licence, predefined map, traffic model, architecture language, and simulation language were collected from each included research where accessible. In March 2021, data extraction was finalised.
The objective outcomes of all included studies were retrieved in the order in which they were reported. The research team then classified these findings according to their similarity to the measured concepts: routing protocol, scenario, mobility generator, and network simulator. Subjective outcomes were similarly retrieved in the way described in the publications and then classified according to their similarity to the assessed concepts: contribution. The subjective outcome criteria for each study were extracted and operationalised by consensus among our research team.
The initial search turned up 269 matches. After removing duplicates, a total of 184 titles and abstracts were screened, from which 72 publications were subjected to full-text review. 10 studies fulfilled the criteria for inclusion and were included in the analysis (see Figure 1 for the PRISMA Flow Diagram).
We found that open-source mobility and network simulators were popular among researchers. Microscopic models were preferable for research related to vehicular communications since the simulations provide the most precise information of each vehicle or mobile node and the highest degree of detail for modelling compared to macroscopic and mesoscopic models. Common network simulators were NS-2, Ns-3 and OMNeT++. However, not all mobility simulators supported active development, which is important in current active research domains such as vehicular communications. The mobility generators and simulators available after 2015 are further shown in Table 1 and Table 2, respectively. Besides, summarised previous studies are shown in Table 3 of using mobility generators or simulators.
Reference(s) | Name of mobility generator | Active development | Release | License | Map | Traffic model | Network simulator |
---|---|---|---|---|---|---|---|
28–30 | SUMO | Y | 2021 | Open Source | Real and User Defined | Microscopic Mesoscopic | NS-2, NS-3, OMNeT++ |
31–33 | MATSim | Y | 2021 | Open Source | Real and User Defined | Microscopic | N/A |
34 | DTALite | Y | 2021 | Open Source | Real | Mesoscopic | N/A |
35,36 | SMARTS | Y | 2020 | Open Source | Real and User Defined | Microscopic | N/A |
21,37,38 | PARAMICS | Y | 2020 | Commercial | Real and User Defined | Microscopic | NS-2, OMNeT++ |
32,38 | MovSim | Y | 2018 | Open Source | Built-In | Microscopic | N/A |
21,27,39 | VISSIM | Y | 2016 | Commercial | Real and User Defined | Microscopic Mesoscopic | NS-2, QualNet |
40 | VNEtIntSim | N | 2015 | Open Source | Real and User Defined | Microscopic | Integration OPNET |
38 | Traffisim | N | 2014 | Open Source | Real and User Defined | Microscopic | N/A |
41 | CityMob | N | 2009 | Open Source | Built-In | Microscopic Macroscopic | NS-2 |
41 | FreeSim | N | 2008 | Open Source | Real | Microscopic Macroscopic | N/A |
41 | STRAW | N | 2007 | Open Source | Built-In | Microscopic | NS-2, SWANS |
41 | Vanet- MobiSim | N | 2007 | Open Source | Real and User Defined | Microscopic | NS-2, QualNEt, OMNeT++, GloMoSim |
Reference(s) | Name of network simulators | Active development | Release | License | 802.11p Support | Architecture Language | Simulation Language |
---|---|---|---|---|---|---|---|
42,43 | OPNET | Y | 2021 | Commercial | Y | C++ | C++ OTCL |
33,42,44 | NS-3 | Y | 2021 | Open Source | Y | C++ Python | C++ Python |
42 | OMNeT++ | Y | 2020 | Open Source | Y | C++ | C++ |
33,42 | QualNet | Y | 2019 | Commercial | Y | C++ | C++ |
42,45 | NS-2 | N | 2011 | Open Source | Y | C++ | C++ OTCL |
33,42 | JiST/SWANS | N | 2005 | Open Source | N | JAVA | JAVA |
40,45 | GloMoSim | N | 2000 | Open Source | N | C | C |
Reference | Contribution | Scenario | Protocol Used | Mobility Simulator | Network Simulator | Simulator and Framework |
---|---|---|---|---|---|---|
46 | This paper provides a comparison of three routing protocols in the VANET scenario. The result focuses on determining the effectiveness of routing protocols for several performance measures of which the vehicle is an essential aspect of the evaluation. | Urban | DSDV AODV DSR | SUMO MOVE | NS-2 | N/A |
47 | The paper provides a simulation in the VANET scenario at a vast scale. The result is focused on the performance of four routing protocols under different checks in terms of delay, packet delivery, overhead, and transmission power. | Urban | OLSR DSDV AODV DSR | SUMO | NS-3 | N/A |
48 | This paper uncovers an automatic routing protocol for the VANET scenario. The idea is to disseminate the information provided by several roadside units. There are three routing protocols evaluated using several performance metrics in terms of delay, number of hops, total service time, and number of fragments. | Urban | ARP GSR A-STAR | SUMO | OMNeT++ | N/A |
49 | The paper focuses on two routing protocols within the VANET scenario. The idea is to ensure an optimal path from source to destination under a few performance measures in terms of throughput and packet delivery ratio. | Generic | DYMO OLSR | N/A | QualNet | N/A |
50 | This paper investigates DSRC 5.9 GHz for the V2V scenario in restricted areas. The findings were reviewed using three routing protocols using different performance parameters in terms of delay and number of forwarding nodes. | Generic | EMDV >MHVB EDB | N/A | NetSim | N/A |
30 | The paper provides an analysis of four routing protocols within the VANET scenario. The outcome was assessed based on a different mobility model and speed and performance parameters such as goodput, throughput, packet receive performance and receive rate. | Urban | OLSR AODV DSDV DSR | SUMO | NS-3 | N/A |
28 | This paper provides a comparison of three routing protocols for the VANET scenario. The results show the performance in the transmission of critical information within the framework of several performance assessments in terms of goodput and packet delivery ratio. | Generic | OLSR AODV DSDV | SUMO | NS-3 | N/A |
51 | The paper presents a fuzzy logic method to improve the routing protocol in the VANET scenario. The study demonstrated the simulation by considering the number of vehicles, the extent of the transmission, and vehicle speed movement. | Urban Generic | AODV | SUMO | OMNeT++ | N/A |
52 | This paper uncovers a road recovery mechanism in the VANET scenario. The study improved the pathway to better message delivery by considering mobility measures such as relative speeds and relative distance. | Generic | CLARR CCBR | N/A | NS-2 | N/A |
53 | The paper examined two routing protocols for better message dissemination in V2V and V2I scenarios. The findings demonstrated optimised routing under several performance assessments like throughput, packet loss, packet delivery report, and delay. | Urban | AODV DSR | SUMO | N/A | NetSim |
Since this area of study is considered as a relatively new but rapidly growing field, this scoping review process only considers relevant papers published from 2015 onwards, which shows that extensive research has been conducted to create security standards for communication technologies, particularly the vehicular network. Although various simulators can be enhanced with library extensions, none of the simulators is related to security and privacy. Ultimately, researchers and professionals cannot compare their security measures to a given circumstance. For instance, ensuring the privacy of a vehicular user in a fast-moving network and disseminating messages in a secure vehicular environment. However, there is no simple practice of extending existing simulators to the desired security standard, which implies that future development research will need to be done.
In addition, the quality of a simulation depends largely on the precision of the models. The range of precision has increased dramatically recently, where several modules contain signal attenuation components, multiple antenna models, and environmental interferences. However, one continuous barrier to producing accurate simulations is the evolution of rapid prototyping and its increasing use in-vehicle networks. For example, vehicle nodes would depend on three-dimensional scenarios to communicate with other nodes. It would be crucial for current and future simulators to extend the current simulators to these new conditions.
Apart from that, integration with real-time system modelling based on non-real-time events creates additional challenges. Due to resource limitations, current simulators do not correspond with the physical properties of the hardware prototype while simulating a comprehensive network with multiple vehicles. Several alternatives have been put forward to reduce the complexity that could speed the simulation. However, this approach usually does not include indirect outcomes, which could seriously impact the behavior of real-world network components. It is, therefore, necessary to examine the interconnection between simulators and hardware devices with the security standards concerned.
Studies have led to the discovery of comprehensive and realistic simulation tools due to the increasing popularity and interest for the future transportation system. This work has examined the current availability of simulators. While testing VANET with essential performance, it is necessary to deploy a mobility generator and mobility network that accurately represent real vehicle traffic. Based on our comparative identification, NS-3 and SUMO has been the optimal choice for real-time VANET modelling. Although several simulators have many features, it is worth exploring further the improvement of the simulators for specific scenarios. In addition, this work can be further be expanded in future by investigating relationships of appropriate simulator for a V2V or V2X application to different scenarios and protocols. We plan to study the used simulators in this context and the extent of benefit and development achieved using the simulators.
All data underlying the results are available as part of the article and no additional source data are required.
Zenodo: PRISMA-ScR checklist for ‘Simulation framework for connected vehicles: a systematic review’, https://doi.org/10.5281/zenodo.563780254
Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Vehicular technology, edge computing, and software-defined networks
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Intelligent Transportation Systems, Artificial Intelligence, Mobile and wireless Communication, Sensors and systems.
Are the rationale for, and objectives of, the Systematic Review clearly stated?
Yes
Are sufficient details of the methods and analysis provided to allow replication by others?
Yes
Is the statistical analysis and its interpretation appropriate?
Partly
Are the conclusions drawn adequately supported by the results presented in the review?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Intelligent Transportation Systems, Artificial Intelligence, Mobile and wireless Communication, Sensors and systems.
Are the rationale for, and objectives of, the Systematic Review clearly stated?
Yes
Are sufficient details of the methods and analysis provided to allow replication by others?
Yes
Is the statistical analysis and its interpretation appropriate?
Yes
Are the conclusions drawn adequately supported by the results presented in the review?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Vehicular technology, edge computing, and software-defined networks
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 2 (revision) 16 Feb 23 |
read | read |
Version 1 09 Dec 21 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)