Stuart Kurkowski
Tracy Camp
Skip Abstract Section
Abstract
Simulation is the research tool of choice for a majority of the mobile ad hoc network (MANET) community. However, while the use of simulation has increased, the credibility of the simulation results has decreased. To determine the state of MANET simulation studies, we surveyed the 2000-2005 proceedings of the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc). From our survey, we found significant shortfalls. We present the results of our survey in this paper. We then summarize common simulation study pitfalls found in our survey. Finally, we discuss the tools available that aid the development of rigorous simulation studies. We offer these results to the community with the hope of improving the credibility of MANET simulation-based studies.
- R. Bagrodia and M. Takai. Position paper on validation of network simulation models. Computer Science Department of University of California, Los Angeles, 1999.Google Scholar
- O. Balci. Validation, verification, and testing techniques throughout the lifecycle of a simulation study. In Proceedings of the 26th Conference on Winter Simulation, pages 215--220, 1994. Google ScholarDigital Library
- O. Balci. Verification, validation and accreditation of simulation models. In Proceedings of the 29th Conference on Winter Simulation, pages 135--141, 1997. Google ScholarDigital Library
- R. Barton. Design of experiments: designing simulation experiments. In Proceedings of the 33rd Conference on Winter Simulation, pages 47--52, 2001. Google ScholarDigital Library
- J.-Y. Le Boudec and M. Vojnovic. Perfect simulation and stationarity of a class of mobility models. In Proceedings of the 38th IEEE Symposium on Simulation, pages 72--79, 2005. Google ScholarDigital Library
- L. Brakmo and L. Peterson. Experiences with network simulation. In Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), pages 80--90, 1996. Google ScholarDigital Library
- L. Briesemeister and G. Hommel. Role-based multicast in highly mobile but sparsely connected ad hoc networks. In Proceedings of the 1st ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), pages 45--50, 2000. Google ScholarDigital Library
- T. Dyer and R. Boppana. A comparison of TCP performance over three routing protocols for mobile ad hoc networks. In Proceedings of the 2nd ACM International Symposium on Mobile Ad Hoc Networking and Computing (Mobi-Hoc), pages 56--66, 2001. Google ScholarDigital Library
- Association for Computing Machinery. The ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc). URL: http://www.sigmobile.org/mobihoc. Page accessed on April 23, 2005.Google Scholar
- D. Goldsman and G. Tokol. Output analysis: output analysis procedures for computer simulations. In Proceedings of the 32nd Conference on Winter Simulation, pages 39--45, 2000. Google ScholarDigital Library
- Akaroa Research Group. Akaroa2. URL: http://www.tkn.tu-berlin.de/research/ns2_akaroa-2/ns.html. Page accessed on April 21, 2005.Google Scholar
- The VINT Group. Ns-users mailing list. http://mailman.isi.edu/mailman/listinfo/nsusers. Page accessed on April 23, 2005.Google Scholar
- J. Heidemann, S. Kumar, and K. Mills. Expanding confidence in network simulations. IEEE Network, September/October:58--63, 2001. Google ScholarDigital Library
- X. Hong, M. Gerla, G. Pei, and C. Chiang. A group mobility model for ad hoc wireless networks. In Proceedings of the ACM International Workshop on Modeling and Simulation of Wireless and Mobile Systems (MSWiM), pages 53--60, August 1999. Google ScholarDigital Library
- Y. Hu and D. Johnson. Implicit source routes for on-demand ad hoc network routing. In Proceedings of the 2nd ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), pages 1--10, 2001. Google ScholarDigital Library
- D. Johnson and D. Maltz. Dynamic source routing in ad hoc wireless networks. In Mobile Computing, pages 153--181. 1996.Google ScholarCross Ref
- S. Kurkowski, T. Camp, and M. Colagrosso. A visualization and animation tool for NS-2 wireless simulations: iNSpect. In Proceedings of the 13th Annual Meeting of the IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), 2005. Google ScholarDigital Library
- A. Law and W. Kelton. Simulation modeling and analysis. McGraw-Hill, 2000. Google ScholarDigital Library
- P. L'Ecuyer and R. Simard. On the performance of birthday spacing tests for certain families of random number generators. Mathematics and Computers in Simulation, pages 131--137, 2001. Google ScholarDigital Library
- S. Lee and C. Kim. Neighbor supporting ad hoc multicast routing protocol. In Proceedings of the 1st ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), pages 37--44, 2000. Google ScholarDigital Library
- J. Liu, L. F. Perrone, Y. Yuan, and D. Nicol. The simulator for wireless ad hoc networks (SWAN). URL: http://www.eg.bucknell.edu/swan/. Page accessed on August 19, 2005.Google Scholar
- Tommaso Melodia, Dario Pompili, Vehbi C. Gungor, and Ian F. Akyildiz. A distributed coordination framework for wireless sensor and actor networks. In Proceedings of the 6th ACM international symposium on Mobile ad hoc networking and computing (MobiHoc), pages 99--110, 2005. Google ScholarDigital Library
- S. Midkiff. Simulation: Methodology. Presentation to ECE590 class. URL: http://fiddle.visc.vt.edu/courses/ece5984net2/lectures/09_sim.pdf. Page accessed on April 15, 2005.Google Scholar
- D. Montgomery. Design and Analysis of Experiments. Wiley, 2005. Google ScholarDigital Library
- E. Mota, A. Wolisz, and K. Pawlikowski. Experience with Akaroa: speeding up stochastic simulation using parallel replications. In Proceedings of the High Performance Computing and Advanced Simulation Technologies Conference, pages 296--301, 1998.Google Scholar
- W. Navidi and T. Camp. Stationary distributions for the random waypoint mobility model. IEEE Transactions on Mobile Computing, pages 99--108, 2004. Google ScholarDigital Library
- The NS manual: formerly known as notes and documentation, 2003. URL: http://www.isi.edu/nsnam/ns/. Page accessed on April 21, 2005.Google Scholar
- K. Pawlikowski. Do not trust all simulation studies of telecommunications networks. International Conference on Information Networking (ICOIN), pages 899--908, 2003.Google ScholarCross Ref
- K. Pawlikowski, J. Jeong, and R. Lee. On credibility of simulation studies of telecommunication networks. IEEE Communications Magazine, pages 132--139, 2001. Google ScholarDigital Library
- K. Pawlikowski, J. Jeong, and R. Lee. Letters to the editor. IEEE Communications Magazine, pages 132--139, 2002.Google Scholar
- K. Pawlikowski and V. Yau. Akaroa-2 Manual, 1995. Department of Computer Science, University of Canterbury, ChristChurch New Zealand. URL: http://www.tkn.tu-berlin.de/research/ns2_akaroa-2. Page accessed on April 21, 2005.Google Scholar
- G. Pei, M. Gerla, X. Hong, and C. Chiang. A wireless hierarchical routing protocol with group mobility. In Proceedings of the IEEE Wireless Communications and Networking Conference (WCNC), pages 1538--1542, 1999.Google ScholarCross Ref
- L. F. Perrone, Y. Yuan, and D. Nicol. Modeling and simulation best practices for wireless ad hoc networks. In Proceedings of the 35th Conference on Winter Simulation, pages 685--693, 2003. Google ScholarDigital Library
- The CMU Monarch Project. The CMU monarch extensions to the ns simulator. URL: http://www.monarch.cs.cmu.edu/. Page accessed on April 25, 2005.Google Scholar
- The SEACORN Project. SEACORN simulation tools. URL: http://seacorn.ptinovacao.pt/sim_tools.html. Page accessed on April 23, 2005.Google Scholar
- E. Royer, P. M. Melliar-Smith, and L. Moser. An analysis of the optimum node density for ad hoc mobile networks. In Proceedings of the IEEE International Conference on Communications (ICC), pages 857--861, 2001.Google ScholarCross Ref
- N. Sadagopan, F. Bai, B. Kishuamachori, and A. Helmy. PATHS analysis of path duration statistics and their impact on reactive manet routing protocols. In Proceedings of the 4th ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), pages 245--256, 2003. Google ScholarDigital Library
- S. Sanchez. Output modeling: abc's of output analysis. In Proceedings of the 33rd Conference on Winter Simulation, pages 30--38, 2001. Google ScholarDigital Library
- R. Sargent. Verification, validation, and accreditation of simulation models. In Proceedings of the 32nd Conference on Winter Simulation, pages 50--59, 2000. Google ScholarDigital Library
- L. Schruben. Detecting initialization bias in simulation output. Operations Research, pages 569--590, 1982.Google Scholar
- R. Zheng, J. Hou, and L. Sha. Asynchronous wakeup for ad hoc networks. In Proceedings of the 4th ACM International Symposium on Mobile Ad Hoc Networking and Computing (Mobi-Hoc), pages 35--45, 2003. Google ScholarDigital Library
Index Terms
- MANET simulation studies: the incredibles
Recommendations
A MANET Simulation System: A Case Study Considering Static Source and Destination Nodes and OLSR Protocol
EIDWT '12: Proceedings of the 2012 Third International Conference on Emerging Intelligent Data and Web TechnologiesMANETs are attracting attention for their potential use in several fields such as collaborative computing and multimedia communications. MANET nodes cooperate in an autonomous way by forwarding packets to each-other. Considering mobility of the ...
A simulation analyse of MANET's RREQ Flooding and HELLO Flooding attacks with ns-3
NISS '19: Proceedings of the 2nd International Conference on Networking, Information Systems & SecurityIn the last decade, Mobile Ad hoc Networks (MANETs) have emerged as a major next generation wireless networking technology and have generated great interest among researchers in the development of theoretical and practical concepts, and their ...
Comments