Skip to main content
SpringerLink
Log in

A component-based end-to-end simulation of the Linux file system

  • Theme Section
  • Published:
Software & Systems Modeling Aims and scope Submit manuscript

Abstract

The Linux file system is designed with components utilizing a layered architecture. The upper components hide details of the lower components, and each layer presents unified and simple interfaces to the layers above and below. This design helps Linux to be flexible as well as to provide support for multiple types of storage devices. In this paper, this component architecture is used to develop a realistic simulation without having to model lower level details of the hardware layer or particular storage devices. A detailed simulation-based performance model of the Linux ext3 file system has been developed using Colored Petri Nets. The extensive validation study using the model obtains results that are close to the expected behavior of the real file system. The model demonstrates that file system parameters have a significant impact on the I/O performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bryant, R.E.: Data-Intensive Supercomputing: The Case for DISC, Carnegie Mellon University, Pittsburgh CMU-CS-07-128 (2007)

  2. Gorton I., Greenfield P., Szalay A., Williams R.: Data-intensive computing in the 21st century. Computer 41, 30–32 (2008)

    Article  Google Scholar 

  3. Johnson, M.K.: Whitepaper: Red Hat’s New Journaling File System: Ext3. http://www.redhat.com/support/wpapers/redhat/ext3/ (2001)

  4. Ratzer, A.V., et~al.: CPN Tools for Editing, Simulating, and Analysing Coloured Petri Nets. In: Proceedings of the 24th international conference on Applications and theory of Petri nets, Eindhoven, The Netherlands, pp. 450–462 (2003)

  5. Nguyen, H.Q., Apon, A.: Hierarchical Performance Measurement and Modeling of the Linux File System. In: Proceeding of the second joint WOSP/SIPEW international conference on Performance engineering, Karlsruhe, Germany, pp. 73–84 (2011)

  6. Bucy, J.S., Ganger, G.R.: The Disksim Simulation Environment Version 3.0 Reference Manual. School of Computer Science, Carnegie Mellon University, Pittsburgh (2003)

  7. Griffin, J.L., Schindler, J., Schlosser, S.W., Bucy, J.C., Ganger, G.R.: Timing-Accurate Storage Emulation. In: Proceedings of the 1st USENIX Conference on File and Storage Technologies, Monterey, CA, p. 6 (2002)

  8. Griffin, J.L., Ganger, G.R.: Timing-Accurate Storage Emulation: Evaluating Hypothetical Storage Components in Real Computer Systems. Thesis (PhD), Carnegie Mellon University, Carnegie Mellon University, Pittsburgh, PA (2004)

  9. Maghraoui, K.E., Kandiraju, G., Jann, J., Pattnaik, P.: Modeling and Simulating Flash Based Solid-State Disks for Operating Systems. In: Proceedings of the First Joint WOSP/SIPEW International Conference on Performance Engineering, San Jose, California, USA, pp. 15–26 (2010)

  10. Zhaobin, L., Haitao, L.: Modeling and Performance Evaluation of Hybrid Storage I/O in Data Grid. In: IFIP International Conference on Network and Parallel Computing Workshops, 2007. NPC Workshops, pp. 624–629 (2007)

  11. Wang, Y., Kaeli, D.: Execution-Driven Simulation of Network Storage Systems. In: Proceedings of the The IEEE Computer Society’s 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, pp. 604–611 (2004)

  12. Molero, X., Silla, F., Santonja, V., Duato, J.: Modeling and Simulation of Storage Area Networks. In: Proceedings of the 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, 2000, pp. 307–314 (2000)

  13. Routray, R., Gopisetty, S., Galgali, P., Modi, A., Nadgowda, S.: ISAN: Storage Area Network Management Modeling Simulation. In: International Conference on Networking, Architecture, and Storage, 2007. NAS 2007, pp. 199–208 (2007)

  14. Staley, J., Muknahallipatna, S., Johnson, H.: Fibre Channel Based Storage Area Network Modeling Using Opnet for Large Fabric Simulations: Preliminary Work. In: 32nd IEEE Conference on Local Computer Networks, 2007. LCN 2007, pp. 234–236 (2007)

  15. Aizikowitz, N., Glikson, A., Landau, A., Mendelson, B., Sandbank, T.: Component-Based Performance Modeling of a Storage Area Network. In: Proceedings of the 37th conference on Winter simulation, Orlando, FL, pp. 2417–2426 (2005)

  16. Hung-Chang, H., Chung-Ta, K.: Modeling and Evaluating Peer-to-Peer Storage Architectures. In: Proceedings of the International Parallel and Distributed Processing Symposium, IPDPS 2002, Abstracts and CD-ROM, pp. 24–29 (2002)

  17. DeRosa, P., Shen, K., Stewart, C., Pearson, J.: Realism and Simplicity: Disk Simulation for Instructional Os Performance Evaluation. In: Proceedings of the 37th SIGCSE technical Symposium on Computer Science Education, Houston, TX, USA, pp. 308–312 (2006)

  18. Ali, A., Souza, R.D.: Modeling and Simulation of Hard Disk Dive Final Assembly Using a Hdd Template. In: Proceedings of the 39th Conference on Winter simulation: 40 years! The best is Yet to Come, Washington, DC, pp. 1641–1650 (2007)

  19. Thekkath C., Wilkes J., Lazowska E.: Techniques for file system simulation. Softw. Pract. Exp. 24(11), 981–999 (1994)

    Article  Google Scholar 

  20. Liu, Y., Figueiredo, R., Clavijo, D., Xu, Y., Zhao, M.: Towards simulation of parallel file system scheduling algorithms with PFSsim. In: Proceedings of the 7th IEEE International Workshop on Storage Network Architectures and Parallel I/O, Denver, CO, May 2011

  21. Jones, M.T.: Anatomy of the Linux File System (2007). http://www.ibm.com/developerworks/linux/library/l-linux-filesystem/

  22. Linux Kernel Organization.: Linux Kernel Source Code (2011). http://www.kernel.org/

  23. International Data Corporation: IDC Press Release (2010). http://www.idc.com/about/viewpressrelease.jsp?containerId=prUS22716111

  24. Stansberry, M.: Data Center Decisions 2010 Survey: Virtualization Drives Budget Rebound (2010). http://searchdatacenter.techtarget.com/news/1516863/Data-Center-Decisions-2010-survey-Virtualization-drives-budget-rebound#server

  25. Norcott, W.D., Capps, D.: Iozone Filesystem Benchmark (2011). www.iozone.org

  26. Murray, N., Horman, N.: Understanding Virtual Memory (2004). http://www.redhat.com/magazine/001nov04/features/vm/

  27. Pommnitz, J.: Kernel Level Exception Handing in Linux 2.1.8 (2010). http://www.mjmwired.net/kernel/Documentation/exception.txt

  28. Levon, J.: Oprofile—a System Profiler for Linux (2009). http://oprofile.sourceforge.net/

  29. Kristensen L.M., Christensen S., Jensen K.: The Practitioner’s Guide to Coloured Petri Nets. Int. J. Softw. Tools Technol. Transf. 2, 98–132 (1998)

    Article  MATH  Google Scholar 

  30. Jensen K.: Coloured Petri Nets (2nd ed.): Basic Concepts, Analysis Methods and Practical Use: Volume 1. Springer-Verlag, London, UK (1996)

    Book  Google Scholar 

  31. Lu, B., et al.: A Case Study on Grid Performance Modeling. In: The 18th IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2006), Dallas, TX, USA (2006)

  32. Prabhakaran, V., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Analysis and Evolution of Journaling File Systems. In: Proceedings of the Annual Conference on USENIX Annual Technical Conference, Anaheim, CA, p. 8 (2005)

Download references

Author information

Authors and Affiliations

  1. University of Arkansas, Fayetteville, AR, USA

    Hai Nguyen

  2. Clemson University, Clemson, SC, USA

    Amy Apon

Authors
  1. Hai Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amy Apon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hai Nguyen.

Additional information

Communicated by Dr. Raffaela Mirandola and David Lilja.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nguyen, H., Apon, A. A component-based end-to-end simulation of the Linux file system. Softw Syst Model 12, 745–764 (2013). https://doi.org/10.1007/s10270-012-0253-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10270-012-0253-0

Keywords

Search

Navigation