Abstract
Experience with the parallelization of an index generator for desktop search is presented. Several configurations of the index generator are compared on three different Intel platforms with 4, 8, and 32 cores. The optimal configurations for these platforms are not intuitive and are markedly different for the three platforms. For finding the optimal configuration, detailed measurements and experimentation were necessary. Several recommendations for parallel software design are derived from this study.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Pankratius, V., Jannesari, A., Tichy, W.F.: Parallelizing BZip2: A Case Study in Multicore Software Engineering. IEEE Softw. 26, 70–77 (2009)
Schäfer, C.A., Pankratius, V., Tichy, W.F.: Engineering Parallel Applications with Tunable Architectures. In: ICSE 2010, pp. 405–414. ACM, New York (2010)
Pankratius, V., Adl-Tabatabai, A., Otto, F.: Does Transactional Memory Keep Its Promises? Results from an Empirical Study, Technical Report 2009-12, IPD, University of Karlsruhe, Germany (September 2009)
Intel Manycore Testing Lab (March 2010), http://software.intel.com/en-us/articles/intel-many-core-testing-lab/
Agrawal, N., Bolosky, W.J., Douceur, J.R., Lorch, J.R.: A five-year study of file-system metadata. In: Trans. Storage, vol. 3. ACM, New York (2007)
Douceur, J.R., Bolosky, W.J.: A Large-Scale Study of File-System Contents. In: SIGMETRICS 1999, vol. 27, pp. 59–70. ACM, New York (1999)
Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters. ACM Commun. 51, 107–113 (2008)
Noll, L.C.: FNV hash (March 2010), http://isthe.com/chongo/tech/comp/fnv/
Parnas, D.L., Clements, P.C.: A rational design process: How and why to fake it. IEEE Trans. Softw. Eng. 12, 251–257 (1986)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Meder, D.J., Tichy, W.F. (2011). Parallelizing an Index Generator for Desktop Search. In: Varbanescu, A.L., Molnos, A., van Nieuwpoort, R. (eds) Computer Architecture. ISCA 2010. Lecture Notes in Computer Science, vol 6161. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24322-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-24322-6_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24321-9
Online ISBN: 978-3-642-24322-6
eBook Packages: Computer ScienceComputer Science (R0)