Skip to main content

Email as Spectroscopy: Automated Discovery of Community Structure within Organizations

  • Conference paper
Communities and Technologies

Abstract

We describe a method for the automatic identification of communities of practice from email logs within an organization. We use a betweenness centrality algorithm that can rapidly find communities within a graph representing information flows. We apply this algorithm to an email corpus of nearly one million messages collected over a two-month span, and show that the method is effective at identifying true communities, both formal and informal, within these scale-free graphs. This approach also enables the identification of leadership roles within the communities. These studies are complemented by a qualitative evaluation of the results in the field.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Adamic, L. A., and Adar, E. (2002). "Friends and Neighbors on the Web," to appear in Social Networks.

    Google Scholar 

  • Aiello, W., Chung, F., & Lu, L. (2000). "A Random Graph Model for Massive Graphs", in Proceedings of the 32nd Annual ACM Symposium on Theory of Computing, 171-180.

    Google Scholar 

  • Alani, H., O'Hara, K., and Shadbolt, N. "ONTOCOPI: Methods and Tools for Identifying Communities of Practice, Intelligent Information Processing Conference", IFIP World Computer Congress (WCC), Montreal, Canada, 2002.

    Google Scholar 

  • Allen, T. (1984). Managing the Flow of Technology. MIT Press.

    Google Scholar 

  • Brandes, U. (2001) "A Faster Algorithm for Betweenness Centrality", Journal of Mathematical Sociology 25 (2): 163 - 177.

    Article  MATH  Google Scholar 

  • Burt, R. S. (1980). "Models of Network Structure", Annual Review of Sociology, Vol. 6, pp. 79 - 141.

    Article  Google Scholar 

  • Crane, D. (1972). Invisible Colleges: Diffusion of Knowledge in Scientific Communities. University of Chicago Press, Chicago.

    Google Scholar 

  • Crozier, M. (1964). The Phenomenon of Bureaucracy. University of Chicago Press, Chicago.

    Google Scholar 

  • Ducheneaut, N. and Bellotti, V. (2002). "A Study of Email Work Processes in Three Organizations," to appear. Technical report available from the authors.

    Google Scholar 

  • Freeman, L. (1977) "A Set of Measures of Centrality Based on Betweenness", Sociometry 40, 35 - 41.

    Article  Google Scholar 

  • Fruchterman, T. M., and Rheingold, E. M. (1991). "Force-Directed Placement", Software Experience and Practice, 21 (11).

    Google Scholar 

  • Girvan, M., & Newman, M. (2002) "Community structure in social and biological networks", Proc. Natl. Acad. Sci. USA 99, 8271-8276.

    Google Scholar 

  • Guimerà, R., Danon, L., Dlaz-Guilera, A., Giralt, F., and Arenas, A. (2002). "Self-similar community structure in organisations". Draft available at http://arxiv.org/PS cache/cond-mat/pdf/0211/0211498.pdf.

    Google Scholar 

  • Huberman, B. A. and Hogg, T. (1995). "Communities of Practice: Performance and Evolution". Computational and Mathematical Organization Theory, Vol. 1, pp. 73 - 92.

    Article  Google Scholar 

  • Krebs, V. E., (2002). "Uncloaking Terrorist Networks," First Monday, volume 7, number 4 (April 2002).

    Google Scholar 

  • Lave, J. and Wenger, E. (1991). Situated Learning: Legitimate Peripheral Participation. Cambridge University Press.

    Google Scholar 

  • Newman, M., (2001). "Who is the Best Connected Scientist? A study of scientific coauthorship networks", Phys Rev. E 64.

    Google Scholar 

  • Newman, M.E.J. (2003), M.E.J. (2003) "The structure and function of complex networks", to appear in SIAM Review, June 2003

    Google Scholar 

  • Ouchi, W. G. (1980). "Markets, Bureaucracies, and Clans." Administrative Science Quarterly, Vol. 25, pp. 129 - 141.

    Article  Google Scholar 

  • Schwartz, M. F., and Wood, D. C. M. (1993). "Discovering Shared Interests Among People Using Graph Analysis", Communications of the ACM, volume 36, issue 8, pp. 78 - 89.

    Article  Google Scholar 

  • Scott, W. R. (1992). Organizations: Rational, Natural, and Open Systems. Prentice-Hall, Inc., Englewood Cliffs, New Jersey.

    Google Scholar 

  • Sparrow, M. K. (1991). "The Application of Network Analysis to Criminal Intelligence: An Assessment of the Prospects," Social Networks, volume 13, pp. 251 - 274.

    Article  Google Scholar 

  • Sproull, L., and Kiesler, S. (1986). "Reducing social context cues: Electronic mail in organizational communication", Management Science, 32, 1492 - 1512.

    Article  Google Scholar 

  • Wellman, B. "Computer Networks As Social Networks", Science 293, 14, Sept 2001: 2031 - 34.

    Article  Google Scholar 

  • Whittaker, S., and Sidner, C. (1996). "Email Overload: Exploring Personal Information Management of Email", in Proceedings of CHI '96, ACM Press, 276-283.

    Google Scholar 

  • Wilkinson, D. and Huberman, H (2002). "A Method for Finding Communities of Related Genes", submitted for publication, http://www.hpl.hp.com/shl/papers/communities/index.html.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer Science+Business Media Dordrecht

About this paper

Cite this paper

Tyler, J.R., Wilkinson, D.M., Huberman, B.A. (2003). Email as Spectroscopy: Automated Discovery of Community Structure within Organizations. In: Huysman, M., Wenger, E., Wulf, V. (eds) Communities and Technologies. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-0115-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-94-017-0115-0_5

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-90-481-6418-9

  • Online ISBN: 978-94-017-0115-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics