Aaron Halfaker
Aniket Kittur
John Riedl
ABSTRACT
Reverts are important to maintaining the quality of Wikipedia. They fix mistakes, repair vandalism, and help enforce policy. However, reverts can also be damaging, especially to the aspiring editor whose work they destroy. In this research we analyze 400,000 Wikipedia revisions to understand the effect that reverts had on editors. We seek to understand the extent to which they demotivate users, reducing the workforce of contributors, versus the extent to which they help users improve as encyclopedia editors. Overall we find that reverts are powerfully demotivating, but that their net influence is that more quality work is done in Wikipedia as a result of reverts than is lost by chasing editors away. However, we identify key conditions -- most specifically new editors being reverted by much more experienced editors - under which reverts are particularly damaging. We propose that reducing the damage from reverts might be one effective path for Wikipedia to solve the newcomer retention problem.
- B. T. Adler and L. de Alfaro. A content-driven reputation system for the Wikipedia. In WWW '07, pages 261--270, New York, NY, USA, 2007. ACM. Google Scholar
Digital Library
- U. Brandes and J. Lerner. Visual analysis of controversy in user-generated encyclopedias. InfoVis, 7:34--48, March 2008. Google ScholarDigital Library
- A. Bruns and S. Humphreys. Wikis in teaching and assessment: The M/Cyclopedia project. In WikiSym. '05, pages 25--32, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
- B. Choi, K. Alexander, R. E. Kraut, and J. M. Levine. Socialization tactics in Wikipedia and their effects. In CSCW '10, pages 107--116, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- P. Dondio, S. Barrett, S. Weber, and J. Seigneur. Extracting trust from domain analysis: A case study on the Wikipedia project. In L. Yang, H. Jin, J. Ma, and T. Ungerer, editors, Autonomic and Trusted Computing, volume 4158, pages 362--373. Springer Berlin, 2006. Google ScholarDigital Library
- M. D. Ekstrand and J. T. Riedl. rv you're dumb: Identifying discarded work in wiki article history. In WikiSym '09, pages 4:1--4:10, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- A. Forte and A. Bruckman, From Wikipedia to the classroom: Exploring online publication and learning. In ICLS '06, pages 182--188. International Society of the Learning Sciences, 2006. Google ScholarDigital Library
- R. S. Geiger and D. Ribes. The work of sustaining order in Wikipedia: The banning of a vandal. In CSCW '10, pages 117--126, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- J. Grudin and E. S. Poole. Wikis at work: Success factors and challenges for sustainability of enterprise wikis. In WikiSym '10, pages 5:1--5:8, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- A. Halfaker, A. Kittur, R. Kraut, and J. Riedl. A jury of your peers: Quality, Experience and Ownership in Wikipedia. In WikiSym '09, pages 1--10, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- S. J. Karau and K. D. Williams. Groups at work: Theory and research, chapter Understanding Individual Motivation in Groups: The Collective Effort Model, pages 113--141. Lawrence Erlbaum Associates, Inc., 2001.Google Scholar
- A. Kittur and R. E. Kraut. Harnessing the wisdom of crowds in Wikipedia: Quality through coordination. In CSCW '08. ACM, 2008. Google ScholarDigital Library
- A. Kittur and R. E. Kraut. Beyond Wikipedia: Coordination and conflict in online production groups. In CSCW '10, pages 215--224, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- A. Kittur, B. Suh, B. A. Pendleton, and E. H. Chi. He says, she says: Conflict and coordination in Wikipedia. In CHI '07, pages 453--462, New York, NY, USA, 2007. ACM. Google ScholarDigital Library
- P. Magnus. Early response to false claims in Wikipedia. First Monday, 13(9), 2008.Google Scholar
- R. Priedhorsky, J. Chen, S. Lam, K. Panciera, L. Terveen, and J. Riedl. Creating, destroying, and restoring value in Wikipedia. In GROUP'07, Sanibel Island, FLorida, USA, 2007. Google ScholarDigital Library
- C. Roth, D. Taraborelli, and N. Gilbert. Measuring wiki viability: an empirical assessment of the social dynamics of a large sample of wikis. In WikiSym '08, pages 27:1--27:5, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- B. Stvilia, M. B. Twidale, and L. C. Smith. Information quality: Discussions in Wikipedia. 2005.Google Scholar
- B. Stvilia, M. B. Twidale, L. C. Smith, and L. Gasser. Assessing information quality of a community-based encyclopedia. ACM Press, 2005.Google Scholar
- B. Suh, E. Chi, B. Pendleton, and A. Kittur. Us vs. them: Understanding social dynamics in Wikipedia with revert graph visualizations. In VAST '07, pages 163--170, Nov. 2007. Google ScholarDigital Library
- B. Suh, G. Convertino, E. H. Chi, and P. Pirolli. The singularity is not near: Slowing growth of Wikipedia. In WikiSym '09, pages 1--10, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- J. Thom-Santelli, D. R. Cosley, and G. Gay. What's mine is mine: Territoriality in collaborative authoring. In CHI '09, pages 1481--1484, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- F. B. Viégas, M. Wattenberg, and K. Dave. Studying cooperation and conflict between authors with history flow visualizations. In CHI'04, pages 575--582. ACM, 2004. Google ScholarDigital Library
- Wikipedia. Editor trends study. http://strategy.wikimedia.org/?oldid=80283, March 2011.Google Scholar
- H. Zeng, M. A. Alhossaini, R. Fikes, and D. L. McGuinness. Mining revision history to assess trustworthiness of article fragments. In CollaborateCom '06, pages 1--10, 2006.Google ScholarCross Ref
- X. Zhang and F. Zhu. Intrinsic motivation of open content contributors: The case of Wikipedia. Workshop on Information Systems and Economics, 2006.Google Scholar
Index Terms
- Don't bite the newbies: how reverts affect the quantity and quality of Wikipedia work
Recommendations
NICE: social translucence through UI intervention
WikiSym '11: Proceedings of the 7th International Symposium on Wikis and Open CollaborationSocial production systems such as Wikipedia rely on attracting and motivating volunteer contributions to be successful. One strong demotivating factor can be when an editor's work is discarded, or "reverted", by others. In this paper we demonstrate ...
A jury of your peers: quality, experience and ownership in Wikipedia
WikiSym '09: Proceedings of the 5th International Symposium on Wikis and Open CollaborationWikipedia is a highly successful example of what mass collaboration in an informal peer review system can accomplish. In this paper, we examine the role that the quality of the contributions, the experience of the contributors and the ownership of the ...
Measuring the Quality of Edits to Wikipedia
OpenSym '14: Proceedings of The International Symposium on Open CollaborationWikipedia is unique among reference works both in its scale and in the openness of its editing interface. The question of how it can achieve and maintain high-quality encyclopedic articles is an area of active research. In order to address this question,...
Comments