Nicolas Jullien
ABSTRACT
We evaluate the efficiency of an online knowledge production project and identify factors that affect efficiency. To assess efficiency, we used the Data Envelopment Analysis (DEA) modelling methodology. We apply DEA to data from more than 30 Wikipedia language projects over three years. We show that the main Wikipedia projects were indeed less efficient that smaller ones, an effect that can be attributed in part to decreasing returns to scale.
- M. Akrich, M. Callon, and B. Latour. Sociologie de la traduction: textes fondateurs. Les presses des Mines de Paris, Paris, 2006.Google Scholar
Cross Ref
- R. D. Banker, A. Charnes, and W. W. Cooper. Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis. Management Science, 30(9):1078--1092, 1984.Google ScholarDigital Library
- J. E. Blumenstock. Size matters: Word count as a measure of quality on wikipedia. In Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08, pages 1095--1096, 2008. Google ScholarDigital Library
- E. Brynjolfsson and L. M. Hitt. Computing productivity: Firm-level evidence. Review of Economics and Statistics, 85 (4):793--808, 2003.Google ScholarCross Ref
- B. Butler, L. Sproull, S. Kiesler, and R. Kraut. Community effort in online groups: Who does the work and why? In S. Weisband, editor, Leadership at a distance: Research in Technologically Supported Work. Lawrence Erlbaum, Mahwah, NJ, 2007.Google Scholar
- B. Butler, E. Joyce, and J. Pike. Don't look now, but we've created a bureaucracy: The nature and roles of policies and rules in Wikipedia. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, CHI '08, pages 1101--1110, New York, NY, USA, 2008. ACM. doi: http://doi.acm.org/10.1145/1357054.1357227. Google ScholarDigital Library
- K. Carillo and C. Okoli. Generating quality open content: A functional group perspective based on the time, interaction, and performance theory. Information & Management, 48(6): 208--219, 2011. Google ScholarDigital Library
- A. Charnes, W. Cooper, and R. E. Measuring the efficiency of decision making units. European Journal of Operational Research, 2: 429--444, 1978.Google ScholarCross Ref
- S. Y. Choi, H. Lee, and Y. Yoo. The impact of information technology and transactive memory systems on knowledge sharing, application, and team performance: A field study. MIS quarterly, 34(4):855--870, 2010. Google ScholarCross Ref
- P. Cohendet, F. Créplet, and O. Dupouet. Interactions between epistemic communities and communities of practice as a mechanism of creation and diffusion of knowledge. In J.-B. Zimmermann and A. Kirman, editors, Interaction and Market Structure. Springer, Londres, 2001.Google Scholar
- B. Collier and J. Bear. Conflict, criticism, or confidence: An empirical examination of the gender gap in Wikipedia contributions. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, CSCW '12, pages 383--392, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- W. W. Cooper, L. M. Seiford, and K. Tone. Introduction to data envelopment analysis and its uses: with DEA-solver software and references. Birkhquser, 2006.Google Scholar
- W. W. Cooper, L. M. Seiford, and J. Zhu, editors. Handbook on Data Envelopment Analysis. Springer, 2nd edition, 2011.Google ScholarCross Ref
- K. Crowston and M. E. Treacy. Assessing the impact of information technology on enterprise level performance. Citeseer, 1986.Google Scholar
- K. Crowston, J. Howison, and H. Annabi. Information system Success in Free and Open Source Software Development: Theory and Measures. Software Process Improvement and Practice, 11: 123--148, 2006.Google ScholarCross Ref
- K. Crowston, N. Jullien, and F. Ortega. Is Wikipedia Inefficient? Modelling Effort and Participation in Wikipedia. In Forty-sixth Hawai'i International Conference on System Sciences (HICSS-46). IEEE Computer society, January 2013. URL http://ssrn.com/abstract=1960696. Google ScholarDigital Library
- D. H. Dalip, M. A. Gonçalves, M. Cristo, and P. Calado. Automatic quality assessment of content created collaboratively by web communities: A case study of wikipedia. In Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, pages 295--304, 2009. Google ScholarDigital Library
- M. Douglas. Cultural Bias. Royal Anthropological Institute, London, 1978.Google Scholar
- P. F. Drucker. Knowledge-Worker Productivity: The Biggest Challenge. California Management Review, 41(2):79--94, 1999.Google ScholarCross Ref
- K. Ehmann, A. Large, and J. Beheshti. Collaboration in context: Comparing article evolution among subject disciplines in wikipedia. First Monday, 13(10), 2008. URL http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/2217/2034.Google Scholar
- Y. Fang and D. Neufeld. Understanding Sustained Participation in Open Source Software Projects. Journal on Management Information Systems, 25(4):9--50, Apr. 2009. Google ScholarDigital Library
- M. J. Farell. The measurement of productive efficiency. Journal of the Royal Statistical Society, Series A, 120(3):250--290, 1957.Google Scholar
- A. Forte, V. Larco, and A. Bruckman. Decentralization in wikipedia governance. Journal of Management Information Systems, 26(1):49--72, 2009. Google ScholarDigital Library
- A. Halfaker, R. S. Geiger, J. T. Morgan, and J. Riedl. The rise and decline of an open collaboration system how Wikipedia's reaction to popularity is causing its decline. American Behavioral Scientist, 57(5):664--688, 2013.Google ScholarCross Ref
- R. Hammwöhner. Interlingual aspects of wikipedia's quality. In Proceedings of the 12th International Conference on Information Quality, MIT, Cambridge, MA, USA, pages 477--488. MIT, 2007.Google Scholar
- M. T. Hannan and J. Freeman. Structural inertia and organizational change. American sociological review, pages 149--164, 1984.Google Scholar
- T. J. Hargrave and A. H. Van De Ven. A collective action model of institutional innovation. Academy of Management Review, 31(4):864--888, 2006.Google ScholarCross Ref
- H. Hasan and C. Pfaff. The wiki: an environment to revolutionise employees' interaction with corporate knowledge. In Proceedings of the Australasian Computer-Human Interaction Conference, Sydney, 2006. OZCHI 2006. Google ScholarDigital Library
- D. D. Heckathorn. The dynamics and dilemmas of collective action. American Sociological Review, 61: 250--277, Apr. 1996.Google ScholarCross Ref
- M. Helfen and J. Sydow. Negotiating as Institutional Work: The Case of Labour Standards and International Framework Agreements. Organization Studies, 34(8):1073--1098, 2013.Google ScholarCross Ref
- C. Hess and E. Ostrom, editors. Understanding Knowledge as a Commons. From Theory to Practice. MIT Press, december 2006.Google ScholarCross Ref
- C. Hess and E. Ostrom. Introduction: An Overview of the Knowledge Commons. In {31}, editor, Understanding Knowledge as a Commons. From Theory to Practice, pages 3--26. 2006.Google Scholar
- P. Hofmann and D. Riehle. Estimating Commit Sizes Efficiently. In Open Source Ecosystems: Diverse Communities Interacting (IFIP 2.13), volume 299/2009 of IFIP Advances in Information and Communication Technology, pages 105--115. Springer, Springer, 2009. URL http://flosshub.org/sites/flosshub.org/files/EstimatingCommitSizesEffciently.pdf.Google ScholarCross Ref
- G. Hofstede. Cultures and organizations: Software of the mind. McGraw-Hill, London, 1991.Google Scholar
- S. Javanmardi, Y. Ganjisaffar, C. Lopes, and P. Baldi. User contribution and trust in Wikipedia. In 5th International Conference on Collaborative Computing: Networking, Applications and Worksharing, 2009.Google ScholarCross Ref
- D. Jemielniak. Common Knowledge?: An Ethnography of Wikipedia. Stanford University Press, 2014.Google Scholar
- W. A. Katz. Introduction to reference work, vol. 1: Basic Information Services. McGraw-Hill, Boston, MA, 8th edition, 2002.Google Scholar
- B. A. Kitchenham. The question of scale economies in software - why cannot researchers agree? Information and Software Technology, 44(1): 13--24, 2002. Google ScholarDigital Library
- S. Koch. Exploring the effects of sourceforge.net coordination and communication tools on the efficiency of open source projects using data envelopment analysis. Empirical Software Engineering, 14: 397--417, 2009. Google ScholarDigital Library
- S. Koch. Organisation of work in open source projects: expended effort and efficiency. Revue d'économie industrielle, 136: 17--38, 2011.Google Scholar
- S. K. Lam, A. Uduwage, Z. Dong, S. Sen, D. R. Musicant, L. Terveen, and J. Riedl. WP:Clubhouse? An Exploration of Wikipedia's Gender Imbalance. In Proceedings of the 7th International Symposium on Wikis and Open Collaboration, WikiSym '11, New York, NY, USA, Oct. 2011. ACM. Google ScholarDigital Library
- D. Lewandowski and U. Spree. Ranking of Wikipedia articles in search engines revisited: Fair ranking for reasonable quality? Journal of the American Society for Information Science and Technology, 62(1):117--132, 2011. Google ScholarDigital Library
- H.-T. Liao. Conflict and consensus in the chinese version of wikipedia. IEEE Technology and Society Magazine, 28, 2009.Google Scholar
- D. Lindsey. Evaluating quality control of wikipedia's feature articles. First Monday, 15(4), 2010. URL http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/2721/2482.Google Scholar
- G. Marwell and P. Oliver. The Critical Mass in Collective Action: A Micro-Social Theory. Cambridge University Press, Cambridge, 1993.Google ScholarCross Ref
- A. P. McAfee. Enterprise 2.0: The Dawn of Emergent Collaboration. Management of Technology and Innovation, 47 (3), 2006.Google Scholar
- B. L. Myers, L. A. Kappelman, and V. R. Prybutok. A comprehensive model for assessing the quality and productivity of the information systems function: toward a theory for information systems assessment. Information Resources Management Journal (IRMJ), 10(1):6--26, 1997. Google ScholarDigital Library
- P. V. Norden. On the anatomy of development projects. IRE Transactions on Engineering Management, 7(1):34--42, 1960.Google ScholarCross Ref
- M. Olson. The logic of Collective Action. Harvard University Press, Cambridge Mass., 1965.Google Scholar
- F. Ortega, D. Izquierdo-Cortazar, J. M. Gonzalez-Barahona, and G. Robles. On the analysis of contributions from privileged users in virtual open communities. In 42th Hawaii International Conference on System Sciences (HICSS), page 110, Waikoloa, Big Island, Hawaii, USA, Jan. 2009. IEEE Computer Society. doi: http://dx.doi.org/10.1109/HICSS.2009.843. Google ScholarDigital Library
- P. Otto and M. Simon. Dynamic perspectives on social characteristics and sustainability in online community networks. System Dynamics Review, 24(3):321--347, 2008.Google ScholarCross Ref
- G. Poderi. Comparing featured article groups and revision patterns correlations in Wikipedia. First Monday, 14(5), 2009. URL http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/2365/2182.Google Scholar
- S. Ransbotham and G. C. Kane. Membership Turnover and Collaboration Success in Online Communities: Explaining Rises and Falls from Grace in Wikipedia. MIS Quarterly, 14 (9):541--545, September 2011. Google ScholarDigital Library
- J. Reagle. "free as in sexist?" free culture and the gender gap. First Monday, 18(1), 2012.Google Scholar
- F. Rullani and S. Haefliger. The periphery on stage: The intra-organizational dynamics in online communities of creation. Research Policy, 42(4):941--953, 2013.Google ScholarCross Ref
- S. Sadiq. The Final Frontier: A SAS Approach to Data Envelopment Analysis. In SAS Global Forum 2011 Operations Research, 2011. URL http://support.sas.com/resources/papers/proceedings11/198-2011.pdf. Paper 198--2011.Google Scholar
- B. Simpson, R. Willer, and C. L. Ridgeway. Status Hierarchies and the Organization of Collective Action. Sociological Theory, 30(3):149--166, 2012.Google Scholar
- J. Struben and B. Lee. Market Formation: Examining the Coordination of Heterogeneous Contributions. Technical report, DRUID, Copenhagen Business School, Department of Industrial Economics and Strategy/Aalborg University, Department of Business Studies, 2012.Google Scholar
- B. Stvilia, M. B. Twidale, L. C. Smith, and L. Gasser. Information Quality Work Organization in Wikipedia. Journal of the American Society for Information Science and Technology, 59(6):983--1001, 2008. Google ScholarDigital Library
- B. Stvilia, A. Al-Faraj, and Y. Yi. Issues of cross-contextual information quality evaluation--The case of Arabic, English, and Korean Wikipedias. Library & Information Science Research, 31(4):232--239, 2009.Google ScholarCross Ref
- B. Suh, G. Convertino, E. H. Chi, and P. Pirolli. The singularity is not near: Slowing growth of wikipedia. In Proceedings of the 5th International Symposium on Wikis and Open Collaboration, WiKiSym 2009, 2009. Google ScholarDigital Library
- B. Uzzi. A social network's changing statistical properties and the quality of human innovation. Journal of Physics A: Mathematical and Theoretical, 41(22):224023, 12pgs, June 2008.Google ScholarCross Ref
- H. R. Varian. Intermediate microeconomics: a modern approach. W. W. Norton, New York, NY, 2nd edition, 2005.Google Scholar
- G. Von Krogh, S. Spaeth, and K. R. Lakhani. Community, joining, and specialization in open source software innovation: A case study. Research Policy, 32(7):1217--1241, 2003.Google ScholarCross Ref
- D. Wallace and C. Van Fleet. The democratization of information? wikipedia as a reference resource. Reference and User Services Quarterly, 45: 100--103, 2005.Google Scholar
- T. Wöhner and R. Peters. Assessing the quality of Wikipedia articles with lifecycle based metrics. In WikiSym '09: Proceedings of the 5th International Symposium on Wikis and Open Collaboration, pages 1--10, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- S.-H. Yu, Y.-G. Kim, and M.-Y. Kim. Do we know what really drives km performance? Journal of Knowledge Management, 11(6):39--53, 2007.Google ScholarCross Ref
- V. Zlatić and H. Stefancić. Model of Wikipedia growth based on information exchange via reciprocal arcs. EPL, 93(5): 58005, 2011.Google ScholarCross Ref
Index Terms
- The rise and fall of an online project: is bureaucracy killing efficiency in open knowledge production?
Recommendations
Increasing fall risk awareness using wearables
Display Omitted A survey of wearables used in fall risk assessment and prevention.Separating fall risk into prospective and context-aware.A Fall Risk Awareness Protocol is proposed is built upon ta Fall Risk Probability Engine.Combining data from ...
Research of Risk Management of Online Group-Buying Project
ICEE '12: Proceedings of the 2012 3rd International Conference on E-Business and E-Government - Volume 04Online group-buying project has becoming an important consumer behavior nowadays. Its rapidly development turns out to be very favorable to consumers, sellers and suppliers. But the online group-buying project is still underway, and many problems and ...
Reseach of Risk Management of Online group-buying Project
ICEE '12: Proceedings of the 2012 3rd International Conference on E-Business and E-Government - Volume 02Online group-buying project has becoming an important consumer behavior nowadays. Its rapidly development turns out to be very favorable to consumers, sellers and suppliers. But the online group-buying project is still underway, and many problems and ...
Comments