skip to main content
10.1145/3334480.3375030acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Identifying and Addressing Design and Policy Challenges in Online Content Moderation

Published:25 April 2020Publication History

ABSTRACT

My doctoral research identifies and addresses the design and policy challenges of content moderation on the levels of smaller communities and larger platforms, using a combination of interviews and surveys. My prior work studies voice-based communities on Discord, and shows that voice as a new technology brings unique challenges to community moderators and highlights the fundamental evidentiary need in content moderation. My dissertation expands on this work by (1) quantifying severity of violations as a way to address social media platforms' challenge of prioritization, and (2) empirically evaluating existing moderation approaches and design recommendations by soliciting moderator and user perceptions of them. Combining these perspectives, my dissertation will provide guidelines for improving content moderation in online communities.

References

  1. Stevie Chancellor, Jessica Annette Pater, Trustin Clear, Eric Gilbert, and Munmun De Choudhury. 2016. #Thyghgapp: Instagram Content Moderation and Lexical Variation in Pro-Eating Disorder Communities. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1201--1213. DOI: http://dx.doi.org/10.1145/2818048.2819963Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Eshwar Chandrasekharan, Umashanthi Pavalanathan, Anirudh Srinivasan, Adam Glynn, Jacob Eisenstein, and Eric Gilbert. 2017. You Can't Stay Here: The Efficacy of Reddit's 2015 Ban Examined Through Hate Speech. Proc. ACM Hum.-Comput. Interact.: CSCW 1, 2 (2017). DOI: http://dx.doi.org/10.1145/3134666Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Julian Dibbell. 1998. My Tiny Life: Crime and Passion in a Virtual World. Julian Dibbell.Google ScholarGoogle Scholar
  4. Bryan Dosono and Bryan Semaan. 2019. Moderation Practices as Emotional Labor in Sustaining Online Communities: The Case of AAPI Identity Work on Reddit. In Proceedings of 2019 ACM Conference on Human Factors in Computing Systems (CHI'19). ACM, Glasgow, UK.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Casey Fiesler, Jialun "Aaron" Jiang, Joshua McCann, Kyle Frye, and Jed R. Brubaker. 2018. Reddit Rules! Characterizing an Ecosystem of Governance. In Twelfth International AAAI Conference on Web and Social Media. https://aaai.org/ocs/index.php/ ICWSM/ICWSM18/paper/view/17898Google ScholarGoogle Scholar
  6. Ysabel Gerrard. 2018. Beyond the hashtag: Circumventing content moderation on social media. New Media & Society 20, 12 (Dec. 2018), 4492--4511. DOI: http://dx.doi.org/10.1177/1461444818776611Google ScholarGoogle ScholarCross RefCross Ref
  7. Tarleton Gillespie. 2018. Custodians of the Internet: platforms, content moderation, and the hidden decisions that shape social media. Yale University Press, New Haven.Google ScholarGoogle Scholar
  8. James Grimmelmann. 2015. The Virtues of Moderation. Yale Journal of Law and Technology 17, 1 (Sept. 2015). https://digitalcommons.law.yale. edu/yjolt/vol17/iss1/2Google ScholarGoogle Scholar
  9. J. P. Guilford. 1954. Psychometric methods, 2nd ed. McGraw-Hill, New York, NY, US.Google ScholarGoogle Scholar
  10. Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator. ACM Trans. Comput.-Hum. Interact. 26, 5 (July 2019), Article 31. DOI: http://dx.doi.org/10.1145/3338243Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Jialun "Aaron" Jiang, Charles Kiene, Skyler Middler, Jed R. Brubaker, and Casey Fiesler. 2019. Moderation Challenges in Voice-based Online Communities on Discord. Proc. ACM Hum.-Comput. Interact. 3, CSCW (Nov. 2019), Article 55. DOI: http://dx.doi.org/10.1145/3359157Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Charles Kiene, Andrés Monroy-Hernández, and Benjamin Mako Hill. 2016. Surviving an "Eternal September": How an Online Community Managed a Surge of Newcomers. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1152--1156. DOI: http://dx.doi.org/10.1145/2858036.2858356Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Robert E. Kraut and Paul Resnick. 2011. Building Successful Online Communities: Evidence-Based Social Design. MIT Press, Boston, MA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Cliff Lampe and Paul Resnick. 2004. Slash(Dot) and Burn: Distributed Moderation in a Large Online Conversation Space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 543--550. DOI: http://dx.doi.org/10.1145/985692.985761Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping pro and anti-social behavior on twitch through moderation and example-setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 111--125. DOI: http://dx.doi.org/10.1145/2998181.2998277Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society (Jan. 2019), 1461444818821316. DOI: http://dx.doi.org/10.1177/1461444818821316Google ScholarGoogle ScholarCross RefCross Ref
  17. Andrew von Hirsch. 1992. Proportionality in the Philosophy of Punishment. Crime and Justice 16 (1992), 55--98. https://www.jstor.org/stable/1147561Google ScholarGoogle ScholarCross RefCross Ref
  18. Donghee Yvette Wohn. 2019. Volunteer Moderators in Twitch Micro Communities: How they Get Involved, the Roles they Play, and the Emotional Labor they Experience.. In Proceedings of 2019 ACM Conference on Human Factors in Computing Systems (CHI'19). ACM, New York, NY, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Identifying and Addressing Design and Policy Challenges in Online Content Moderation

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems
          April 2020
          4474 pages
          ISBN:9781450368193
          DOI:10.1145/3334480

          Copyright © 2020 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 25 April 2020

          Check for updates

          Qualifiers

          • abstract

          Acceptance Rates

          Overall Acceptance Rate6,164of23,696submissions,26%

          Upcoming Conference

          CHI '24
          CHI Conference on Human Factors in Computing Systems
          May 11 - 16, 2024
          Honolulu , HI , USA

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format