skip to main content
opinion
Free Access

Data Bias Management

Published:21 December 2023Publication History
Skip Abstract Section

Abstract

Envisioning a unique approach toward bias and fairness research.

References

  1. Amigó, E. et al. A unifying and general account of fairness measurement in recommender systems. Information Processing and Management 60, 1 (2023), 103--115. Google ScholarGoogle Scholar
  2. Baeza-Yates, R. Bias on the Web. Commun. ACM 61, 6 (June 2018), 54--61.Google ScholarGoogle Scholar
  3. Bolukbasi, T. et al. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. Advances in Neural Information Processing Systems 29 (2016).Google ScholarGoogle Scholar
  4. Fan, S. et al. Socio-economic diversity in human annotations. In Proceedings of the 4th ACM Web Science Conf. 2022. (2022); 98--109.Google ScholarGoogle Scholar
  5. Fong, H. et al. Fairness for auc via feature augmentation. arXiv preprint arXiv:2111.12823 (2021).Google ScholarGoogle Scholar
  6. Franklin, M.J. et al. CrowdDB: answering queries with crowdsourcing. In Proceedings of the 2011 ACM SIGMOD Intern. Conf. on Management of Data. (2011), 61--72.Google ScholarGoogle Scholar
  7. Han, L. et al. Modelling user behavior dynamics with embeddings. In Proceedings of the 29th ACM Intern. Conf. on Information & Knowledge Management. (2020), 445--454.Google ScholarGoogle Scholar
  8. Han, L. et al. On understanding data worker interaction behaviors. In Proceedings of the 43rd Intern. ACM SIGIR Conf. on Research and Development in Information Retrieval. (2020), 269--278.Google ScholarGoogle Scholar
  9. Han, L., Dong, X., and Demartini, G. Iterative human-in-the-loop discovery of unknown unknowns in image datasets. In Proceedings of the AAAI Conf. on Human Computation and Crowdsourcing 9, (2021), 72--83.Google ScholarGoogle Scholar
  10. Johansen, J., Pedersen, T. and Johansen, C. Studying the transfer of biases from programmers to programs. arXiv preprint arXiv:2005.08231 (2020).Google ScholarGoogle Scholar
  11. La Barbera, D. et al. Crowdsourcing truthfulness: The impact of judgment scale and assessor bias. In European Conf. on Information Retrieval. Springer, (2020), 207--214.Google ScholarGoogle Scholar
  12. Luggen, M. et al. Non-parametric class completeness estimators for collaborative knowledge graphs---The case of wikidata. In Intern. Semantic Web Conf. Springer, (2019), 453--469.Google ScholarGoogle Scholar
  13. Lum, K., Zhang, Y., and Bower, A. De-biasing "bias" measurement. In 2022 ACM Conf. on Fairness, Accountability, and Transparency. (2022), 379--389.Google ScholarGoogle Scholar
  14. Nickerson, R.S. Confirmation bias: A ubiquitous phenomenon in many guises. Rev. of General Psychology 2, 2 (1998), 175--220.Google ScholarGoogle Scholar
  15. Otterbacher, J., Bates, J., and Clough, P. Competent men and warm women: Gender stereotypes and backlash in image search results. In Proceedings of the 2017 CHI Conf. on Human Factors in Computing Systems. (2017), 6620--6631.Google ScholarGoogle Scholar
  16. Otterbacher, J. et al. Investigating user perception of gender bias in image search: the role of sexism. In Proceedings of the 41st Intern. ACM SIGIR Conf. on Research and Development in Information Retrieval. (2018), 933--936.Google ScholarGoogle Scholar
  17. Pastaltzidis, I. et al. Data augmentation for fairness-aware machine learning: Preventing algorithmic bias in law enforcement systems. In 2022 ACM Conference on Fairness, Accountability, and Transparency. (2022), 2302--2314.Google ScholarGoogle Scholar
  18. Perikleous, P. et al. How does the crowd impact the model? A tool for raising awareness of social bias in crowdsourced training data. In Proceedings of the 31st ACM Intern. Conf. on Information & Knowledge Management. (2022), 4951--4954.Google ScholarGoogle Scholar
  19. Reinecke, K. and Bernstein, A. Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Transactions on Computer-Human Interaction (TOCHI) 18, 2 (2011), 1--29.Google ScholarGoogle Scholar
  20. Sadiq, S. et al. Information Resilience: The nexus of responsible and agile approaches to information use. The VLDB J. (2022), 1--26.Google ScholarGoogle Scholar
  21. Sarasua, C. et al. The evolution of power and standard Wikidata editors: Comparing editing behavior over time to predict lifespan and volume of edits. Computer Supported Cooperative Work (CSCW) 28, 5 (2019), 843--882.Google ScholarGoogle Scholar
  22. Schick, T., Udupa, S., and Schütze, H. Self-diagnosis and self-debiasing: A proposal for reducing corpus-based bias in NLP. Transactions of the Association for Computational Linguistics 9 (2021), 1408--1424.Google ScholarGoogle Scholar
  23. Silberzahn, R. et al. Many analysts, one data set: Making transparent how variations in analytic choices affect results. Advances in Methods and Practices in Psychological Science 1, 3 (2018), 337--356.Google ScholarGoogle Scholar
  24. Sutton, A. Biased embeddings from wild data: Measuring, understanding and removing. In Intern. Symp. on Intelligent Data Analysis. Springer (2018), 328--339.Google ScholarGoogle Scholar

Index Terms

  1. Data Bias Management

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Communications of the ACM
          Communications of the ACM  Volume 67, Issue 1
          January 2024
          122 pages
          ISSN:0001-0782
          EISSN:1557-7317
          DOI:10.1145/3638509
          • Editor:
          • James Larus
          Issue’s Table of Contents

          Copyright © 2023 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 21 December 2023

          Check for updates

          Qualifiers

          • opinion
        • Article Metrics

          • Downloads (Last 12 months)7,322
          • Downloads (Last 6 weeks)198

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format