Andrea Aler Tubella
ABSTRACT
Fairness is central to the ethical and responsible development and use of AI systems, with a large number of frameworks and formal notions of algorithmic fairness being available. However, many of the fairness solutions proposed revolve around technical considerations and not the needs of and consequences for the most impacted communities. We therefore want to take the focus away from definitions and allow for the inclusion of societal and relational aspects to represent how the effects of AI systems impact and are experienced by individuals and social groups. In this paper, we do this by means of proposing the ACROCPoLis framework to represent allocation processes with a modeling emphasis on fairness aspects. The framework provides a shared vocabulary in which the factors relevant to fairness assessments for different situations and procedures are made explicit, as well as their interrelationships. This enables us to compare analogous situations, to highlight the differences in dissimilar situations, and to capture differing interpretations of the same situation by different stakeholders.
- Axel Abels, Tom Lenaerts, Vito Trianni, and Ann Nowé. 2021. Dealing with Expert Bias in Collective Decision-Making. arXiv preprint arXiv:2106.13539 (2021).Google Scholar
- Andrea Aler Tubella, Flavia Barsotti, Rüya Gökhan Koçer, and Julian Alfredo Mendez. 2022. Ethical implications of fairness interventions: what might be hidden behind engineering choices?Ethics and Information Technology 24, 12 (2022). https://doi.org/10.1007/s10676-022-09636-zGoogle ScholarDigital Library
- Jane Arthurs, Sophia Drakopoulou, and Alessandro Gandini. 2018. Researching youtube., 3–15 pages.Google Scholar
- Chelsea Barabas, Colin Doyle, JB Rubinovitz, and Karthik Dinakar. 2020. Studying up: Reorienting the Study of Algorithmic Fairness around Issues of Power. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* ’20). Association for Computing Machinery, New York, NY, USA, 167–176. https://doi.org/10.1145/3351095.3372859Google ScholarDigital Library
- Solon Barocas, Moritz Hardt, and Arvind Narayanan. 2019. Fairness and Machine Learning. fairmlbook.org. http://www.fairmlbook.orgGoogle Scholar
- Cynthia L. Bennett and Os Keyes. 2020. What is the Point of Fairness? Disability, AI and the Complexity of Justice. SIGACCESS Access. Comput. (mar 2020), 1 pages. https://doi.org/10.1145/3386296.3386301Google ScholarDigital Library
- Abeba Birhane. 2021. Algorithmic injustice: a relational ethics approach. Patterns 2, 2 (2021), 100205. https://doi.org/10.1016/j.patter.2021.100205Google ScholarCross Ref
- Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020. Language (Technology) is Power: A Critical Survey of “Bias” in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 5454–5476. https://doi.org/10.18653/v1/2020.acl-main.485Google ScholarCross Ref
- Christine Boshuijzen-van Burken, Niek Mouter, Shannon Spruit, and Lotte Fillerup. 2023. Value Sensitive Design Meets Participatory Value Evaluation for Autonomous Systems in Defence. Technical Report. EasyChair.Google Scholar
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Conference on Fairness, Accountability and Transparency, FAT 2018, 23-24 February 2018, New York, NY, USA(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, 77–91. http://proceedings.mlr.press/v81/buolamwini18a.htmlGoogle Scholar
- Raja Chatila, Kay Firth-Butterfield, and John C Havens. 2018. Ethically Aligned Design: A Vision for Prioritizing Human Well-being with Autonomous and Intelligent Systems Version 2. Technical Report. University of Southern California Los Angeles. https://apps.dtic.mil/sti/pdfs/AD1170922.pdfGoogle Scholar
- Marika Cifor, Patricia Garcia, T.L. Cowan, Jasmine Rault, Tonia Sutherland, Anita Say Chan, Jennifer Rode, Anna Lauren Hoffmann, Niloufar Salehi, and Lisa Nakamura. 2019. Feminist Data Manifest-No. https://www.manifestno.com/Google Scholar
- Sam Corbett-Davies and Sharad Goel. 2018. The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning. https://doi.org/10.48550/ARXIV.1808.00023Google Scholar
- Sam Corbett-Davies, Emma Pierson, Avi Feller, Sharad Goel, and Aziz Huq. 2017. Algorithmic Decision Making and the Cost of Fairness. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM. https://doi.org/10.1145/3097983.3098095Google ScholarDigital Library
- Kimberle Crenshaw. 1991. Mapping the Margins: Intersectionality, Identity Politics, and Violence against Women of Color. Stanford Law Review 43, 6 (1991), 1241–1299. https://doi.org/10.2307/1229039Google ScholarCross Ref
- Catherine D’Ignazio and Lauren F. Klein. 2020. Data Feminism (1 ed.). MIT Press.Google Scholar
- Virginia Dignum. 2021. The myth of complete ai-fairness. In International Conference on Artificial Intelligence in Medicine. Springer, 3–8.Google ScholarDigital Library
- Virginia Dignum. 2022. Relational Artificial Intelligence. arXiv preprint arXiv:2202.07446 (2022).Google Scholar
- Roel Dobbe, Thomas Krendl Gilbert, and Yonatan Mintz. 2021. Hard choices in artificial intelligence. Artificial Intelligence 300 (2021), 103555.Google ScholarDigital Library
- Mateusz Dolata, Stefan Feuerriegel, and Gerhard Schwabe. 2022. A sociotechnical view of algorithmic fairness. Information Systems Journal 32, 4 (2022), 754–818.Google ScholarCross Ref
- Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard S. Zemel. 2012. Fairness through awareness. In Innovations in Theoretical Computer Science 2012, Cambridge, MA, USA, January 8-10, 2012, Shafi Goldwasser (Ed.). ACM, 214–226. https://doi.org/10.1145/2090236.2090255Google ScholarDigital Library
- EUCommission. 2018. ETHICS GUIDELINES FOR TRUSTWORTHY AI. High-Level Expert Group on Artificial Intelligence (2018). Issue December. https://ec.europa.eu/digital-single-market/en/news/ethics-guidelines-trustworthy-ai https://ec.europa.eu/digital-single-market/en/high-level-expert-group-artificial-intelligenceGoogle Scholar
- Sina Fazelpour and Zachary C. Lipton. 2020. Algorithmic Fairness from a Non-ideal Perspective. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. ACM. https://doi.org/10.1145/3375627.3375828Google ScholarDigital Library
- Sina Fazelpour, Zachary C. Lipton, and David Danks. 2021. Algorithmic Fairness and the Situated Dynamics of Justice. Canadian Journal of Philosophy (oct 2021), 1–17. https://doi.org/10.1017/can.2021.24Google Scholar
- Elias Fernández Domingos, Inês Terrucha, Rémi Suchon, Jelena Grujić, Juan C Burguillo, Francisco C Santos, and Tom Lenaerts. 2022. Delegation to artificial agents fosters prosocial behaviors in the collective risk dilemma. Scientific Reports 12, 1 (2022), 1–12.Google Scholar
- Stefan Feuerriegel, Mateusz Dolata, and Gerhard Schwabe. 2020. Fair AI: Challenges and Opportunities. Business & Information Systems Engineering 62 (05 2020). https://doi.org/10.1007/s12599-020-00650-3Google ScholarCross Ref
- Sorelle A. Friedler, Carlos Scheidegger, and Suresh Venkatasubramanian. 2021. The (Im)possibility of fairness. Commun. ACM 64, 4 (apr 2021), 136–143. https://doi.org/10.1145/3433949Google ScholarDigital Library
- Seraphina Goldfarb-Tarrant, Rebecca Marchant, Ricardo Muñoz, Mu˜ Muñoz Sánchez, Mugdha Pandya, and Adam Lopez. 2021. Intrinsic Bias Metrics Do Not Correlate with Application Bias. In Proceedings ofthe 59th Annual Meeting ofthe Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Association for Computational Linguistics (ACL), 1926–1940. https://doi.org/10.18653/v1/2021.acl-long.150 arxiv:2012.15859Google Scholar
- Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of Opportunity in Supervised Learning. In Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, December 5-10, 2016, Barcelona, Spain, Daniel D. Lee, Masashi Sugiyama, Ulrike von Luxburg, Isabelle Guyon, and Roman Garnett (Eds.). 3315–3323. https://proceedings.neurips.cc/paper/2016/hash/9d2682367c3935defcb1f9e247a97c0d-Abstract.htmlGoogle ScholarDigital Library
- Brian Hedden. 2021. On statistical criteria of algorithmic fairness. Philosophy & Public Affairs 49, 2 (mar 2021), 209–231. https://doi.org/10.1111/papa.12189Google ScholarCross Ref
- Anna Lauren Hoffmann. 2021. Even When You Are a Solution You Are a Problem: An Uncomfortable Reflection on Feminist Data Ethics. Global Perspectives 2, 1 (03 2021). https://doi.org/10.1525/gp.2021.21335 arXiv:https://online.ucpress.edu/gp/article-pdf/2/1/21335/462728/globalperspectives_2021_2_1_21335.pdf21335.Google Scholar
- Gordon Hull. 2022. Dirty Data Labeled Dirt Cheap: Epistemic Injustice in Machine Learning Systems. SSRN Electronic Journal (2022). https://doi.org/10.2139/ssrn.4137697Google Scholar
- Matthew Joseph, Michael Kearns, Jamie Morgenstern, and Aaron Roth. 2016. Fairness in Learning: Classic and Contextual Bandits. https://doi.org/10.48550/ARXIV.1605.07139Google Scholar
- Michael Kearns, Aaron Roth, and Saeed Sharifi-Malvajerdi. 2019. Average individual fairness: algorithms, generalization and experiments.Google Scholar
- Baris Kirdemir, Joseph Kready, Esther Mead, Muhammad Nihal Hussain, and Nitin Agarwal. 2021. Examining Video Recommendation Bias on YouTube. In Advances in Bias and Fairness in Information Retrieval, Ludovico Boratto, Stefano Faralli, Mirko Marras, and Giovanni Stilo (Eds.). Springer International Publishing, Cham, 106–116. https://doi.org/10.1007/978-3-030-78818-6_10Google Scholar
- Svetlana Kiritchenko and Saif M Mohammad. 2018. Examining gender and race bias in two hundred sentiment analysis systems. arXiv preprint arXiv:1805.04508 (2018).Google Scholar
- Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2016. Inherent Trade-Offs in the Fair Determination of Risk Scores. https://doi.org/10.48550/ARXIV.1609.05807Google Scholar
- Susan Leavy. 2018. Gender bias in artificial intelligence: The need for diversity and gender theory in machine learning. In Proceedings - International Conference on Software Engineering. Association for Computing Machinery, New York, New York, USA, 14–16. https://doi.org/10.1145/3195570.3195580Google ScholarDigital Library
- Lydia T. Liu, Sarah Dean, Esther Rolf, Max Simchowitz, and Moritz Hardt. 2018. Delayed Impact of Fair Machine Learning. In Proceedings of the 35th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 80), Jennifer Dy and Andreas Krause (Eds.). PMLR, 3150–3158. https://proceedings.mlr.press/v80/liu18c.htmlGoogle Scholar
- Michael Lutz, Sanjana Gadaginmath, Natraj Vairavan, and Phil Mui. 2021. Examining Political Bias within YouTube Search and Recommendation Algorithms. In 2021 IEEE Symposium Series on Computational Intelligence (SSCI). 1–7. https://doi.org/10.1109/SSCI50451.2021.9660012Google Scholar
- Melissa McCradden, Shalmali Joshi, Mjaye Mazwi, and James A Anderson. 2020. When Your Only Tool Is A Hammer: Ethical Limitations of Algorithmic Fairness Solutions in Healthcare Machine Learning. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. Association for Computing Machinery, 109. https://doi.org/10.1145/3375627.3375824Google ScholarDigital Library
- Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2021. A Survey on Bias and Fairness in Machine Learning. ACM Comput. Surv. 54, 6, Article 115 (jul 2021), 35 pages. https://doi.org/10.1145/3457607Google ScholarDigital Library
- Milagros Miceli, Julian Posada, and Tianling Yang. 2022. Studying Up Machine Learning Data: Why Talk About Bias When We Mean Power?Proc. ACM Hum.-Comput. Interact. 6, GROUP, Article 34 (jan 2022), 14 pages. https://doi.org/10.1145/3492853Google ScholarDigital Library
- Thomas Miconi. 2017. The impossibility of "fairness": a generalized impossibility result for decisions. https://doi.org/10.48550/ARXIV.1707.01195Google Scholar
- Shira Mitchell, Eric Potash, Solon Barocas, Alexander D'Amour, and Kristian Lum. 2021. Algorithmic Fairness: Choices, Assumptions, and Definitions. Annual Review of Statistics and Its Application 8, 1 (mar 2021), 141–163. https://doi.org/10.1146/annurev-statistics-042720-125902Google ScholarCross Ref
- Hervé Moulin. 2019. Fair Division in the Internet Age. Annual Review of Economics 11, 1 (2019), 407–441. https://doi.org/10.1146/annurev-economics-080218-025559 arXiv:https://doi.org/10.1146/annurev-economics-080218-025559Google ScholarCross Ref
- Lawrence Page. 1998. Method for node ranking in a linked database. https://patents.google.com/patent/US6285999B1/enGoogle Scholar
- Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. 1999. The PageRank Citation Ranking: Bringing Order to the Web.Technical Report 1999-66. Stanford InfoLab. http://ilpubs.stanford.edu:8090/422/ Previous number = SIDL-WP-1999-0120.Google Scholar
- Nick Pearce. 2007. Rethinking fairness. Public Policy Research 14, 1 (2007), 11–22. https://doi.org/10.1111/j.1744-540X.2007.00458.x arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1744-540X.2007.00458.xGoogle ScholarCross Ref
- Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes. 2020. Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* ’20). Association for Computing Machinery, New York, NY, USA, 33–44. https://doi.org/10.1145/3351095.3372873Google ScholarDigital Library
- John Rawls. 2004. A theory of justice. In Ethics. Routledge, 229–234.Google Scholar
- Andrew D. Selbst, Danah Boyd, Sorelle A. Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2019. Fairness and Abstraction in Sociotechnical Systems. In Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM. https://doi.org/10.1145/3287560.3287598Google ScholarDigital Library
- Jonathan Stray, Alon Y. Halevy, Parisa Assar, Dylan Hadfield-Menell, Craig Boutilier, Amar Ashar, Lex Beattie, Michael D. Ekstrand, Claire Leibowicz, Connie Moon Sehat, Sara Johansen, Lianne Kerlin, David Vickrey, Spandana Singh, Sanne Vrijenhoek, Amy X. Zhang, McKane Andrus, Natali Helberger, Polina Proutskova, Tanushree Mitra, and Nina Vasan. 2022. Building Human Values into Recommender Systems: An Interdisciplinary Synthesis. CoRR abs/2207.10192 (2022). https://doi.org/10.48550/arXiv.2207.10192 arXiv:2207.10192Google Scholar
- Harry Surden. 2020. The ethics of artificial intelligence in law: Basic questions. Forthcoming chapter in Oxford Handbook of Ethics of AI (2020), 19–29.Google Scholar
- Sahil Verma and Julia Rubin. 2018. Fairness definitions explained. In Proceedings - International Conference on Software Engineering (New York, NY, USA). IEEE Computer Society, 1–7. https://doi.org/10.1145/3194770.3194776Google ScholarDigital Library
- Pak-Hang Wong. 2020. Democratizing Algorithmic Fairness. Philosophy & Technology 33, 2 (jun 2020), 225–244. https://doi.org/10.1007/s13347-019-00355-wGoogle ScholarCross Ref
- Jie Xu, Yunyu Xiao, Wendy Hui Wang, Yue Ning, Elizabeth A Shenkman, Jiang Bian, and Fei Wang. 2022. Algorithmic fairness in computational medicine. EBioMedicine 84 (2022), 104250.Google ScholarCross Ref
Index Terms
- ACROCPoLis: A Descriptive Framework for Making Sense of Fairness
Recommendations
Moral Philosophy of Artificial General Intelligence: Agency and Responsibility
Artificial General IntelligenceAbstractThe European Parliament recently proposed to grant the personhood of autonomous AI, which raises fundamental questions concerning the ethical nature of AI. Can they be moral agents? Can they be morally responsible for actions and their ...
Ethical implications of fairness interventions: what might be hidden behind engineering choices?
AbstractThe importance of fairness in machine learning models is widely acknowledged, and ongoing academic debate revolves around how to determine the appropriate fairness definition, and how to tackle the trade-off between fairness and model performance. ...
Understanding responsibility in Responsible AI. Dianoetic virtues and the hard problem of context
AbstractDuring the last decade there has been burgeoning research concerning the ways in which we should think of and apply the concept of responsibility for Artificial Intelligence. Despite this conceptual richness, there is still a lack of consensus ...
Comments