Kimberly Williamson
René F. Kizilcec
ABSTRACT
Learning analytic dashboards (LADs) have become more prevalent in higher education to help students, faculty, and staff make data-informed decisions. Despite extensive research on the design and usability of LADs, few studies have examined them in relation to issues of diversity, equity, and inclusion. We conducted a critical literature review to address three research questions: How does LAD research contribute to improving diversity, equity, and inclusion? How might LADs contribute to maintaining or exacerbating inequitable outcomes? And what future opportunities exist in this research space? Our review showed little use of LADs to address or improve issues of diversity, equity, and inclusion in the literature thus far. We argue that excluding these issues from LAD research is not an isolated oversight and it risks reinforcing existing inequities within the higher education system. We argue that LADs can be designed, researched, and deployed intentionally to advance equitable outcomes and help dismantle inequities in education. We highlight opportunities for future LAD research to address issues of diversity, equity, and inclusion.
Supplemental Material
- Stephen J. Aguilar, Stuart A. Karabenick, Stephanie D. Teasley, and Clare Baek. 2021. Associations between learning analytics dashboard exposure and motivation and self-regulated learning. Computers & Education 162 (mar 2021), 104085. http://dx.doi.org/10.1016/j.compedu.2020.104085Google Scholar
- June Ahn, Fabio Campos, Maria Hays, and Daniela Digiacomo. 2019. Designing in Context: Reaching Beyond Usability in Learning Analytics Dashboard Design. Journal of Learning Analytics 6, 2 (jul 2019), 70--85. http://dx.doi.org/10.18608/jla.2019.62.5Google ScholarCross Ref
- Estela Mara Bensimon. 2004. The Diversity Scorecard: A Learning Approach to Institutional Change. Change: The Magazine of Higher Learning 36, 1 (jan 2004), 44--52. http://dx.doi.org/10.1080/00091380409605083Google ScholarCross Ref
- Blackboard. 2021a. About Us. (2021). https://www.blackboard.com/en-uk/about-usGoogle Scholar
- Blackboard. 2021b. Dashboard. (2021). https://help.blackboard.com/WebGoogle Scholar
- Blackboard. 2021c. Performance Dashboard. (2021). https://help.blackboard.com/Learn/Instructor/Performance/PerformanceGoogle Scholar
- Robert Bodily and Katrien Verbert. 2017. Review of Research on Student-Facing Learning Analytics Dashboards and Educational Recommender Systems. IEEE Transactions on Learning Technologies 10, 4 (oct 2017), 405--418. http://dx.doi.org/10.1109/TLT.2017.2740172Google ScholarDigital Library
- Michael Brown. 2020. Seeing students at scale: how faculty in large lecture courses act upon learning analytics dashboard data. Teaching in Higher Education 25, 4 (may 2020), 384--400. http://dx.doi.org/10.1080/13562517.2019.1698540Google ScholarCross Ref
- Simon Buckingham Shum. 2020. Should predictive models of student outcome be "colour-blind"? (jul 2020). https://simon.buckinghamshum.net/2020/07/should-predictive-models-of-student-outcome-be-colour-blind/Google Scholar
- Ed Foster and Rebecca Siddle. 2020. The effectiveness of learning analytics for identifying at-risk students in higher education. Assessment & Evaluation in Higher Education 45, 6 (aug 2020), 842--854. http://dx.doi.org/10.1080/02602938.2019.1682118Google ScholarCross Ref
- Julio Guerra, Margarita Ortiz-Rojas, Miguel Angel Zúniga-Prieto, Eliana Scheihing, Alberto Jiménez, Tom Broos, Tinne De Laet, and Katrien Verbert. 2020. Adaptation and evaluation of a learning analytics dashboard to improve academic support at three Latin American universities. British Journal of Educational Technology 51, 4 (jul 2020), 973--1001. http://dx.doi.org/10.1111/bjet.12950Google ScholarCross Ref
- Frank Harris and Estela Mara Bensimon. 2007. The equity scorecard: A collaborative approach to assess and respond to racial/ethnic disparities in student outcomes. New Directions for Student Services 2007, 120 (2007), 77--84. http://dx.doi.org/10.1002/ss.259Google ScholarCross Ref
- Isabel Hilliger, Tinne De Laet, Valeria Henríquez, Julio Guerra, Margarita Ortiz-Rojas, Miguel Ángel Zuniga, Jorge Baier, and Mar Pérez-Sanagustín. 2020. For Learners, with Learners: Identifying Indicators for an Academic Advising Dashboard for Students. In Addressing Global Challenges and Quality Education, Carlos Alario-Hoyos, María Jesús Rodríguez-Triana, Maren Scheffel, Inmaculada Arnedillo-Sánchez, and Sebastian Maximilian Dennerlein (Eds.). Springer International Publishing, Cham, 117--130.Google Scholar
- Instructure. 2021a. How do I use the Dashboard as a student? (2021). https://community.canvaslms.com/t5/Student-Guide/How-do-I-use-the-Dashboard-as-a-student/ta-p/512Google Scholar
- Instructure. 2021b. How do I use the Dashboard as an instructor? (2021). https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-use-the-Dashboard-as-an-instructor/ta-p/815Google Scholar
- Instructure. 2021c. Our Company Story. (2021). https://www.instructure.com/about/our-storyGoogle Scholar
- Joe L Kincheloe. 2005. Critical Constructivism Primer. Vol. 2. Peter Lang, Bern, Switzerland.Google Scholar
- Ben Levin. 2013. To know is not enough: research knowledge and its use. Review of Education 1, 1 (feb 2013), 2--31. http://dx.doi.org/10.1002/rev3.3001Google Scholar
- Meyliana, Henry A. E Widjaja, and Stephen W. Santoso. 2014. University dashboard: An implementation of executive dashboard to university. In 2014 2nd International Conference on Information and Communication Technology (ICoICT). IEEE, Bandung, Indonesia, 282--287. http://dx.doi.org/10.1109/ICoICT.2014.6914080Google Scholar
- Guy Paré , Marie-Claude Trudel, Mirou Jaana, and Spyros Kitsiou. 2015. Synthesizing information systems knowledge: A typology of literature reviews. Information & Management 52, 2 (mar 2015), 183--199. http://dx.doi.org/10.1016/j.im.2014.08.008Google Scholar
- Lori D. Patton, Berenice Sá nchez, Jacqueline Mac, and D-L Stewart. 2019. An Inconvenient Truth About "Progress": An Analysis of the Promises and Perils of Research on Campus Diversity Initiatives. The Review of Higher Education 42, 5 (2019), 173--198. http://dx.doi.org/10.1353/rhe.2019.0049Google ScholarCross Ref
- Paul Prinsloo, Sharon Slade, and Mohammad Khalil. 2018. Stuck in the middle? Making sense of the impact of micro, meso and macro institutional, structural and organisational factors on implementing learning analytics. In Proceedings of the European Distance and E-Learning Network Annual Conference. 17--20.Google Scholar
- Beat A. Schwendimann, Maria Jesus Rodriguez-Triana, Andrii Vozniuk, Luis P. Prieto, Mina Shirvani Boroujeni, Adrian Holzer, Denis Gillet, and Pierre Dillenbourg. 2017. Perceiving Learning at a Glance: A Systematic Literature Review of Learning Dashboard Research. IEEE Transactions on Learning Technologies 10, 1 (jan 2017), 30--41. http://dx.doi.org/10.1109/TLT.2016.2599522Google ScholarDigital Library
- SoLAR. 2020. From SoLAR Executive Committee: Statement of Support and Call for Action. (2020). https://www.solaresearch.org/2020/06/statement-of-support-and-call-for-action/Google Scholar
- USC Center for Urban Education. 2021. Equity Scorecard. (2021). https://cue.usc.edu/tools/the-equity-scorecard/Google Scholar
Index Terms
- Learning Analytics Dashboard Research Has Neglected Diversity, Equity and Inclusion
Recommendations
A Review of Learning Analytics Dashboard Research in Higher Education: Implications for Justice, Equity, Diversity, and Inclusion
LAK22: LAK22: 12th International Learning Analytics and Knowledge ConferenceLearning analytics dashboards (LADs) are becoming more prevalent in higher education to help students, faculty, and staff make data-informed decisions. Despite extensive research on the design and implementation of LADs, few studies have investigated ...
Diversity and Inclusion, a Perspective from a Four Years MSI Faculty Member
KDD '20: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data MiningThis presentation provides information on the path taken by a faculty member at a Minority Serving Institution (MSI). She presents the difficulties and opportunities that have been presented to her and, as a role model she has managed to improve the ...
ECS4Alabama: A State-Wide Effort to Provide Access to Authentic Computer Science Education in Predominantly Rural and High Minority Schools
SIGCSE '19: Proceedings of the 50th ACM Technical Symposium on Computer Science EducationThis poster provides a description of an NSF-sponsored project entitled "ECS4Alabama" that addresses one of the nation's areas of highest priority in K-12 education: To offer all children opportunities for preparation in authentic Computer Science, with ...
Comments