skip to main content
10.1145/3573051.3596196acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesl-at-sConference Proceedingsconference-collections
short-paper
Open Access

Examinator v3.0: Cheating Detection in Online Take-Home Exams

Published:20 July 2023Publication History

ABSTRACT

Examinator v3.0 detects cheating in online take-home exams by comparing answers and the timestamps they were entered. A web interface enables efficient manual inspection. Use of the tool reveals that certain question types substantially enhance cheating detection, demonstrating the potential of automated algorithmic detection at scale. Examinator v3.0 has analyzed 915,831 pairs of exam submissions across three courses over two semesters at a top U.S. institution, identifying 46 instances of cheating.

References

  1. Keith L Adkins and David A Joyner. 2022. Scaling anti-plagiarism efforts to meet the needs of large online computer science classes: Challenges, solutions, and recommendations. Journal of Computer Assisted Learning, Vol. 38, 6 (2022), 1603--1619.Google ScholarGoogle ScholarCross RefCross Ref
  2. Abdullah M Almutawa and Sai Sruthi. 2022. Students' perspective towards online proctoring in exams during COVID-19. Journal of Engineering Research, Vol. 10, 4A (2022).Google ScholarGoogle Scholar
  3. Raghav Apoorv, Akshay Dahiya, Uma Sreeram, Bharat Rahuldhev Patil, India Irish, Rocko Graziano, and Thad Starner. 2020. Examinator: A Plagiarism Detection Tool for Take-Home Exams. In Proceedings of the Seventh ACM Conference on Learning@ Scale. 261--264.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Lars Bengtsson. 2019. Take-home exams in higher education: A systematic review. Education Sciences, Vol. 9, 4 (2019), 267.Google ScholarGoogle ScholarCross RefCross Ref
  5. Canvas. n.d.. How do I create a quiz using New Quizzes? https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-create-a-quiz-using-New-Quizzes/ta-p/1173 Retrieved April 7, 2023 fromGoogle ScholarGoogle Scholar
  6. Martin Dick, Judy Sheard, Cathy Bareiss, Janet Carter, Donald Joyce, Trevor Harding, and Cary Laxer. 2002. Addressing student cheating: definitions and solutions. ACM SigCSE Bulletin, Vol. 35, 2 (2002), 172--184.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jiameng Du, Yifan Song, Mingxiao An, Marshall An, Christopher Bogart, and Majd Sakr. 2022. Cheating Detection in Online Assessments via Timeline Analysis. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1. 98--104.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. David Goldberg. 2021. Programming in a pandemic: Attaining academic integrity in online coding courses. Communications of the Association for Information Systems, Vol. 48, 1 (2021), 6.Google ScholarGoogle ScholarCross RefCross Ref
  9. David N Harpp and James J Hogan. 1993. Crime in the classroom: Detection and prevention of cheating on multiple-choice exams. Journal of Chemical Education, Vol. 70, 4 (1993), 306.Google ScholarGoogle ScholarCross RefCross Ref
  10. Phil Hill. 2023. State of higher ed LMS market for US and Canada: Year-end 2022 edition. Dostupno na: https://philonedtech.com/state-of-higher-ed-lms-market-for-us-and-canada-year-end-2022-edition/[Pristupljeno: 31.01.2023.] (2023).Google ScholarGoogle Scholar
  11. Chun-Hua Hsiao. 2015. Impact of ethical and affective variables on cheating: comparison of undergraduate students with and without jobs. Higher Education, Vol. 69, 1 (2015), 55--77.Google ScholarGoogle ScholarCross RefCross Ref
  12. Fakhroddin Noorbehbahani, Azadeh Mohammadi, and Mohammad Aminazadeh. 2022. A systematic review of research on cheating in online exams from 2010 to 2021. Education and Information Technologies, Vol. 27, 6 (2022), 8413--8460.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Jochen Ranger, Nico Schmidt, and Anett Wolgast. 2020. The detection of cheating on E-exams in higher education-the performance of several old and some new indicators. Frontiers in Psychology, Vol. 11 (2020), 568825.Google ScholarGoogle ScholarCross RefCross Ref
  14. Peter Salhofer. 2017. Analysing student behavior in CS courses: A case-study on detecting and preventing cheating. In 2017 IEEE Global Engineering Education Conference (EDUCON). IEEE, 1426--1431.Google ScholarGoogle ScholarCross RefCross Ref
  15. Talia Waltzer and Audun Dahl. 2022. Why do students cheat? Perceptions, evaluations, and motivations. Ethics & Behavior (2022), 1--21.Google ScholarGoogle Scholar
  16. Krist Wongsuphasawat and Ben Shneiderman. 2009. Finding comparable temporal categorical records: A similarity measure with an interactive visualization. In 2009 IEEE Symposium on Visual Analytics Science and Technology. 27--34. https://doi.org/10.1109/VAST.2009.5332595Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Examinator v3.0: Cheating Detection in Online Take-Home Exams

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          L@S '23: Proceedings of the Tenth ACM Conference on Learning @ Scale
          July 2023
          445 pages
          ISBN:9798400700255
          DOI:10.1145/3573051

          Copyright © 2023 Owner/Author

          This work is licensed under a Creative Commons Attribution International 4.0 License.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 20 July 2023

          Check for updates

          Qualifiers

          • short-paper

          Acceptance Rates

          Overall Acceptance Rate117of440submissions,27%
        • Article Metrics

          • Downloads (Last 12 months)374
          • Downloads (Last 6 weeks)77

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader