skip to main content
10.1145/3544549.3583960acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
demonstration

Computational Assistance for User Interface Design: Smarter Generation and Evaluation of Design Ideas

Published:19 April 2023Publication History

ABSTRACT

This paper describes a lab demo by the User Interfaces group at Aalto University. The demo allows attendees to interactively experience recent research prototypes aiming to facilitate designers’ creative and problem-solving capabilities in user interface (UI) design. Empirical work on designers suggests that UI design is challenging, partially because of the presence of very large design spaces, multiple and ill-defined objectives, design fixation and biases, as well as multiple requirements that need to to kept in mind. At the exhibition, members of the lab provide live demonstrations of six computational features, with a special focus on plug-ins created for Figma, a popular UI design tool. The demos draw from the group’s latest research published at HCI conferences. They demonstrate how to interactively exploit machine learning methods ranging from deep nets to Bayesian inference and NLP. We also present our design approach and provide a summary of findings from empirical evaluations with designers.

Footnotes

Skip Supplemental Material Section

Supplemental Material

3544549.3583960-walkthrough.mp4

mp4

6.8 MB

3544549.3583960-preview.mp4

mp4

2.8 MB

References

  1. Liwei Chan, Yi-Chi Liao, George B Mo, John J Dudley, Chun-Lien Cheng, Per Ola Kristensson, and Antti Oulasvirta. 2022. Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction Techniques. In CHI Conference on Human Factors in Computing Systems. 1–14.Google ScholarGoogle Scholar
  2. Sebastiaan De Peuter, Antti Oulasvirta, and Samuel Kaski. 2021. Toward AI Assistants That Let Designers Design. arXiv preprint arXiv:2107.13074(2021).Google ScholarGoogle Scholar
  3. Lena Hegemann, Niraj Ramesh Dayama, Abhishek Iyer, Erfan Farhadi, Ekaterina Marchenko, and Antti Oulasvirta. 2023. CoColor: Interactive Exploration of Color Designs. In 28th International Conference on Intelligent User Interfaces (Sydney, Australia).Google ScholarGoogle Scholar
  4. Yue Jiang, Luis A. Leiva, Hamed Rezazadegan Tavakoli, Paul R. B. Houssel, Julia Kylmälä, and Antti Oulasvirta. 2023. UEyes: Understanding Visual Saliency across User Interface Types. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Yue Jiang, Wolfgang Stuerzlinger, Matthias Zwicker, and Christof Lutteroth. 2020. ORCSolver: An Efficient Solver for Adaptive GUI Layout with OR-Constraints. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376610Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Antti Oulasvirta, Samuli De Pascale, Janin Koch, Thomas Langerak, Jussi Jokinen, Kashyap Todi, Markku Laine, Manoj Kristhombuge, Yuxi Zhu, Aliaksei Miniukovich, 2018. Aalto Interface Metrics (AIM) A Service and Codebase for Computational GUI Evaluation. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings. 16–19.Google ScholarGoogle Scholar
  7. Joongi Shin, Michael A Hedderich, AndréS Lucero, and Antti Oulasvirta. 2022. Chatbots Facilitating Consensus-Building in Asynchronous Co-Design. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Kashyap Todi, Gilles Bailly, Luis Leiva, and Antti Oulasvirta. 2021. Adapting user interfaces with model-based reinforcement learning. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Computational Assistance for User Interface Design: Smarter Generation and Evaluation of Design Ideas

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
      April 2023
      3914 pages
      ISBN:9781450394222
      DOI:10.1145/3544549

      Copyright © 2023 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 April 2023

      Check for updates

      Qualifiers

      • demonstration
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate6,164of23,696submissions,26%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA
    • Article Metrics

      • Downloads (Last 12 months)476
      • Downloads (Last 6 weeks)44

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    View Full Text

    HTML Format

    View this article in HTML Format .

    View HTML Format