Daun Kim
ABSTRACT
We propose EmoFlow, a prototype service that can recognize the emotional changes of users in video chat and provide a text-based summary along with various visualizations. We present design concepts to represent users’ emotional flow on the mobile messenger application in three types: Emoji, Color, and Shape visualizations. Through a user study with 60 voluntary participants, we found that the Emoji type received the highest score in terms of conveying emotions and design preferences. Also, 65 percent of the participants responded they are willing to use the proposed service if several points are enhanced in the future. The survey results suggest that the proposed service would help users understand and manage their emotional status.
- Toshiki Aoki, Rintaro Chujo, Katsufumi Matsui, Saemi Choi, and Ari Hautasaari. 2022. EmoBalloon - Conveying Emotional Arousal in Text Chats with Speech Balloons. In CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3491102.3501920Google Scholar
Digital Library
- Genavee Brown and Patricia M. Greenfield. 2021. Staying connected during stay-at-home: Communication with family and friends and its association with well-being. Human Behavior and Emerging Technologies 3, 1 (Jan. 2021), 147–156. https://doi.org/10.1002/hbe2.246Google ScholarCross Ref
- Qinyue Chen, Yuchun Yan, and Hyeon-Jeong Suk. 2021. Bubble Coloring to Visualize the Speech Emotion. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3411763.3451698Google ScholarDigital Library
- Roger Yat-Nork Chung and Minnie Ming Li. 2020. Anti-Chinese sentiment during the 2019-nCoV outbreak. The Lancet 395, 10225 (Feb. 2020), 686–687. https://doi.org/10.1016/s0140-6736(20)30358-5Google Scholar
- Eylül Ertay, Hao Huang, Zhanna Sarsenbayeva, and Tilman Dingler. 2021. Challenges of Emotion Detection Using Facial Expressions and Emotion Visualisation in Remote Communication. In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers. ACM. https://doi.org/10.1145/3460418.3479341Google ScholarDigital Library
- Helen Gilburt, Diana Rose, and Mike Slade. 2008. The importance of relationships in mental health care: A qualitative study of service users' experiences of psychiatric hospital admission in the UK. BMC Health Services Research 8, 1 (April 2008). https://doi.org/10.1186/1472-6963-8-92Google ScholarCross Ref
- Jiaxiong Hu, Qianyao Xu, Limin Paul Fu, and Yingqing Xu. 2019. Emojilization. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3290607.3313071Google ScholarDigital Library
- Mike Krieger Kevin Systrom. 2023. Instagram. Retrieved Accessed 18-Jan-2023 from https://www.instagram.comGoogle Scholar
- Stephen J. Lepore, Jennifer D. Ragan, and Scott Jones. 2000. Talking facilitates cognitive–emotional processes of adaptation to an acute stressor.Journal of Personality and Social Psychology 78, 3 (2000), 499–508. https://doi.org/10.1037/0022-3514.78.3.499Google Scholar
- Danielle Lottridge. 2020. Insights from videochat research in the context of Covid-19. Interactions 27, 4 (July 2020), 9–10. https://doi.org/10.1145/3406104Google ScholarDigital Library
- Gaëtan Mertens, Lotte Gerritsen, Stefanie Duijndam, Elske Salemink, and Iris M. Engelhard. 2020. Fear of the coronavirus (COVID-19): Predictors in an online study conducted in March 2020. Journal of Anxiety Disorders 74 (Aug. 2020), 102258. https://doi.org/10.1016/j.janxdis.2020.102258Google ScholarCross Ref
- NAVER CLOUD PLATFORM. 2023. CLOVA Face Recognition(CFR). Retrieved Accessed 18-Jan-2023 from https://api.ncloud-docs.com/docs/ai-naver-clovafacerecognition-faceGoogle Scholar
- NAVER CLOUD PLATFORM. 2023. CLOVA Speech Recognition(CSR). Retrieved Accessed 18-Jan-2023 from https://api-fin.ncloud-docs.com/docs/ai-naver-clovaspeechrecognition-sttGoogle Scholar
- Jordi Quoidbach, Elizabeth V. Berry, Michel Hansenne, and Moïra Mikolajczak. 2010. Positive emotion regulation and well-being: Comparing the impact of eight savoring and dampening strategies. Personality and Individual Differences 49, 5 (Oct. 2010), 368–373. https://doi.org/10.1016/j.paid.2010.03.048Google ScholarCross Ref
- Ellen Roche, Joscelin Rocha-Hidalgo, Douglas Piper, Gabrielle A. Strouse, Lucinda I. Neely, Jenna Ryu, Lauren J. Myers, Elisabeth McClure, Georgene L. Troseth, Jennifer M. Zosh, and Rachel Barr. 2022. Presence at a distance: Video chat supports intergenerational sensitivity and positive infant affect during COVID-19. Infancy 27, 6 (Aug. 2022), 1008–1031. https://doi.org/10.1111/infa.12491Google ScholarCross Ref
- Camilo Rojas, Eugenio Zuccarelli, Alexandra Chin, Gaurav Patekar, David Esquivel, and Pattie Maes. 2022. Towards Enhancing Empathy Through Emotion Augmented Remote Communication. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. ACM. https://doi.org/10.1145/3491101.3519797Google ScholarDigital Library
- Alessandro Rovetta and Akshaya Srikanth Bhagavathula. 2020. COVID-19-Related Web Search Behaviors and Infodemic Attitudes in Italy: Infodemiological Study. JMIR Public Health and Surveillance 6, 2 (May 2020), e19374. https://doi.org/10.2196/19374Google ScholarCross Ref
- Matthew T. Tull, Keith A. Edmonds, Kayla M. Scamaldo, Julia R. Richmond, Jason P. Rose, and Kim L. Gratz. 2020. Psychological Outcomes Associated with Stay-at-Home Orders and the Perceived Impact of COVID-19 on Daily Life. Psychiatry Research 289 (July 2020), 113098. https://doi.org/10.1016/j.psychres.2020.113098Google Scholar
- Keiko Yamaguchi, Masaya Ito, and Yoshitake Takebayashi. 2018. Positive emotion in distress as a potentially effective emotion regulation strategy for depression: A preliminary investigation. Psychology and Psychotherapy: Theory, Research and Practice 91, 4 (March 2018), 509–525. https://doi.org/10.1111/papt.12176Google ScholarCross Ref
- Zihan Yan, Yufei Wu, Yang Zhang, and Xiang ’Anthony’ Chen. 2022. EmoGlass: An End-to-End AI-Enabled Wearable Platform for Enhancing Self-Awareness of Emotional Health. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 13, 19 pages. https://doi.org/10.1145/3491102.3501925Google ScholarDigital Library
Index Terms
- EmoFlow: Visualizing Emotional Changes in Video Chat - Preliminary Study
Recommendations
EMOTE: An interactive online tool for designing real-time emotional AR visualizations
AH2022: 13th Augmented Human International ConferenceIn a future when augmented vision becomes a part of our daily lives, some might want or need to highlight their emotions by visuals on or around their bodies like wearing a prosthesis or an expressive make-up. This might especially be useful for ...
Visualizing excitement of individuals and groups
EmoVis'16: Proceedings of the 2016 EmoVis Conference on Emotion and VisualizationExcitement or arousal is one of the main emotional dimensions that affects our lives on a daily basis. We win a tennis match, watch a great movie, get into an argument with a colleague—all of these are instances when most of us experience excitement, ...
Interpolating Happiness: Understanding the Intensity Gradations of Face Emojis Across Cultures
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsWe frequently utilize face emojis to express emotions in digital communication. But how wholly and precisely do such pictographs sample the emotional spectrum, and are there gaps to be closed? Our research establishes emoji intensity scales for seven ...
Comments