Corina Sas
Tomasz Fratczak
Kristina Höök
ABSTRACT
This paper describes the design and evaluation of AffectCam, a wearable system integrating SenseCam and BodyMedia SenseWear for capturing galvanic skin response as a measure of bodily arousal. AffectCam's algorithms use arousal as a filtering mechanism for selecting the most personally relevant photos captured during people's ordinary daily life, i.e. high arousal photos. We discuss initial findings showing that emotional arousal does improve the quality of memory recall associated with emotionally arousing events. In particular, the high arousal photos support richer recall of episodic memories than low arousal ones, i.e. over 50% improvement. We also consider how various phenomenological characteristics of autobiographical memories such as event, emotions, thoughts, place and time are differently cued by the AffectCam.
- . Anderson, A. K., Wais, P. E., & Gabrieli, J. D. Emotion enhances remembrance of neutral events past. Proc. NASUSA, 103(5), (2006), 1599--1604Google Scholar
Cross Ref
- Browne, G., Berry, E., Kapur, N., Hodges, S., Smyth, G., Watson, P., & Wood, K. SenseCam improves memory for recent events. Memory, 19, 7 (2011), 713--722.Google ScholarCross Ref
- Cahill L, McGaugh JL. A novel demonstration of enhanced memory associated with emotional arousal. Conscious Cogn 4 (1995), 410--421.Google ScholarCross Ref
- Consolvo, S., Everitt, K., Smith, I., and Landay, J.A. Design requirements for technologies that encourage physical activity. In Proc. CHI '06, ACM Press (2006), 457--466. Google ScholarDigital Library
- Consolvo,S.,McDonald,D.W.,Toscos,T.,Chen, M.Y.,Froehlich,J., Harrison,B.,Klasnja,P., LaMarca,A.,LeGrand, L.,Libby,R.,Smith,I., and Landay,J.A.Activity sensing in the wild:afield trialof ubifitgarden. InProc.CHI '08.ACMPress,(2008), 1797--1806. Google ScholarDigital Library
- Conway, M. A. Memory and the self. Journal of Memory and Language, 53 (2005), 594--628.Google ScholarCross Ref
- Conway, M.A., & Dewhurst, S.A. The self and recollective experience. Applied Cognitive Psychology, 9 (1995), 1--19.Google ScholarCross Ref
- Conway, M.A., Pleydell-Pearce, C.W. The construction of autobiographical memories in the self-memory system. Psychological Review 107, 2 (2000), 261--288.Google ScholarCross Ref
- Doherty, A. R., Pauly-Takacs, K., Caprani, N., Gurrin, C., Moulin, C. J., O'Connor, N. E., & Smeaton, A. F. Experiences of Aiding Autobiographical Memory Using the SenseCam. Human-Computer Interaction, 27,1--2 (2012), 151--174.Google ScholarCross Ref
- D'Argembeau, A., Comblain, C., Van der Linden, M. Phenomenal characteristics of autobiographical memories for positive, negative, and neutral events. Applied Cognitive Psychology, 17 (2003), 281--294.Google ScholarCross Ref
- Easterbrook, J. A. The effect of emotion on cue utilization and the organization of behaviour. Psychological Review 66, 3 (1959), 183--201.Google ScholarCross Ref
- Hamann, S. Cognitive and neural mechanisms of emotional memory. Trends in Cognitive Science, 5 (2001), 394--400.Google ScholarCross Ref
- Healey, J., & Picard, R. W. Startlecam: A cybernetic wearable camera. In Proc. Wearable Computers, (1998). 42--49. Google ScholarDigital Library
- Hodges, S., Berry, E., & Wood, K. SenseCam: A wearable camera that stimulates and rehabilitates autobiographical memory. Memory, 19,7(2011), 685--696.Google ScholarCross Ref
- Johnson, M. K., Foley, M. A., Suengas, A. G., and Raye, C. L. Characteristics of memories for perceived and imagined autobiographical events. Journal of Experimental Psychology: General 117 (1988), 371--376.Google ScholarCross Ref
- Kalnikaite, V., Sellen, A., Whittaker, S., & Kirk, D. Now let me see where I was: understanding how lifelogs mediate memory. In Proc. CHI 2010, ACM Press (2010), 2045--2054. Google ScholarDigital Library
- Laney, C., Heuer, F., & Reisberg, D. Thematically--induced arousal in naturally--occurring emotional memories. Applied Cognitive Psychology 17, 8 (2003), 995--1004.Google ScholarCross Ref
- Lee, M.L. and Dey, A.K. Providing good memory cues for people with episodic memory impairment. In Proc. SIGACCESS 2007, ACM Press (2007), 131--138. Google ScholarDigital Library
- Levine, B., Svoboda, E., Hay, J. F., Winocur, G., & Moscovitch, M. Aging and autobiographical memory. Psychology and aging 17, 4 (2002), 677--689.Google Scholar
- Linton, M. Ways of searching and the contents of memory. In Autobiographical Memory (pp. 25--49). Cambridge Univ. Press, Cambridge, UK, 1986.Google ScholarCross Ref
- Sanches, P., Höök, P., Vaara, E., Weymann, C., Bylund, M., Ferreira, P., Peira, N., and Sjölinder, M. Mind the body!: designing a mobile stress management application encouraging personal reflection. In Proc. DIS 2010. ACM Press, (2010), 47--56. Google ScholarDigital Library
- Schaefer, A., & Philippot, P. Selective effects of emotion on the phenomenal characteristics of autobiographical memories. Memory, 13, 2 (2005), 148--160.Google ScholarCross Ref
- Sellen, A., Fogg, A., Hodges, S. and Wood, K. Do lifelogging technologies support memory for the past? In Proc. CHI '07, ACM Press, (2007), 81--90. Google ScholarDigital Library
- Ståhl, A., Höök, K., Svensson, M, Taylor, A.S., and Combetto, M. Experiencing the Affective Diary. Personal Ubiquitous Comput. 13, 5 (2009), 365--378. Google ScholarDigital Library
- Talarico, J. M., LaBar, K. S., & Rubin, D. C. Emotional intensity predicts autobiographical memory experience. Memory & Cognition, 32,7(2004), 1118--1132.Google ScholarCross Ref
- Vetrugno, R., Liguori, R., Cortelli, P., & Montagna, P. Sympathetic skin response. Clinical autonomic research, 13, 4 (2003), 256--270.Google Scholar
Index Terms
- AffectCam: arousal- augmented sensecam for richer recall of episodic memories
Recommendations
Stress in interactive applications: analysis of the valence-arousal space based on physiological signals and self-reported data
Measuring users' emotional reaction to interactive multimedia and hypermedia is important. One particularly popular self-reported method for emotion assessment is the Valence-Arousal (VA) Scale: a 9ź ź9 affective grid. This paper aims to identify ...
How do emotions elicited in virtual reality affect our memory? A systematic review
AbstractEmotion has been shown to have a significant influence on memory. However, most of the investigations that led to this conclusion used non-virtual reality procedures. Virtual reality, as an emotional medium, is suitable for the study ...
Highlights- Studies investigating how emotions affect memory using VR range from basic (e.g., episodic memories) to applied research.
Emotional clouds: Showing arousal and valence through the movement and darkness of digital cartoonish clouds
While nowadays the most usual way to show emotions in digital contexts is via virtual characters, its use may raise false expectations (the user attributes human abilities to the virtual character). This paper proposes and explores an approach to ...
Comments