Predrag Klasnja
Jon Froehlich
Scott E. Hudson
ABSTRACT
Users' ability to accurately recall frequent, habitual activities is fundamental to a number of disciplines, from health sciences to machine learning. However, few, if any, studies exist that have assessed optimal sampling strategies for in situ self-reports. In addition, few technologies exist that facilitate benchmarking self-report accuracy for routine activities. We report on a study investigating the effect of sampling frequency of self-reports of two routine activities (sitting and walking) on recall accuracy and annoyance. We used a novel wearable sensor platform that runs a real time activity inference engine to collect in situ ground truth. Our results suggest that a sampling frequency of five to eight times per day may yield an optimal balance of recall and annoyance. Additionally, requesting self-reports at regular, predetermined times increases accuracy while minimizing perceived annoyance since it allows participants to anticipate these requests. We discuss our results and their implications for future studies.
- Adams, S. A., Matthews, C. E., Ebbeling, C. B., Moore, C. G., Cunningham, J. E., Fulton, J. and Herbert, J. R. The effect of social desirability and social approval on self-reports of physical activity. American Journal of Epidemiology, 161, 4, (2005), 389--398.Google Scholar
Cross Ref
- Ainsworth, B. E., Sternfeld, B., Slattery, M. L., Dagulsé, V. and Zahrn, S. H. Physical activity and breast cancer: Evaluation of physical activity assessment methods. Cancer, 83, 3S, (1998), 611--620.Google ScholarCross Ref
- Alevizos, A., Lentzas, J., Kokkoris, S., Mariolis, A. and Korantzopoulos, P. Physical activity and stroke risk. International Journal of Clinical Practice, 59, 8, (2005), 922--930.Google ScholarCross Ref
- American College of Sports Medicine American College of Sports Medicine position stand: Osteoporosis and exercise. Medicine & Science in Sports & Exercise, 27, 4, (1995), i--vii.Google Scholar
- Bishop, C. M. Pattern recognition and machine learning. Springer, New York, 2006. Google ScholarDigital Library
- Blair, S. N. and Connelly, J. C. How much physical activity should we do? The case for moderate amounts and intensities of physical activity. Research Quarterly for Exercise and Sport, 67, 2, (1996), 193--205.Google ScholarCross Ref
- Consolvo, S. and Walker, M. Using the Experience Sampling Method to Evaluate Ubicomp Applications. IEEE Pervasive Computing Magazine: The Human Experience, 2, 2, (2003), 24--31 Google ScholarDigital Library
- Csikszentmihalyi, M. and Larson, R. Validity and reliability of the Experience-Sampling Method. Journal of Nervous and Mental Disease, 175, 9, (1987), 526--536.Google ScholarCross Ref
- Durante, R. and Ainsworth, B. E. The recall of physical activity: Using a cognitive model of the question-answering process. Medicine & Science in Sports & Exercise, 28, 10, (1996), 1282--1291.Google Scholar
- Froehlich, J., Chen, M. Y., Consolvo, S., Harrison, B., & Landay, J. A. MyExperience: A system for in situ tracing and capturing of user feedback on mobile phones. In Proc MobiSys '07, (2007), 57--70. Google ScholarDigital Library
- Hakim, A. A., Curb, J. D., Petrovitch, H., Rodriguez, B. L., Yano, K., Ross, G. W., White, L. R. and Abbott, R. D. Effects of walking on coronary heart disease in elderly men: The Honolulu Heart Program. Circulation, 100, 1, (1999), 9--13.Google Scholar
- Hektner, J. M. and Csikszentmihalyi, M. The experience sampling method: Measuring the context and content of lives. In Bechtel, R. B. and Churchman, A. eds. Handbook of environmental psychology, John Wiley & Sons, Inc., New York, 2002, 233--243.Google Scholar
- Helmrich, S. P., Ragland, D. R., W., L. R. and Paffenbarger, R. S., Jr. Physical activity and reduced occurrence of non-insulin-dependent diabetes mellitus. New England Journal of Medicine, 325, 3, (1991), 147--152.Google ScholarCross Ref
- Intille, S. S., Rondoni, J., Kukla, C., Ancona, I., and Bao, L. Context-aware experience sampling tool. In Proc CHI 2003, (2003), 972--3. Google ScholarDigital Library
- Lee, I.-M. and Skerrett, P. J. Physical activity and all-cuase mortality: What is the dose-response relationship? Medicine & Science in Sports & Exercise, 33, 6, Suppl., (2001), S549--471.Google Scholar
- Lester, J. Choudhury, T., & Borriello, G. A practical approach to recognizing physical activities. Proc Pervasive '06, (2006), 1--16 Google ScholarDigital Library
- Livingstone, M. B. E., Robson, P. J., Wallace, J. M. W. and McKinley, M. C. How active are we? Levels of physical activity in children and adults. Proceedings of the Nutrition Society, 62, (2003), 681--701.Google ScholarCross Ref
- Paffenbarger, R. S., Jr., Wing, A. L., Hyde, R. T. and Jung, D. L. Physical activity and incidence of hypertension in college alumni. American Journal of Epidemiology, 117, 3, (1983), 245--257.Google ScholarCross Ref
- Sallis, J. F. and Saelens, B. E. Assessment of physical activity by self-report: Status, limitations, and future directions. Research Quarterly for Exercise and Sport, 71, 2, (2000), 1--14.Google ScholarCross Ref
- Salmon, P. Effects of physical exercise on anxiety, depression, and sensitivity to stress: A unifying theory. Clinical Psychology Review, 21, 1, (2000), 33--61.Google Scholar
- Shephard, R. J. Limits to the measurement of habitual physical activity by questionnaires. British Journal of Sports Medicine, 37, (2003), 197--206.Google ScholarCross Ref
- U. S. Department of Health and Human Services Physical activity and health: A report of the Surgeon General. U. S. Department of Health and Human Services, Atlanta, 1996.Google Scholar
- Wheeler, L. and Reis, H. T. Self-recording of everyday life events: Origins, types, and uses. Journal of Personality, 59, 3, (1991), 339--354.Google ScholarCross Ref
Recommendations
The Experience Sampling Method on Mobile Devices
The Experience Sampling Method (ESM) is used by scientists from various disciplines to gather insights into the intra-psychic elements of human life. Researchers have used the ESM in a wide variety of studies, with the method seeing increased ...
Wearable ESM: differences in the experience sampling method across wearable devices
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and ServicesThe Experience Sampling Method is widely used for collecting self-report responses from people in natural settings. While most traditional approaches rely on using a phone to trigger prompts and record information, wearable devices now offer new ...
Gamification of Mobile Experience Sampling Improves Data Quality and Quantity
The Experience Sampling Method is used to capture high-quality in situ data from study participants. This method has become popular in studies involving smartphones, where it is often adapted to motivate participation through the use of gamification ...
Comments