Abstract
Despite the growing quality of touch screen mobile devices, most of them still suffer from input latency. This paper presents a new way to cope with this problem for users who use an active stylus to perform pointing tasks. It is based on the usage of real-pen specific features of an active stylus that can be obtained without any additional wearables. To assess latency compensation that uses orientation, tilt, and pressure values, two studies are conducted. The first study shows that using these features decreases prediction error by 2.5%, improves the distribution of deviation angle from the target direction, and has a good ability to reduce lateness and wrong orientation side-effect metrics by 9.4% and 3.3%, respectively. The second study reveals that users perceive fewer visual side-effects with latency compensation using real-pen specific features of the active stylus. The obtained results prove the effectiveness of utilizing orientation, tilt, and pressure to cope with the latency compensation problem.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ng, A., et al.: In the blink of an eye: investigating latency perception during stylus interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1103–1112. ACM, New York (2014). https://doi.org/10.1145/2556288.2557037
New Survey Shows Professionals Prefer Pen and Paper Note Taking for Increased Productivity and Retention. Press release (2015). https://www.neolab.net/en/news/press-releases/new-survey-shows-professionals-prefer-pen-and-paper-note-taking-for-increased-productivity-and-retention. Accessed 21 Jan 2021
Jota, R., Ng, A., Dietz, P., Wigdor, D.: How fast is fast enough?: a study of the effects of latency in direct-touch pointing tasks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2291–2300. ACM, New York (2013). https://doi.org/10.1145/2470654.2481317
Annett, M., et al.: How low should we go?: under-standing the perception of latency while inking. In: Proceedings of Graphics Interface 2014, pp. 167–174. Canadian Information Processing Society, Toronto (2014)
Deber, J., Jota, R., Forlines, C., Wigdor, D.: How much faster is fast enough?: user perception of latency & latency improvements in direct and indirect touch. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 1827–1836. ACM, New York (2015). https://doi.org/10.1145/2702123.2702300
Ng, A., et al.: Designing for low-latency direct-touch input. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, pp. 453–464. ACM, New York (2012). https://doi.org/10.1145/2380116.2380174
Yun, M.H., He, S., Zhong, L.: POLYPATH: supporting multiple tradeoffs for interaction latency. arXiv preprint arXiv:1608.05654v1 (2016)
Yun, M.H., He, S., Zhong, L.: POLYPATH: reducing latency by eliminating synchrony. In: Proceedings of the 26th International Conference on World Wide Web, pp. 331–340. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva (2017). https://doi.org/10.1145/3038912.3052557
Miller, R.B.: Response time in man-computer conversational transactions. In: Proceedings of the December 9-11, 1968, Fall Joint Computer Conference, Part I, pp. 267–277. ACM, New York (1968). https://doi.org/10.1145/1476589.1476628
Cattan, E., Rochet-Capellan, A., Perrier, P., Bérard, F.: Reducing latency with a continuous prediction: effects on users’ performance in direct-touch target acquisitions. In: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, pp. 205–214. ACM, New York (2015). https://doi.org/10.1145/2817721.2817736
Cattan, E., Rochet-Capellan, A., Bérard, F.: A predictive approach for an end-to-end touch-latency measurement. In: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, pp. 215–2018. ACM, New York (2015). https://doi.org/10.1145/2817721.2817747
Nancel, M., et al.: Next-point prediction metrics for perceived spatial errors. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pp. 271–285. ACM, New York (2016). https://doi.org/10.1145/2984511.2984590
Nancel, M., et al.: Next-point prediction for direct touch using finite-time derivative estimation. In: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST ‘18), pp. 793–807. ACM, New York (2018). https://doi.org/10.1145/3242587.3242646
Henze, N., Funk, M., Shirazi, A.S.: Software-reduced touchscreen latency. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 434–441. ACM, New York (2016). https://doi.org/10.1145/2935334.2935381
Henze, N., Mayer, S., Le, H.V., Schwind, V.: Improving software-reduced touchscreen latency. In: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 1–8. ACM, New York (2017). Article no. 107. https://doi.org/10.1145/3098279.3122150
Le, H.V., Schwind, V., Göttlich, P., Henze, N.: PredicTouch: a system to reduce touchscreen latency using neural networks and inertial measurement units. In: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces, pp. 230–39. ACM, New York (2017). https://doi.org/10.1145/3132272.3134138
Kushnirenko, R., Alkhimova, S., Sydorenko, D., Tolmachov, I.: Active stylus input latency compensation on touch screen mobile devices. In: Stephanidis, C., Antona, M. (eds.) HCII 2020. CCIS, vol. 1224, pp. 245–253. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50726-8_32
Schomake, L.R.B., Réjean, P.: The relation between pen force and pen-point kinematics in handwriting. Biol. Cybern. 63(4), 277–289 (1990). https://doi.org/10.1007/BF00203451
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kushnirenko, R., Alkhimova, S., Sydorenko, D., Tolmachov, I. (2021). Using Real-Pen Specific Features of Active Stylus to Cope with Input Latency. In: Kurosu, M. (eds) Human-Computer Interaction. Interaction Techniques and Novel Applications. HCII 2021. Lecture Notes in Computer Science(), vol 12763. Springer, Cham. https://doi.org/10.1007/978-3-030-78465-2_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-78465-2_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78464-5
Online ISBN: 978-3-030-78465-2
eBook Packages: Computer ScienceComputer Science (R0)