Skip to main content

State Trajectory

A Unifying Approach to Interactivity with Real-Time Sharing and Playback Support

  • Conference paper
  • First Online:
Proceedings of the Future Technologies Conference (FTC) 2023, Volume 2 (FTC 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 814))

Included in the following conference series:

  • 140 Accesses

Abstract

Interactive applications are powerful tools for data exploration, visualization and collaboration. Applications featuring viewports are particularly expressive, offering controls for altering perspective by scrolling, panning, zooming or tilting a view. Still, interactivity is inherently live and manual, and often limited to a single interface. We propose to model interactivity as a data source. This way, interactivity may be transmitted from one interface to another, or broadcasted to a distributed audience. Interactivity could also be created or edited by AI-based algorithms, recorded from manual input, stored and made available for on demand playback, or shared in real-time in a multi-view setup or among collaborators in a group. To facilitate such opportunities, we propose State Trajectory, a unifying concept for local and online interactivity. State trajectories extend regular program variables with a temporal dimension and provide built-in support for persistence, real-time sharing, time-consistent recording and playback, and gradual transitions. A concept implementation demonstrates that state trajectories encapsulate significant complexity, yet with a low performance overhead. Using trajectories, support for real-time collaboration and time-shifted replays could be added to a 3’rd party map framework, with minimal modifications to the existing code base.

This research is funded in part by the Research Council of Norway, grant number 323302 (STIPINST) and grant number 309339 (MediaFutures).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abramov, D.: Live react: Hot reloading with time travel (2015). https://www.youtube.com/watch?v=xsSnOQynTHs

  2. Abramov, D.: Redux. A predictable state container for JS apps (2015). https://redux.js.org

  3. Arntzen, I.M.: Timingsrc. Multi-device timing for Web (2015). https://webtiming.github.io/timingsrc

  4. Arntzen, I.M., Borch, N.T.: Data-independent sequencing with the timing object: a JavaScript sequencer for single-device and multi-device Web media. In: Proceedings of the 7th International Conference on Multimedia Systems, pp. 1–10 (2016)

    Google Scholar 

  5. Arntzen, I.M., Borch, N.T., Daoust, F.: Media synchronization on the web. In: Montagud, M., Cesar, P., Boronat, F., Jansen, J. (eds.) MediaSync, pp. 475–504. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-65840-7_17

    Chapter  Google Scholar 

  6. Arntzen, I.M., Borch, N.T., Needham, C.P.: The media state vector: a unifying concept for multi-device media navigation. In: Proceedings of the 5th Workshop on Mobile Video, pp. 61–66 (2013)

    Google Scholar 

  7. Arntzen, I.M., Daoust, F., Borch, N.T.: Timing object; draft community group report (2015). http://webtiming.github.io/timingobject

  8. Unreal engine (1998). https://www.unrealengine.com

  9. React. A JavaScript library for building user interfaces (2013). https://reactjs.org

  10. Google analytics (2005). https://analytics.google.com

  11. Angular. The modern Web developer’s platform (2016). https://angular.io

  12. Hotjar. Website heatmaps & behavior analytics tools (2014). https://www.hotjar.com

  13. IETF. The Web socket protocol (2011). https://www.rfc-editor.org/rfc/rfc6455

  14. Leiva, L.A., Huang, J.: Building a better mousetrap: compressing mouse cursor activity for Web analytics. Inf. Process. Manag. 51(2), 114–129 (2015)

    Article  Google Scholar 

  15. Lowet, D., Goergen, D.: Co-browsing dynamic Web pages. In: Proceedings of the 18th International Conference on World Wide Web, pp. 941–950 (2009)

    Google Scholar 

  16. Lucky orange (2010). https://www.luckyorange.com

  17. Miro online collaborative whiteboard platform (2011). https://miro.com

  18. Motion Corporation (2013). http://motioncorporation.com

  19. Mouseflow. Behavior analytics for optimal Website UX (2009). https://mouseflow.com

  20. Node.js is an open-source, cross-platform JavaScript runtime environment (2015). https://nodejs.org

  21. Openlayers. A high-performance, feature-packed library for all your mapping needs (2006). https://openlayers.org

  22. Seifried, T., Rendl, C., Haller, M., Scott, S.: Regional undo/redo techniques for large interactive surfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2855–2864 (2012)

    Google Scholar 

  23. Smartlook (2016). https://www.smartlook.com

  24. Unity real-time development platform (2005). https://unity.com

  25. Michel Weststrate. MobX state management framework (2015). https://mobx.js.org

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ingar M. Arntzen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Arntzen, I.M., Borch, N.T., Andersen, A. (2023). State Trajectory. In: Arai, K. (eds) Proceedings of the Future Technologies Conference (FTC) 2023, Volume 2. FTC 2023. Lecture Notes in Networks and Systems, vol 814. Springer, Cham. https://doi.org/10.1007/978-3-031-47451-4_1

Download citation

Publish with us

Policies and ethics