Vamsidhar Reddy Gaddam
Håkon Kvale Stensland
Pål Halvorsen
ABSTRACT
High-resolution panoramic video with a wide field-of-view is popular in many contexts. However, in many examples, like surveillance and sports, it is often desirable to zoom and pan into the generated video. A challenge in this respect is real-time support, but in this demo, we present an end-to-end real-time panorama system with interactive zoom and panning. Our system installed at Alfheim stadium, a Norwegian premier league soccer team, generates a cylindrical panorama from five 2K cameras live where the perspective is corrected in real-time when presented to the client. This gives a better and more natural zoom compared to existing systems using perspective panoramas and zoom operations using plain crop. Our experimental results indicate that virtual views can be generated far below the frame-rate threshold, i.e., on a GPU, the processing requirement per frame is about 10 milliseconds.
The proposed demo lets participants interactively zoom and pan into stored panorama videos generated at Alfheim stadium and from a live 2-camera array on-site.
- Azure-0814m5m. http://www.azurephotonicsus.com/products/azure-0814M5M.html.Google Scholar
- Basler aca2000-50gc. http://www.basierweb.com/products/ace.html?model=173.Google Scholar
- SmoothHD. http://www.smoothhd.com, 2009.Google Scholar
- Sports & Entertainment - Cisco Connected Stadium, 2013. http://www.cisco.com/web/strategy/sports/index.html.Google Scholar
- Y. Ariki, S. Kubota, and M. Kumano. Automatic production system of soccer sports video by digital camera work based on situation recognition. In Proc. of ISM, pages 851--860, 2006. Google ScholarDigital Library
- P. Carr and R. Hartley. Portable multi-megapixel camera with real-time recording and playback. In Proc. of DICTA, pages 74--80, 2009. Google ScholarDigital Library
- P. Carr, M. Mistry, and I. Matthews. Hybrid robotic/virtual pan-tilt-zom cameras for autonomous event recording. In Proc. of ACM MM, pages 193--202, 2013. Google ScholarDigital Library
- V. R. Gaddam, R. Langseth, S. Ljødal, P. Gurdjos, V. Charvillat, C. Griwodz, and P. Halvorsen. Interactive zoom and panning from live panoramic video. In Proc. of ACM NOSSDAV, Mar. 2014. Google ScholarDigital Library
- R. Guntur and W. T. Ooi. On tile assignment for region-of-interest video streaming in a wireless Ian. In Proc. of NOSSDAV, pages 59--64, 2012. Google ScholarDigital Library
- P. Halvorsen, S. Sasgrov, A. Mortensen, D. K. Kristensen, A. Eichhorn, M. Stenhaug, S. Dahl, H. K. Stensland, V. R. Gaddam, C. Griwodz, and D. Johansen. Bagadus: An integrated system for arena sports analytics -- a soccer case study. In Proc. of ACM MMSys, pages 48--59, Mar. 2013. Google ScholarDigital Library
- A. Mavlankar and B. Girod. Video streaming with interactive pan/tilt/zoom. In M. Mrak, M. Grgic, and M. Kunt, editors, High-Quality Visual Experience, Signals and Communication Technology, pages 431--455. Springer Berlin Heidelberg, 2010.Google Scholar
- S. A. Pettersen, D. Johansen, H. Johansen, V. Berg-Johansen, V. R. Gaddam, A. Mortensen, R. Langseth, C. Griwodz, H. K. Stensland, and P. Halvorsen. Soccer video and player position dataset. In Proc. of ACM MMSYS, Mar. 2014. Google ScholarDigital Library
- R. Pantos (ed). HTTP Live Streaming. http://www.ietf.org/internet-drafts/draft-pantos-http-live-streaming-10.txt, 2013.Google Scholar
- H. K. Stensland, V. R. Gaddam, M. Tennøe, E. Helgedagsrud, M. Næss, H. K. Alstad, A. Mortensen, R. Langseth, S. Ljødal, O. Landsverk, C. Griwodz, P. Halvorsen, M. Stenhaug, and D. Johansen. Bagadus: An integrated real-time system for soccer analytics. ACM Trans. Multimedia Comput. Commun. Appl. (TOMCCAP), 10(1s):14:1--14:21, Jan. 2014. Google ScholarDigital Library
- X. Sun, J. Foote, D. Kimber, and B. Manjunath. Region of interest extraction and virtual camera control based on panoramic video capturing. IEEE Transactions on Multimedia, 7(5):981--990, 2005. Google ScholarDigital Library
- M. Tennøe, E. Helgedagsrud, M. Næss, H. K. Alstad, H. K. Stensland, V. R. Gaddam, D. Johansen, C. Griwodz, and P. Halvorsen. Efficient implementation and processing of a real-time panorama video pipeline. In Proc. of IEEE ISM, Dec. 2013. Google ScholarDigital Library
- J. Wang, C. Xu, E. Chng, K. Wah, and Q. Tian. Automatic replay generation for soccer video broadcasting. In Proc. of ACM MM, pages 32--39, 2004. Google ScholarDigital Library
- M. Wieland, R. Steinmetz, and P. Sander. Remote camera control in a distributed multimedia system. In B. Wolfinger, editor, Innovationen bei Rechen- und Kommunikationssystemen, Informatik aktuell, pages 174--181. Springer Berlin Heidelberg, 1994.Google Scholar
Index Terms
- Be your own cameraman: real-time support for zooming and panning into stored and live panoramic video
Recommendations
Automatic Real-Time Zooming and Panning on Salient Objects from a Panoramic Video
MM '14: Proceedings of the 22nd ACM international conference on MultimediaThe proposed demo shows how our system automatically zooms and pans into tracked objects in panorama videos. At the conference site, we will set up a two-camera version of the system, generating live panorama videos, where the system zooms and pans ...
Interactive Zoom and Panning from Live Panoramic Video
NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video WorkshopPanorama video is becoming increasingly popular, and we present an end-to-end real-time system to interactively zoom and pan into high-resolution panoramic videos. Compared to existing systems using perspective panoramas with cropping, our approach ...
Interactive Zoom and Panning from Live Panoramic Video
NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video WorkshopPanorama video is becoming increasingly popular, and we present an end-to-end real-time system to interactively zoom and pan into high-resolution panoramic videos. Compared to existing systems using perspective panoramas with cropping, our approach ...
Comments