skip to main content
10.1145/3596711.3596786acmoverlaybooksArticle/Chapter ViewAbstractPublication PagesEdited Collectionacm-pubtype
research-article
Seminal Paper

The Virtual Cinematographer: A Paradigm for Automatic Real-Time Camera Control and Directing

Published:02 August 2023Publication History

Editorial Notes

This paper was originally published as https://doi.org/10.1145/237170.237259.

ABSTRACT

This paper presents a paradigm for automatically generating complete camera specifications for capturing events in virtual 3D environments in real-time. We describe a fully implemented system, called the Virtual Cinematographer, and demonstrate its application in a virtual "party" setting. Cinematographic expertise, in the form of film idioms, is encoded as a set of small hierarchically organized finite state machines. Each idiom is responsible for capturing a particular type of scene, such as three virtual actors conversing or one actor moving across the environment. The idiom selects shot types and the timing of transitions between shots to best communicate events as they unfold. A set of camera modules, shared by the idioms, is responsible for the low-level geometric placement of specific cameras for each shot. The camera modules are also responsible for making subtle changes in the virtual actors? positions to best frame each shot. In this paper, we discuss some basic heuristics of filmmaking and show how these ideas are encoded in the Virtual Cinematographer.

References

  1. Daniel Arijon. Grammar of the Film Language. Communication Arts Books, Hastings House, Publishers, New York, 1976.Google ScholarGoogle Scholar
  2. James Blinn. Where am I? What am I looking at? IEEE Computer Graphics and Applications, pages 76--81, 1988.Google ScholarGoogle Scholar
  3. David B. Christianson, Sean E. Anderson, Li-wei He, David H. Salesin, Daniel S. Weld, and Michael F. Cohen. Declarative camera control for automatic cinematography. In Proceedings of the AAAI-96, August 1996.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Steven M. Drucker, Tinsley A. Galyean, and David Zeltzer. CINEMA: A system for procedural camera movements. In David Zeltzer, editor, Computer Graphics (1992 Symposium on Interactive 3D Graphics), volume 25, pages 67--70, March 1992.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Steven M. Drucker and David Zelter. CamDroid: A system for implementing intelligent camera control. In Michael Zyda, editor, Computer Graphics (1995 Symposium on Interactive 3D Graphics), volume 28, pages 139--144, April 1995.Google ScholarGoogle Scholar
  6. Steven M. Drucker and David Zeltzer. Intelligent camera control in a virtual environment. In Proceedings of Graphics Interface '94, pages 190--199, Banff, Alberta, Canada, May 1994. Canadian Information Processing Society.Google ScholarGoogle Scholar
  7. James D. Foley, Andries van Dam, Steven K. Feiner, and John F. Hughes. Computer Graphics, Principles and Practice. AddisonWesley Publishing Company, Reading, Massachusetts, second edition, 1990.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Michael Gleicher and Andrew Witkin. Through-the-lens camera control. In Edwin E. Catmull, editor, Computer Graphics (SIGGRAPH '92 Proceedings), volume 26, pages 331--340, July 1992.Google ScholarGoogle Scholar
  9. David Harel. Statecharts: A visual formalism for complex systems. Science of Computer Programming, pages 231--274, 1987.Google ScholarGoogle Scholar
  10. Donald Hearn and M. Pauline Baker. Computer Graphics. Prentice Hall, Englewood Cliffs, New Jersey, second edition, 1994.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Peter Karp and Steven Feiner. Issues in the automated generation of animated presentations. In Proceedings of Graphics Interface '90, pages 39--48, May 1990.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Peter Karp and Steven Feiner. Automated presentation planning of animation using task decomposition with heuristic reasoning. In Proceedings of Graphics Interface '93, pages 118--127, Toronto, Ontario, Canada, May 1993. Canadian Information Processing Society.Google ScholarGoogle Scholar
  13. Christopher Lukas. Directing for Film and Television. Anchor Press/Doubleday, Garden City, N.Y., 1985.Google ScholarGoogle Scholar
  14. Jock D. Mackinlay, Stuart K. Card, and George G. Robertson. Rapid controlled movement through a virtual 3D workspace. In Forest Baskett, editor, Computer Graphics (SIGGRAPH '90 Proceedings), volume 24, pages 171--176, August 1990.Google ScholarGoogle Scholar
  15. Joseph V. Mascelli. The Five C's of Cinematography. Cine/Grafic Publications, Hollywood, 1965.Google ScholarGoogle Scholar
  16. Cary B. Phillips, Norman I. Badler, and John Granieri. Automatic viewing control for 3D direct manipulation. In David Zeltzer, editor, Computer Graphics (1992 Symposium on Interactive 3D Graphics), volume 25, pages 71--74, March 1992.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Warren Sack and Marc Davis. IDIC: Assembling video sequences from story plans and content annotations. In IEEE International Conference on Multimedia Computing and Systems, Boston, MA, May 1994.Google ScholarGoogle ScholarCross RefCross Ref
  18. Patrick Tucker. Secrets of Screen Acting. Routledge, New York, 1994Google ScholarGoogle Scholar

Index Terms

  1. The Virtual Cinematographer: A Paradigm for Automatic Real-Time Camera Control and Directing

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Overlay Books
              Seminal Graphics Papers: Pushing the Boundaries, Volume 2
              August 2023
              893 pages
              ISBN:9798400708978
              DOI:10.1145/3596711
              • Editor:
              • Mary C. Whitton
              • cover image ACM Conferences
                SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
                August 1996
                528 pages
                ISBN:0897917464
                DOI:10.1145/237170

              Copyright © 2023 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 2 August 2023

              Permissions

              Request permissions about this article.

              Request Permissions

              Qualifiers

              • research-article

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader