Skip to main content
SpringerLink
Log in

Retrospective on Aurora

  • Published:
The VLDB Journal Aims and scope Submit manuscript

Abstract.

This experience paper summarizes the key lessons we learned throughout the design and implementation of the Aurora stream-processing engine. For the past 2 years, we have built five stream-based applications using Aurora. We first describe in detail these applications and their implementation in Aurora. We then reflect on the design of Aurora based on this experience. Finally, we discuss our initial ideas on a follow-on project, called Borealis, whose goal is to eliminate the limitations of Aurora as well as to address new key challenges and applications in the stream-processing domain.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. A guide for hot lane development: A U.S. Department of Transportation Federal Highway Administration. http://www.itsdocs.fhwa.dot.gov/JPODOCS/REPTS\_TE/13668.html

  2. Abadi D, Carney D, Çetintemel U, Cherniack M, Convey C, Erwin C, Galvez E, Hatoun M, Hwang J, Maskey A, Rasin A, Singer A, Stonebraker M, Tatbul N, Xing Y, Yan R, Zdonik S (2003) Aurora: A data stream management system (demo description). In: ACM SIGMOD

  3. Abadi D, Carney D, Çetintemel U, Cherniack M, Convey C, Lee S, Stonebraker M, Tatbul N, Zdonik S (2003) Aurora: A new model and architecture for data stream management. VLDB J 12(2):120-139

    Article  Google Scholar 

  4. Arasu A, Cherniack M, Galvez E, Maier D, Maskey A, Ryvkina E, Stonebraker M, Tibbetts R (2004) Linear Road: A benchmark for stream data management systems. In: VLDB conference, Toronto (in press)

  5. Balazinska M, Balakrishnan H, Stonebraker M (2004) Contract-based load management in federated distributed systems. In: NSDI symposium

  6. Barlett J, Gray J, Horst B (1986) Fault tolerance in tandem computer systems. Technical Report TR-86.2, Tandem Computers

  7. Carney D, Çetintemel U, Cherniack M, Convey C, Lee S, Seidman G, Stonebraker M, Tatbul N, Zdonik S (2002) Monitoring streams - a new class of data management applications. In: VLDB conference, Hong Kong

  8. Carney D, Çetintemel U, Rasin A, Zdonik S, Cherniack M, Stonebraker M (2003) Operator scheduling in a data stream manager. In: VLDB conference, Berlin, Germany

  9. Chandrasekaran S, Deshpande A, Franklin M, Hellerstein J, Hong W, Krishnamurthy S, Madden S, Raman V, Reiss F, Shah M (2003) TelegraphCQ: Continuous dataflow processing for an uncertain world. In: CIDR conference

  10. Cherniack M, Balakrishnan H, Balazinska M, Carney D, Çetintemel U, Xing Y, Zdonik S (2003) Scalable distributed stream processing. In: CIDR conference, Asilomar, CA

  11. Congestion pricing: a report from intelligent transportation systems (ITS). http://www.path.berkeley.edu

  12. DeWitt D, Naughton J, Schneider D (1991) An evaluation of non-equijoin algorithms. In: VLDB conference, Barcelona, Catalonia, Spain

  13. Hwang J, Balazinska M, Rasin A, Çetintemel U, Stonebraker M, Zdonik S (2003) A comparison of stream-oriented high-availability algorithms. Technical Report CS-03-17, Department of Computer Science, Brown University, Providence, RI

  14. Lerner A, Shasha D (2003) AQuery: Query language for ordered data, optimization techniques, and experiments. In: VLDB conference, Berlin, Germany

  15. Motwani R, Widom J, Arasu A, Babcock B, Babu S, Datar M, Manku G, Olston C, Rosenstein J, Varma R (2003) Query processing, approximation, and resource management in a data stream management system. In: CIDR conference

  16. Poole RW (2002) Hot lanes prompted by federal program. http://www.rppi.org/federalhotlanes.html

  17. Seshadri P, Livny M, Ramakrishnan R (1995) SEQ: A model for sequence databases. In: IEEE ICDE conference, Taipei, Taiwan

  18. Tatbul N, Çetintemel U, Zdonik S, Cherniack M, Stonebraker M (2003) Load shedding in a data stream manager. In: VLDB conference, Berlin, Germany

  19. The MITRE Corporation. http://www.mitre.org/

  20. US Army Medical Research and Materiel Command. https://mrmc-www.army.mil/

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Brandeis University, MA 02454, Waltham, USA

    Mitch Cherniack & Eddie Galvez

  2. Department of Computer Science, Brown University, RI 02912, Providence, USA

    Don Carney, Uğur Çetintemel, Christian Convey, Nesime Tatbul & Stan Zdonik

  3. Department of EECS and Laboratory of Computer Science, Massachussetts Institute of Technology, MA 02139, Cambridge, USA

    Hari Balakrishnan, Magdalena Balazinska, Jon Salz, Michael Stonebraker & Richard Tibbetts

Authors
  1. Hari Balakrishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Magdalena Balazinska
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Don Carney
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Uğur Çetintemel
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mitch Cherniack
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Christian Convey
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Eddie Galvez
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jon Salz
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Michael Stonebraker
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Nesime Tatbul
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Richard Tibbetts
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Stan Zdonik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hari Balakrishnan.

Additional information

Received: 21 October 2003, Accepted: 16 April 2004, Published online: 14 September 2004

Edited by: J. Gehrke and J. Hellerstein.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Balakrishnan, H., Balazinska, M., Carney, D. et al. Retrospective on Aurora. VLDB 13, 370–383 (2004). https://doi.org/10.1007/s00778-004-0133-5

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00778-004-0133-5

Keywords:

Search

Navigation