Real-time Time-variability Analysis of GB to TB Datasets: Experience from SuperMACHO and Supernova projects at NOAO/CTIO Conference Paper uri icon

abstract

  • The era of large survey datasets has arrived, and the era of large survey telescope projects is upon us. Many of these new telescope projects will not only produce large datasets, they will produce datasets that require real-time astronomical analysis, including object detection, photometry, and classification. These datasets promise to open new horizons in the exploration of the time domain in astrophysical systems on large scales. But to fulfill this promise, the projects must design and develop data management systems on a much larger scale (many Terabytes per day continuously) than has previously been achieved in astronomy. Working together, NOAO and the University of Washington are developing prototype pipeline systems to explore the issues involved in real-time time-variability analysis. These efforts are not simply theoretical exercises, but rather are driven by NOAO Survey programs which are generating large data flows. Our survey projects provide a science-driven testbed of data management strategies needed for future initiatives such as the Large Synoptic Survey Telescope and other large-scale astronomical data production systems.

name of conference

  • Survey and Other Telescope Technologies and Discoveries

published proceedings

  • Proceedings of SPIE--the International Society for Optical Engineering

author list (cited authors)

  • Smith, C., Rest, A., Hiriart, R., Becker, A., Stubbs, C. W., Valdes, F. G., & Suntzeff, N.

citation count

  • 9

complete list of authors

  • Smith, Chris||Rest, Armin||Hiriart, Rafael||Becker, Andrew||Stubbs, Christopher W||Valdes, Francisco G||Suntzeff, Nicholas

editor list (cited editors)

  • Tyson, J. A., & Wolff, S.

publication date

  • December 2002