Real-time Time-variability Analysis of GB to TB Datasets: Experience from SuperMACHO and Supernova projects at NOAO/CTIO
Conference Paper
Overview
Research
Identity
Additional Document Info
Other
View All
Overview
abstract
The era of large survey datasets has arrived, and the era of large survey telescope projects is upon us. Many of these new telescope projects will not only produce large datasets, they will produce datasets that require real-time astronomical analysis, including object detection, photometry, and classification. These datasets promise to open new horizons in the exploration of the time domain in astrophysical systems on large scales. But to fulfill this promise, the projects must design and develop data management systems on a much larger scale (many Terabytes per day continuously) than has previously been achieved in astronomy. Working together, NOAO and the University of Washington are developing prototype pipeline systems to explore the issues involved in real-time time-variability analysis. These efforts are not simply theoretical exercises, but rather are driven by NOAO Survey programs which are generating large data flows. Our survey projects provide a science-driven testbed of data management strategies needed for future initiatives such as the Large Synoptic Survey Telescope and other large-scale astronomical data production systems.
name of conference
Survey and Other Telescope Technologies and Discoveries