High Speed Interconnects and Parallel Software Libraries: Enabling Technologies for the NVO

Abstract

The NVOs core data mining and archive federation activities are heavily dependent on the underlying data pipeline software necessary to translate the raw data into scientifically relevant source detections. The data pipeline software dictates: the raw data storage and retrieval mechanisms, the meaning and format of the fields in the source catalogs, and the ability of the NVO users to re-analyze raw data for their own purposes. Increasing the performance of the core data pipeline software so that it can address the needs of current and future high data rate surveys is an important activity that should be addressed in concert with the development of the NVO.