The Chandra automated processing system: challenges, design enhancements, and lessons learned

David Plummer; John Grier; Sreelatha Masters

doi:10.1117/12.672293

30 June 2006 The Chandra automated processing system: challenges, design enhancements, and lessons learned

David Plummer, John Grier, Sreelatha Masters

Proceedings Volume 6270, Observatory Operations: Strategies, Processes, and Systems; 62701W (2006) https://doi.org/10.1117/12.672293
Event: SPIE Astronomical Telescopes + Instrumentation, 2006, Orlando, Florida , United States

Abstract

Chandra standard data processing involves hundreds of different types of data products and pipelines. Pipelines are initiated by different types of events or notifications and may depend upon many other pipelines for input data. The Chandra automated processing system (AP) was designed to handle the various notifications and orchestrate the pipeline processing. Certain data sets may require "special" handling that deviates slightly from the standard processing thread. Also, bulk reprocessing of data often involves new processing requirements. Most recently, a new type of processing to produce source catalogs has introduced requirements not anticipated by the original AP design. Managing these complex dependencies and evolving processing requirements in an efficient, flexible, and automated fashion presents many challenges. This paper describes the most significant of these challenges, the AP design changes required to address these issues and the lessons learned along the way.

Citation Download Citation

David Plummer, John Grier, and Sreelatha Masters "The Chandra automated processing system: challenges, design enhancements, and lessons learned", Proc. SPIE 6270, Observatory Operations: Strategies, Processes, and Systems, 62701W (30 June 2006); https://doi.org/10.1117/12.672293

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available