Proposal review rankings: the influence of reviewer discussions on proposal selection

Lisa J. Storrie-Lombardi; Nancy A. Silbermann; Luisa M. Rebull; Seppo Laine; Megan Crane

doi:10.1117/12.787964

12 July 2008 Proposal review rankings: the influence of reviewer discussions on proposal selection

Lisa J. Storrie-Lombardi, Nancy A. Silbermann, Luisa M. Rebull, Seppo Laine, Megan Crane

Proceedings Volume 7016, Observatory Operations: Strategies, Processes, and Systems II; 701622 (2008) https://doi.org/10.1117/12.787964
Event: SPIE Astronomical Telescopes + Instrumentation, 2008, Marseille, France

Abstract

The telescope time allocation process for NASA's Great Observatories involves a substantial commitment of time and expertise by the astronomical community. The annual review meetings typically have 100 external participants. Each reviewer spends 3-6 days at the meeting in addition to one-two weeks of preparation time, reading and grading proposals. The reviewers grade the proposals based on their individual reading prior to the meeting and grade them again after discussion within the broad, subject-based review panels. We summarize here how the outcome of the review process for three Spitzer observing cycles would have changed if the selection had been done strictly based on the preliminary grades without having the panels meet and discuss the proposals. The changes in grading during the review meeting have a substantial impact on the final list of selected proposals. Approximately 30% of the selected proposals would not have been included if just the preliminary rankings had been used to make the selection.

Citation Download Citation

Lisa J. Storrie-Lombardi, Nancy A. Silbermann, Luisa M. Rebull, Seppo Laine, and Megan Crane "Proposal review rankings: the influence of reviewer discussions on proposal selection", Proc. SPIE 7016, Observatory Operations: Strategies, Processes, and Systems II, 701622 (12 July 2008); https://doi.org/10.1117/12.787964

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available