|
1.IntroductionParametric cost models for space telescopes have several uses. They identify major architectural cost drivers and allow high-level design trades. They enable cost-benefit analysis for technology development investment. And, they provide a basis for estimating total project cost used to justify the initiation of billion dollar programs. However, great care is required. All cost models are wrong and should be used with healthy skepticism. And, while some models are useful, others are really wrong. This work reviews and summarizes historical and current published cost models for space telescopes. Each model is presented using its original nomenclature and definitions. Whenever possible, the work attempts to place models into a present context while intercomparing models and other relevant information. This work does not include unpublished proprietary models or models developed to study specific mission concepts. 2.Cost Models2.1.Ground Telescope Cost ModelsCost models for ground-based telescopes have been published since the 1960s. However, at the time, there was insufficient data to generate similar cost models for space telescopes. In the absence of a space telescope cost model, the community naturally relied on what it knew and extrapolated based on ground telescope models. Ground telescope cost models historically focused on primary mirror diameter as the principal cost driver. A detailed discussion of ground cost models can be found in Stahl, 2005.1 Starting in the 1960s, models scaled cost as a function of primary mirror diameter raised to the power of 3.0. Since that time, many different scaling laws have been proposed by different and, in some cases, even the same author. In his 1979 paper, Meinel2 found a “scaling law exponent close to the 2.0 power, in contrast to the often cited 2.7 exponent.” However, in later papers,3, 4 he reported scaling laws ranging from 2.5 to 2.75. Of all these laws, the one which seems to have gained the most acceptance is the 2.7 factor. In 2000, Bely indicated that a scaling law of 2.7 is considered the standard for ground-based observatories,5 and in 2002 Stepp stated that the consensus traditional scaling law appears to be 2.7.6 While these laws are technically correct, they should not be extended to space telescopes, because they all include the ground observatory building and/or dome (the cost of the dome is driven by the volume of the telescope, which is proportional to raised to the third power). And, space telescopes do not have domes. Therefore, any use of a 2.7 scaling law for space telescopes will result in unfounded conclusions. Meinel actually made the dome distinction in his 1979 paper, but then failed to repeat this clarification in his later papers. In 2005, Stahl1 published a multivariable parametric cost model for just the ground telescope assembly (without telescope mount or dome), where the cost scales with primary mirror diameter to the 1.8th power: where is the primary mirror diameter, is the wavelength diffraction-limited performance, is the year of development for reduction in technology cost over time, and is the segmentation factor.
if the primary mirror is segmented and
1 if the primary mirror is monolithic
segment diameter
number of unique segment prescriptions
number of repeated segments. The segmentation factor estimates the cost reduction that can be gained by incorporating replication and serial processing learning into the fabrication of large telescopes. However, please note that this cost efficiency is not fully obtained if multiple parallel manufacturing lines are used. The Stahl 2005 study hoped that a cost relationships for ground optical telescopes, without their domes, would be indicative of space optical telescope assembly costs. Unfortunately, as is discussed in Stahl 2010,7 it is not. The cost to manufacture ground telescopes is not a good estimator of the cost to manufacture space telescopes. 2.2.Space Telescope Cost ModelsParametric cost models for space telescopes have not been published as much as for ground telescopes. This is partly because of the lack of an extensive database, i.e., there are not as many space telescopes, and partly because cost information for space telescopes is difficult to obtain either for proprietary or national security reasons. But, there have been some discussions. 2.2.1.Meinel modelsIn 1986, Meinel and Meinel asserted that, “Space telescopes are intrinsically 2 orders of magnitude more expensive for a given aperture than are terrestrial ones and are likely to remain at least 1 order of magnitude more expensive.”8 However, it does not appear that this predicted cost reduction has occurred. Ten years later in 1997, Schmidt-Kaler and Rucks asserted that space telescopes were still more expensive than ground telescopes by a factor of almost 100.9 These papers implied that space telescope cost scales with aperture diameter to either the 2.0 or 2.7 power. The Meinels revisited the subject of cost models for space telescopes in 2004 with lead author Bellea.10 At one point in the paper, they assert that, “no general inference can be drawn from the relationship between telescope cost and aperture size … telescope size is independent of cost. Instead, our assessment is that the predominant phenomenon at play is rapid technological development.” But, later in the paper and in the conclusion, they assert that it is their expectation that the scaling law for space-based telescopes is close to . They make this argument based on a scaling of the structure necessary to maintain optical surface figure in a zero-gravity environment and the scaling of structure necessary to protect a space telescope from space weather. 2.2.2.Bely modelsIn 2000, Bely asserted that from his experience with “mostly classified systems cost data,” that the scaling law for space telescopes based on primary mirror diameter is “on the order of 1.8th power.”5 In his 2003 book, Bely published an equation for cost scaling with diameter to the 1.6th power. He justified this assertion based on the argument that space telescopes do not have a dome which scales with volume; and, that the cost to design and test a telescope is larger for a space than a ground telescope.11 But most importantly, Bely provided a citation for his equation: “For space telescopes, one model developed by Technomics, based for the most part on military and surveillance missions, is of the form:” where is diameter, the and terms are material and design factors, is temperature, and is year. These parameters ( , , , , and ) are all directly traceable to the Technomics citation provided by Bely, which is identical to Ref. 12 by Horak , 1993.The Horak cost model is summarized later in this work and thus is not discussed here. However, the cost relationship reported by Bely is not the same as reported by Horak. There are three specific differences. Missing from the Bely equation is a term for the number of curved elements included in the Horak model. The Horak model exponent for wavelength is 0.178 not 1.8—possibly a typo on the part of Bely. And, the exponent for aperture diameter in the cited Horak publication is 0.705 not 1.6. It is this last discrepancy which is of most interest to this author, because, during his tenure in industry, he saw several proprietary cost models with the same 1.6th power aperture diameter exponent. All of these models claimed to have been derived from the Horak model. 2.2.3.Mass modelsIn the space industry, mass is believed to be the key cost driver. Thus, the original NASA Air Force Cost Model (NAFCOM) estimated space mission cost based solely on mass. The problem is that a mass-only model lacks sufficient detail to make meaningful mission concept design trades. To correct this deficiency, since 2002 NAFCOM has incorporated cost estimating relationships (CERs) of heritage, technology readiness level (TRL), and other technical and programmatic parameters. NAFCOM has an extensive database containing parametric cost data and technical information at the group, subsystem, and component level for many historical NASA programs. These data are normalized and separated by mission type. In addition, NAFCOM contains data from the Scientific Instrument Cost Model (SICM). NAFCOM and SICM are computer software applications that calculate cost predictions based on user parameter inputs. One example of a space telescope cost versus mass model is the NASA Advanced Mission Cost Model:13 where is the number of flight systems; and difficulty levels are: low, , , , and high.While it may initially appear, from the parametric equation, that mission cost is driven by mass, Fig. 1 shows that difficulty level is a larger cost driver than mass. To illustrate this fact, Fig. 1 has phase A to D cost data points for Hubble Space Telescope (HST), James Webb Space Telescope (JWST), and Kepler. While HST is nearly two times more massive than JWST, HST is less expensive because it is less difficult. Also, the model includes a cost reduction for multiple systems, but this author knows of no way to test this CER. Most, if not all, scientific space telescopes are “one-off” systems with very little duplication or even reuse. The only relevant examples of quantity production are commercial imaging systems such as IKONOS (Lockhead Martin, Bethesda, Maryland), Quickbird (Satellite Imaging Corporation, Houston, Texas), or NextView (Digital Globe, Longmont, Colorado), and their cost data is proprietary. It is this author’s opinion that there are two problems with mass models. First, mass is not a primary cost driver, but rather an indicator of the true cost drivers. And second, some may be tempted to focus only on mass and ignore not only the true engineering cost drivers (such as aperture) but also the critical role that complexity plays. A simplistic example as to why one cannot consider only mass is the lead brick analogy. It is silly to think that it costs more to launch a lead brick than a complex instrument with half the mass. In real life, mission planners are given a mass budget based on the capacities of the intended launch vehicle. Then they proceed to design their mission to this mass budget. The more functionality they include for a fixed mass, the more complex and more expensive the mission becomes. 2.2.4.Planning Research Corporation cost modelsPlanning Research Corporation (PRC) has generated several telescope cost models. In 1985, PRC published a model that predicts costs of telescopes for unmanned and manned spacecraft.14 The paper reports two cost estimating relationships: telescope design and development (D and D) and telescope flight hardware. These cost estimating relationships “represent the cost of a second unit following the manufacture and assembly of a prototype article. System level costs are included [for example: Systems Test Hardware (prototype); Systems Test Operations, GSE, Systems Engineering and Integration and Program Management].” PRC studied the parameters of weight, volume, primary mirror diameter, and minimum temperature. The PRC diameter only CER estimates 58% of total space telescope D and D and flight cost. For all space telescopes in their database (UV, visible, IR): design and development cost is proportional to , flight unit cost is proportional to , and D and D cost is approximately three times the flight unit cost. For just the infrared telescopes in their database: design and development cost is proportional to , flight unit cost is proportional to , and D and D cost is approximately four times the flight unit cost. In 2000, Smart developed a multivariable parametric cost model:15 where is the mirror diameter (meters), is the technology readiness level, is the average power (watt), and is the year of technology.While Smart found that mirror diameter was the primary cost driver, it was not the only parameter. It was necessary to include other engineering parameters to account for variations in cost not related to mirror diameter. The more mature the technology used on a mission, the lower the cost. The more power required by a mission for its instruments, spacecraft, and data transmission, the higher the cost. And because technology investment reduces cost, the more recent the mission launch date, the lower its cost. This model was developed using 13 space telescopes: EUVE, HEAO-2 (Einstein), HST, SIRTF (Spitzer), TRACE, WIRE, IRAS, IUE, OAO-2, OAO-3 (Copernicus), Skylab 1, and two Spacelab-2 missions. The regression statistics for this model explained 89% of the cost variation of these missions (Fig. 2). 2.2.5.Wong cost modelIn 1991, Wong of TRW contributed a chapter on cost modeling to Space and Mission Analysis and Design by Larson and Wertz.16 The Wong model presents a two-tier cost breakdown structure for unmanned spacecraft space segment CERs for “research, development, test, and evaluation” (RDTE) cost and “theoretical first unit” (TFU) cost. The chapter states that the model is derived from CERs of two editions of the United States Air Force Unmanned Spacecraft Cost Model.17 For optical sensors, the model predicts that cost depends on aperture diameter. For spacecraft and power subsystem CERs, the model estimates cost based on mass and required power. “The advantage of this is that during the concept and mission design phase, weight and power estimates are typically available. The disadvantage is that other parameters that should provide better cost estimates are not included.” Additionally, Wong reports multipliers or “wrap” factors for program level costs, technology insertion, and heritage reuse. It is important to note that the author assumes that all technologies involved are “proven” to “at least the component breadboard” level in a relevant environment (i.e., TRL-5/6) before the start of RDTE. The Wong model (Table 1) estimates that both the RDTE and the TFU costs, for either visible or IR sensors, varies by the sensor aperture diameter to the power of 0.562. This is similar to the 1985 PRC model’s power term for infrared systems. And, while PRC reports that the flight unit is 25 to 33% of the development cost (depending on system wavelength), Wong reports that TFU cost is approximately 40% of RDTE cost. Also, Wong reports that IR systems cost 2.77 times more than visible sensor systems. While no discussion was offered regarding these ratios, it is this author’s opinion that, given the payload applications and the state of technology in the mid to late 1980s, the ratio is probably driven by differences between visible and infrared optical components (i.e., substrate material costs and difficulty to manufacture) and detector costs (i.e., visible arrays versus infrared arrays or scanners). Finally, Wong provides wrap factors for estimating the cost of ground support equipment (GSE) at 11% of the RTDE and TFU cost, and program level support (i.e., management, systems engineering, product assurance, and system test and evaluation) at 33 to 36% of the hardware cost. Table 1Summary of Wong model unmanned spacecraft sensor CERs.
While Wong does report values for the one sigma standard error of the CERs, the only discussion regarding the database that supports this model is that the CERs are derived from historical data for sensor diameters ranging from . There is no discussion of how many or even what sensors are included in the database. Wong does caution the reader that these CERs should not be extended to systems beyond the data range. Additionally, Wong offers an interesting discussion of the cost impact of inserting new technology into a program verses using heritage technology. While current thinking assumes that insertion of new technology lowers programmatic cost, Wong asserts that new technology increases RDTE and TFU cost by 25 to 100%. An example provided is the cost to change structure designs (of the late 1980s) to graphite epoxy. By comparison, the author states that reuse of heritage technology requiring only moderate modifications can reduce RTDE cost by 40 to 60%, and that reuse of an existing design can reduce RTDE cost by 70 to 90%. Finally, Wong states that because of requirement creep and risk-averse government oversight, the RTDE cost for commercial space systems is only 80% as much as government spacecraft. 2.2.6.Horak cost modelsOf all the historical cost models, the Horak model is the most detailed and best documented. The complete model was published via two reports in 199312 and 1994.18 An updated model was published in 1996.19 The purpose of the model was to estimate the total cost of IR sensor payloads operating in geosynchronous and nongeosynchronous orbits or on aircraft. The database consisted of strategic and experimental IR sensor programs (Table 2) which may or may not have actually flown. The developed cost methodology consisted of seven cost estimating relationships (CERs) that estimate the costs of IR sensor assemblies (i.e., optical telescope assembly/structure, focal plane arrays, etc.). The study also developed a CER for integration, assembly, and calibration of the subsystems into a complete system. Table 2Horak cost model database of strategic and experimental IR sensor programs used in the development of CERs for optical telescope assembly/structure.
The 1993 study developed CERs to estimate the manufacturing cost of the first flight unit of seven different IR sensor subsystems, including the optical telescope assembly/structure. If a qualification unit was developed, its cost was considered as nonrecurring and was included in the developing engineering costs. The manufacturing cost included fabrication, assembly, inspection, and test of the hardware subsystem and did not include any program level costs (e.g., system engineering, program management, etc.). Cost of money, G&A, and fee for the subsystem component are included. The OTA subsystem includes the telescope optics, mounting hardware, and optical bench support structure. It also included baffles, shroud, and any structure associated with housing the telescope, cryostat, and shroud. Figure 3 shows the derived CER and its statistics for the OTA subsystem. The CER is a multiparametric model consistent with engineering judgment. Horak found that the cost of an OTA increases with mirror diameter and with the number of powered optics in the OTA. And, that the shorter the operating wavelength or the colder the operating temperature, the higher the OTA costs. Horak also found that technology investment over time lowers cost. Additionally, the Horak model included multiplier factors that account for fabrication difficulty, e.g., on-axis designs are less expensive than off-axis designs; or, light-weight mirrors cost more to fabricate than solid mirrors. For anyone who has ever tried to align an off-axis telescope or to grind and polish an extremely light-weight mirror, these multiplier factors may seem obvious. But you would be surprised at how many mission planners assume that there is no cost penalty associated with demanding design requirements. The 1993 Horak OTA cost model had a regression of , which means that the CER explained 97.8% of the cost variation of the 16 telescopes in the study. The 1993 study also developed a CER for the labor and material costs associated with integrating and assembling the subsystem hardware into the complete system. With a regression , the study found that: While the comparison might be incorrect, Wong estimates that GSE cost and system test and evaluation wrap is approximately 18% of the total hardware cost.Horak’s 1994 report developed CERs to estimate the nonrecurring development engineering costs for the demonstration and validation (D&V) and the engineering manufacturing development (EMD) phases of a program. With a regression , the study found that: This result is interesting in its disagreement with both the PRC and Wong models, which estimate that the design cost will range from 250 to 400% the cost to manufacture the first flight unit. As expected, Horak found that if more than one flight unit is manufactured, then the design cost increases with quantity, but not linearly. The model assumes a learning curve of 76%.The breadboard or engineering unit was found to cost 68% of the manufacturing cost of the first flight unit, and the qualification unit was found to cost 106% of the manufacturing cost of the first flight unit.In 1996, Horak published a set of charts with a multivariable parametric cost model for optical telescope assembly,19 which combined design, programmatic, and manufacturing costs (Fig. 4). The parameters were similar to the 1993 model, but the scaling power factors were slightly different. Unfortunately, there is no commentary discussion in the report to explain the details of this model. 2.2.7.Aerospace cost modelsThe Aerospace Corporation (El Segundo, California) has published several papers on cost modeling.20, 21, 22, 23 While none of these papers are specifically related to space telescopes, they are none the less relevant and illuminative. According to Beardon, there is a direct correlation between mission payload complexity and mission cost, as well as schedule growth. The more complex a mission is, the greater its cost, schedule, and mass is likely to grow. Additionally, the greatest predictor of a mission’s success is its technology maturity. The reason for this correlation is because the only way to achieve increasingly demanding performance requirements in a mass and volume constrained launch vehicle is to design increasingly complex mission payload architectures. This cost versus complexity relationship can be seen in Fig. 5, which plots actual mission development cost as a function of the complexity index developed by Beardon. According to the references (and private communication with Beardon), complexity index is determined via a methodology proprietary to the Aerospace Corporation. Specific mission technology or component specifications are compared to similar technologies or components of 150 satellite missions contained in the Aerospace Corporation Complexity Based Risk Assessment (CoBRA) database.23 For a detailed discussion of the mission payload complexity index, as well as a full explanation of Fig. 5, the author recommends that readers consult Refs. 20, 21, 22, 23. Similar evidence of a cost versus complexity relationship can be found in the NASA Advanced Mission Cost Model13 (Fig. 1), which is typically used to justify (possibly incorrectly) that mass is the dominant mission cost driver. A closer look at the model indicates that difficulty level is a larger cost driver than mass. Unfortunately, this author has no insight into how NASA derived this model or defines difficulty level. 3.ConclusionParametric cost models are important tools for mission planners. They identify major architectural cost drivers, allow high-level design trades, enable cost-benefit analysis for technology development investment, and provide a basis for estimating total project cost. They can provide guidance for expected design costs relative to manufacturing costs; system integration and test costs; or program management overhead. The problem is that all cost models are wrong. They are limited by their database sample sets and assumptions. For example, any model derived from ground-based telescopes is wrong. Similarly, any model based primarily on aircraft sensors or sensor design studies will underestimate the cost of space telescopes. Furthermore, any model that simply says that cost depends solely on mass without any engineering detail might lead one to actually increase total mission cost risk by selecting an unnecessarily complex mission concept or basing a concept on immature unproven technology. It is this author’s opinion that any correlation between mass and space telescope cost is a coincidence. Finally, some cost models include programmatic and system engineering costs, while others estimate these as percentage wraps. As shown in this survey of published cost models, there is no definitive model for the cost of space telescopes. For example, the scaling factor that relates space telescope cost to primary mirror diameter ranges by an order of magnitude from 2.7 (Meinel) to 0.27 (PRC). Of all the historical models surveyed, it is this author’s opinion that the one which is closest to “truth” is Smart’s multivariable parametric cost model:15 A key subtley of this model is that it is based entirely on NASA space telescopes. What is universally indicated by all the models surveyed in this work is that the more complex the design, the more difficult it will be to build and the more it will cost. Conversely, it is uniformly agreed that the higher the maturity of the technology being implemented, the lower the mission will cost. Some secondary predictions made by the models that require testing are that the cost to develop a mission is 1.25 to the cost of the flight hardware. And, that infrared telescopes cost two to three times more than visible telescopes. The bottom line is that blindly using an incorrect and unjustifiable cost estimating relationship without understanding its assumptions and limitations will lead to wrong conclusions and a potentially very expensive decision. Therefore, it is the responsibility of anyone who is reviewing potential mission proposals or selecting missions for flight to perform their due diligence and fully understand the limitations that constrain their foundational assumptions. ReferencesH. P. Stahl, G. Holmes Rowell, G. Reese, and A. Byberg,
“Multivariable parametric cost model for ground optical telescope assembly,”
Opt. Eng., 44
(8), 083001
(2005). https://doi.org/10.1117/1.2031216 0091-3286 Google Scholar
A. B. Meinel,
“Cost-scaling laws applicable to very large telescopes,”
Opt. Eng., 18
(6), 645
–647
(1979). 0091-3286 Google Scholar
A. B. Meinel,
“Cost relationships for nonconventional telescope structural configurations,”
J. Opt. Soc. Am., 2
(1), 14
–20
(1981). 0030-3941 Google Scholar
A. B. Meinel and M. P. Meinel,
“Optical phased array configuration for an extremely large telescope,”
Appl. Opt., 43
(3), 601
–607
(2004). https://doi.org/10.1364/AO.43.000601 0003-6935 Google Scholar
P. Y. Bely,
“Large space optics,”
ASP Conf. Ser., 207 34
–35
(2000). 1080-7926 Google Scholar
L. Stepp, L. Daggert, and P. Gillett,
“Estimating the costs of extremely large telescopes,”
Proc. SPIE, 4840 309
–321
(2002). https://doi.org/10.1117/12.459868 0277-786X Google Scholar
H. P. Stahl, K. Stephens, T. Henrichs, C. Smart, and F. A. Prince,
“Single variable parametric cost models for space telescopes,”
Opt. Eng., 49
(2010). 0091-3286 Google Scholar
A. B. Meinel and M. Meinel,
“Very large telescopes,”
Optics News, 12
(3), 9
–14
(1986). https://doi.org/10.1364/ON.12.3.000009 0098-907X Google Scholar
T. Schmidt-Kaler and P. Rucks,
“Telescope costs and cost reduction,”
Proc. SPIE, 2871 635
–640
(1997). https://doi.org/10.1117/12.269092 0277-786X Google Scholar
G. T. Bellea
A. B. Meinel, and M. P. Meinel,
“The scaling relationship between telescope cost and aperture size for very large telescopes,”
Proc. SPIE, 5489 563
–570
(2004). https://doi.org/10.1117/12.552181 0277-786X Google Scholar
P. Y. Bely, The Design and Construction of Large Optical Telescopes, 79 Springer-Verlag, New York
(2003). Google Scholar
J. A. Horak, C. J. Brown, L. M. Giegerich, and W. E. Waller,
“Strategic and experimental IR sensor cost model II,”
(1993). Google Scholar
, “Cost estimating relationships for spaceborne telescopes,”
(1985) Google Scholar
C. B. Smart,
“Telescope cost estimating relationship,”
(2000) Google Scholar
R. Wong,
“Cost modeling,”
Space Mission Analysis and Design, 2nd ed.Microcosm and Kluwer Academic Publishers, New York
(1992). Google Scholar
J. A. Horak, C. J. Brown, and W. E. Waller,
“Strategic and experimental IR sensor cost model II,”
(1994). Google Scholar
J. A. Horak,
“Cost trends of space electronics,”
(1996). Google Scholar
D. A. Bearden,
“A complexity-based risk assessment of low-cost planetary missions: when is a mission too fast and too cheap?,”
(2000). Google Scholar
R. Bitten, D. Emmons, and C. Freaner,
“Using historical NASA cost and schedule growth to set future programs and project reserve guidelines,”
(2007). Google Scholar
C. W. Freaner,
“An assessment of the inherent optimism in early conceptual designs and its effect on cost and schedule growth,”
(2008). Google Scholar
D. A. Bearden,
“Perspectives on NASA mission cost and schedule performance trends,”
(2008). Google Scholar
BiographyH. Philip Stahl is a Senior Optical Physicist at NASA MSFC. He is the James Webb Space Telescope (JWST) Optical Components Technical Lead. Previously, he was a senior staff optical engineer at Raytheon Danbury (formerly Hughes Danbury Optical Systems, now Goodrich Aerospace) where he was the lead optical engineer for the 4 meter LAMP mirror. As President of Stahl Optical Systems Inc, he supported several NASA Space Shuttle microgravity experiments. Also, he was an assistant professor of physics and applied optics at Rose-Hulman Institute of Technology, the Optical Products Manager at Breault Research Organization (BRO), and a Senior Optical Systems Engineer at BRO. Prior to that, he worked at Perkin-Elmer, Hughes Aircraft, and Wright-Patterson AFB. Finally, he was a Faculty Fellow at NASA Lewis (now Glenn) Research Center. He is a leading authority in optical metrology, optical engineering, and phase-measuring interferometry. Many of the world’s largest telescopes have been fabricated with the aid of high-speed and infrared phase-measuring interferometers developed by him, including the Keck, VLT and Gemini telescopes. He is a member of OSA, Fellow of SPIE, a past SPIE Director, and current International Commission for Optics (ICO) Vice President. He earned his PhD in Optical Science at the University of Arizona Optical Sciences Center in 1985. |