Contents

• Background
• Definition of a Major Research Facility
• Congressional Hearing on Planning and Management Issues
• Audit of Funding for Major Research Equipment and Facilities
• Congressional Activity
• Planning and Management Issues
• Termination of a Major Research Project
• MREFC Support in the FY2013 Budget Request

Summary

The Major Research Equipment and Facilities Construction (MREFC) account of the National Science Foundation (NSF) supports the acquisition and construction of major research facilities and equipment that are to extend the boundaries of science, engineering, and technology. The facilities include telescopes, earth simulators, astronomical observatories, and mobile research platforms. Currently, the NSF provides approximately $1.0 billion annually in support of facilities and other infrastructure projects. While the NSF does not directly design or operate research facilities, it does have final responsibility for oversight and management. Questions have been raised by many in the scientific community and in Congress concerning the adequacy of the planning and management of NSF facilities. In addition, there has been debate related to the criteria used to select projects for MREFC support.

The Administration's FY2013 budget request for the NSF is $7,373.1 million, a 4.8% increase ($340.0 million) over the FY2012 estimated level of $7,033.1 million. Included in the request total is $196.2 million for MREFC, slightly below the FY2012 estimate of $197.1 million. The FY2013 request proposes support for four projects—Advanced Laser Interferometer Gravitational-Wave Observatory ($14.9 million), Advanced Technology Solar Telescope ($42.0 million), Ocean Observatories Initiative ($27.5 million), and the National Ecological Observatory Network ($98.2 million).

Background

The Major Research Equipment and Facilities Construction (MREFC) account of the National Science Foundation (NSF) was established in FY1995 and supports the acquisition, construction, and commissioning of major research facilities and equipment that are to extend the boundaries of science and engineering. Major research facilities are complex in their design, construction, and operation and require a large investment over a limited period of time. Examples of some of the funded projects include telescopes, research vessels, accelerators, networked high-tech research platforms, advanced computing resources, astronomical observatories, and earthquake simulators. These complex projects sometimes involve the participation of international partners. Currently, the NSF provides approximately $1.0 billion annually in support of facilities and other infrastructure projects. The funding for construction of individual facilities ranges from several tens of millions to hundreds of millions of dollars. Additional funding is required annually for operation, maintenance, upgrades, and retooling of the facilities.

With the significant exception of research facilities in the Antarctic, the NSF does not directly design or operate research facilities. Rather, it makes awards to other organizations, such as universities, consortia of universities, or nonprofit organizations, which have the responsibility of construction, operation, and management. The NSF enters into cooperative agreements with these external entities, and has the final responsibility for oversight of the development, management, and performance of the facilities.

During the past few years, NSF's portfolio of facilities has expanded and diversified to include complex multidisciplinary projects and distributed projects. Because these major facility projects are multi-year, their accounting, management, and oversight require more complexity and detail than the traditional average grant award. There are concerns from Congress and from some in the academic and scientific community about the adequacy of the planning and management of NSF facilities. Discussions have focused on how major facility projects are selected for funding. Other questions have centered on the types of costs to be funded through the MREFC account and NSF personnel involved in major facility projects. In the FY2002 budget submission, President Bush directed the NSF to develop clearer policies and procedures for managing all aspects of large facility projects, including funding controls and effective project management.¹ The FY2002 budget document, A Blue Print for New Beginnings: A Responsible Budget for America's Priorities, directed that "NSF will develop a plan to enhance its capability to estimate costs and provide oversight of project management and construction. This plan should help ensure that NSF is able to meet and stick to cost and schedule commitments for major facility projects."²

Definition of a Major Research Facility

The MREFC is an agency-wide capital asset account that funds major science and engineering infrastructure projects that cost more than one program's budget could support.³ Major research facility projects are defined as those awards made for establishing and/or operating a major tool or facility that will potentially benefit a community of researchers and/or educators. A project should "offer the possibility of transformative knowledge and the potential to shift existing paradigms in scientific understanding, engineering processes and/or infrastructure technology."⁴ A research facility is considered "major" if its total cost of construction and/or acquisition constitutes an investment that is more than 10% of the annual budget of the sponsoring directorate or office. The majority of large facility projects are funded through the MREFC, but some also receive support through the Research and Related Activities Account (RRA).⁵

Congressional Hearing on Planning and Management Issues

On September 6, 2001, the House Committee on Science, Subcommittee on Research, held a hearing on planning and management issues associated with major research facilities at the NSF. These hearings resulted from concerns expressed by some in the academic and scientific community and in Congress about the management and oversight of major projects selected for construction and the need for prioritization of potential projects funded in the MREFC. In testimony before the Subcommittee on Research, then NSF Director Rita R. Colwell stated that the draft of the Large Facility Projects Management and Oversight Plan codifies practices already in place and develops new guidelines for oversight of financial and business functions. She responded to criticism that the lines of authority for project management included in the draft plan were ambiguous and that those with oversight functions for the projects were program officers who may not have the expertise necessary for overseeing a complex project. The Plan established a new position—Deputy Director for Large Facility Projects. Under the Plan, the Deputy Director would be responsible for implementing and managing guidelines and procedures for facility management and oversight, maintaining lines of authority for facility management, and providing project management training for NSF staff engaged in large facility projects.

There has been considerable debate concerning the selection of major research facility projects for funding. In testimony before the Subcommittee on Research, Anita K. Jones, then Vice Chair, National Science Board (NSB), stated that because not all facilities can be built at the time they are considered, the NSB established guidelines for approving major facility projects.⁶ She emphasized that there is a prioritization process for selecting major projects, one that involves the NSF and the community, with the NSB actually making the priority decisions. The NSB, she asserted, reviews the need for the facility, the research that will be enabled, the readiness of plans for construction and operation, construction budget estimates, and operations budget estimates before making its decisions. Another issue brought before the subcommittee was that of maintaining distinct records of spending activities in the MREFC. Subcommittee members questioned the types of costs to be funded through the MREFC account because the differentiation between construction and operation is not always clearly defined.⁷ The Subcommittee noted that internal mechanisms needed to be created in order to prevent the combining of MREFC and RRA funds.

Audit of Funding for Major Research Equipment and Facilities

In May 2002, the NSF's Office of Inspector General (OIG) released a draft report, Audit of Funding for Major Research Equipment and Facilities.⁸ The report noted that the current policy for major research equipment and facilities projects is limited to only the MREFC and does not include major facilities for other programs in NSF. In addition, the existing guidelines stipulate a single financial review and do not offer directives on how the review should be conducted. Also, according to the audit, the current policies did not provide direction to NSF program mangers on how to address the problem of potential cost overruns. While federal guidelines require that the total cost of major research facilities be tracked through all stages of a project, NSF's policies and procedures did not provide full accounting costs in its financial reports in accordance with federal standards. Because of NSF's inconsistencies in tracking costs and funding sources of its major research facilities, the OIG recommended that NSF revise its policies and procedures by complying with the directives that were detailed in the FY2002 appropriation bill.

Congressional Activity

In June 2002, Congress requested the National Academy of Sciences (NAS) to review NSF's management of its large facility projects.⁹ The study began in February and examined how the NSF sets priorities in determining which competing projects to fund, and offered recommendations on how to strengthen the process. The recommendations are contained in a January 2004 report prepared jointly by the NSB and the NSF—Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation.¹⁰ At an October 2004 meeting of the NSB, the NSF was directed to begin implementation of the proposed large facility project review and prioritization process outlined in the report. The report revealed that in addition to there being a backlog of approved but unfunded projects, there was a lack of support for disciplines conducting idea-generating activities, and a lack of funding for conceptual development, planning, and design.

On March 8, 2012, the House Subcommittee on Research and Science Education held a hearing on the management and accountability concerns being raised relative to MREFC at NSF.¹¹ Testifying at the hearing was Jum Yeck, Project Director for IceCube, a MREFC facility. Yeck stated that the management of large facilities continues to evolve and improve; that the rules are "stabilizing"; and that considerably more confidence is being voiced in its management practices. He also stated that the director of any project ensures that proper project management and reporting systems are implemented. Also testifying was Cora B. Marrett, Deputy Director, NSF. Marrett reiterated that the NSB provides oversight during the complete life-cycle process for planning, constructing, operating, and possibly terminating support for a particular facility. This oversight occurs while simultaneously providing guidance between the balance for investments in research infrastructure and support for other NSF programs and activities. Marrett further explained the importance and necessity for external review committees to evaluate management capabilities and the need for investment in effective management techniques. She stated that

Project Management Control Systems are essential for determining the project's technically limited construction schedule and the associated funding profile, and so that, once in construction, the project manager can effectively ascertain technical and financial status, obtain a detailed picture of risks and contingency usage, and provide the necessary transparency to the agency needed to carry out an effective oversight role.¹²

Planning and Management Issues

The March 2011 report, Large Facilities Manual, details the procedures by which large facility research projects advance through a multi-phase internal and external review and approval process.¹³ According to the Manual, an MREFC Panel evaluates the projects based on, among other things, project definition; intellectual justification; connection to NSF strategic goals and priorities; life-cycle cost profile; partnerships; and project management plans, schedules, and reviews. Based on the review, the MREFC Panel submits to the NSF Director its recommendation on the project's relative importance, eligibility, and readiness, with readiness defined as its ability to be included in the upcoming budget request. The Director then makes the selection of projects based on (1) strength and substance of the information; (2) the appropriate balance among various fields, disciplines, or directorates; and (3) opportunities to leverage MREFC funds. The Director submits his selections to the NSB for project approval. After the NSB approves a project for future budget cycle funding, it prioritizes among the projects.¹⁴ On an annual basis, the NSB reviews all NSB-approved projects that have not been funded as yet to determine if any changes are necessary to the priority order of the projects.¹⁵ If a project is not approved, or if a project's plans are no longer determined to be "clearly and fully construction ready," the project will be returned to the preliminary design/readiness phase for additional work. A project can be resubmitted to the NSB the following year. While the NSB may approve a project for inclusion in a future budget request, it does not necessarily mean that it will receive funding in the upcoming budget request. It does indicate that the project is to be considered for inclusion, depending on current budget levels and constraints.

The 2012 NSF Facility Plan was presented to the NSB on February 2, 2012.¹⁶ The Plan covers readiness stage projects through those projects that are in the process of completion. In addition, the report includes NSF's support for major research infrastructure and the operational facilities that have received new or renewed awards, interrelationships among the portfolio of research facilities, life-cycle considerations, and sunsetting provisions. The 2012 Facility Plan describes NSF's goals and strategies for incorporating the existing approaches and practices into a system for selecting, managing, and overseeing large facility projects to make certain that a large facility is both constructed properly and is the appropriate facility to build. Included in the report also are detailed procedures for termination or renewal of a large facility. The Plan includes a multi-stage development, review, and approval process. NSF has designated four project evolution phases: (1) conceptual design review, (2) preliminary design review, (3) final design review (readiness), and (4) construction and operation. The projects under construction and those being considered for construction are indicative of NSF's long-term investment priorities for new capabilities and next-generation facilities that will "transform research in science and engineering." The NSF questions

Is the proposed project, when compared to other proposed projects—whether within the same field, across related fields, or across different fields—among the very highest priorities for potential new facilities?¹⁷

The 2012 Facility Plan describes a team approach and details the cooperation between the scientific and technical staff and the business operations staff. The lines of authority and responsibility are defined for the NSF Director, the participating Division Director, the NSF Program Manager, and the awardees' project director. In every large facility project, the NSF Program Manager, with the support of the participating Division Director, has primary responsibility for all aspects of management. In addition, the NSF Program Manager is responsible for determining whether the project director and project management staff have the necessary training and skills for working on the project.

Termination of a Major Research Project

The Rare Symmetry Violating Processes Project (RSVP) was initially NSB-approved for funding in October 2000, and was included in the FY2005 budget request as a new construction project. While the RSVP was in the design phase, an analysis revealed that there could be significant increases in construction and operating costs. The cost overruns generated interest from Congress and the international scientific community. An evaluation was conducted by scientific personnel internal and external to NSF in an attempt to resolve the cost increases in various elements of the project. In August 2005, on the recommendation from NSF management, the NSB terminated the RSVP. NSF determined that continued support for the RSVP would cause "unacceptable loss of research opportunities in elementary particle physics and other areas of science."¹⁸ The RSVP underwent a series of phase-out activities.

The March 2011 Large Facilities Manual includes a discussion of termination of a large facility. Language included in the report states that

To remain at the research frontier and support new facilities, NSF should retire existing facilities when the science they enable is of lower strategic priority than science that could be enabled by alternate use of the funds. Such decisions will be difficult to make, in part because of the number of stakeholders and interested parties, and will require extensive community consultation and input, which may come from "blue ribbon" panels, National Academies committees and professional societies. In some cases in which a facility can continue to be productive, it may be possible to transfer ownership to another agency, a university or a consortium of universities. It is the responsibility of the Directorate and Divisions to periodically review their facilities portfolio and to consider which facilities may have reached an appropriate end of NSF support.¹⁹

MREFC Support in the FY2013 Budget Request

The Major Research Equipment and Facilities Construction (MREFC) account receives $196.2 million in the FY2013 budget request,²⁰ slightly below the FY2012 estimated level of $197.1 million.²¹ The MREFC supports the acquisition and construction of major research facilities and equipment that extend the boundaries of science, engineering, and technology.²² According to NSF, it is the primary federal agency providing support for forefront instrumentation and facilities for the academic research and education communities. NSF states that "Modern and effective research infrastructure is critical to maintaining U.S. leadership in science and engineering. The future success of entire fields of research depends upon access to new generations of powerful research tools. Increasingly, these tools are large and complex, and have a significant information technology component."²³ NSF gives highest priority to ongoing projects, and second-highest priority to projects that have been approved by the NSB for new starts. To qualify for support, NSF required MREFC projects to have "the potential to shift the paradigm in scientific understanding."²⁴ The FY2013 request proposes support for the National Ecological Observatory Network, $98.2 million (NEON); Advanced Laser Interferometer Gravitational Wave- Observatory, $14.9 million (AdvLIGO);²⁵ Advanced Technology Star Telescope, $42.0 million (ATST); and the Ocean Observatories Initiative, $27.5 million (OOI).²⁶ Funds were not included in the budget request for the Atacama Large Millimeter Array (ALMA). The funding received for ALMA in the FY2012 appropriation ($3.0 million) was the final support required to complete the eleven-year project.²⁷

The NSF has instituted tighter standards and requirements for receiving funding in this account. Included in the more stringent procedures was the implementation of a "no cost overrun" policy for major projects.²⁸ All projects seeking funding and construction support in the MREFC must move through a series of detailed steps and "should be transformative in nature, with the potential to shift the paradigm in scientific understanding."²⁹ The cost estimates for projects developed at the preliminary design phase must include adequate contingencies. In the absence of such contingencies, any cost increase would result in reduction in scope for the project.³⁰ NSF states that

If total cost for a project is revised during construction for reasons other than inadequate funding, NSF will identify mechanisms for offsetting any cost increases in accordance with the no overrun policy. In addition, all of the projects funded through the MREFC account undergo major cost and schedule reviews as required by NSF guidelines.³¹

The following table provides funding levels for current and out-years for projects in the MREFC account.

Appendix.

Figure A-1. Advanced Laser Interferometer Gravitational-Wave Observatory (AdvLIGO) Total NSF Cost = $205.1 Million

Source: National Science Foundation, 2012 NSF Facility Plan, p. 22. Note: Movement of end-test mass vacuum chamber of AdvLigo.

Figure A-2. Advanced Technology Solar Telescope (ATST) Total NSF Cost = $297.9 Million

Source: National Science Foundation, 2012 NSF Facility Plan, p. 24. Note: ATST primary mirror blank with convex rear surface.

Figure A-3. National Ecological Observatory Network (NEON) Total NSF Cost = $433.7 Million

Source: National Science Foundation, 2012 NSF Facilities Plan, p. 31. Note: Sensor tower at NEON headquarters.

Figure A-4. Ocean Observatories Initiative (OOI) Total NSF Cost = $386.4 Million

Source: National Science Foundation, 2012 NSF Facility Plan, p. 33. Note: Deployment locations.

Footnotes