NAS Statement on Secretary Scott Pruitt's Proposed Rule Change

National Association of Scholars

The National Association of Scholars welcomes Secretary Scott Pruitt’s announcement of a proposed rule change at the Environmental Protection Agency. The new rule requires that “When promulgating significant regulatory actions, the Agency shall ensure that dose response data and models underlying pivotal regulatory science are publicly available in a manner sufficient for independent validation.” The NAS has long been concerned about politicized distortions of dose-response science, and our just-released report The Irreproducibility Crisis: Causes, Consequences, and the Road to Reform urges that the Federal government require that only properly reproducible science be used as a basis for regulatory action. We are delighted that Secretary Pruitt’s proposed action addresses two of our priorities. We are also gratified that Secretary Pruitt has provided proper flexibility in the application of this new principle. The proposed rule allows the EPA Administrator to grant exemptions on a case-by-case basis.

The NAS urges Federal agency heads to take steps similar to Secretary Pruitt’s initiative. Legislators must also act to ensure that Federal policy is based on reproducible science. We recommend five changes in the way government funds and regulates science.

  1. Government granting agencies should fund more studies of publication bias, more re-examinations of the statistical operations underlying older studies, and more studies of the effects of groupthink. These agencies should prioritize funding for these studies. They should also prioritize funding for research on improving experimental design techniques.
  2. Federal legislators should dedicate funding for programs to broaden statistical literacy in primary, secondary, and post-secondary education. They should fund basic classes in statistical literacy for all high school and college students and advanced statistics education for students specializing in the sciences and social sciences.
  3. Legislators should fund infrastructure to allow scientists to make their work completely reproducible. These should include the creation of standardized descriptions of scientific materials and procedures, standardized statistics programs, and standardized archival formats. Policymakers should fund the infrastructure to create born-open data, facilitate pre-registered research protocols, and fund journals dedicated to negative results.
  4. Policymakers should work with reform-minded professionals in each discipline to draft policies to condition government funding on scientists adopting best existing practices to deal with the reproducibility crisis. They should institute regulations that require grant-seekers to adopt standardized materials and techniques, born open data, and preregistered research protocols. In a world of scarce funding, policymakers should prioritize funding for science done properly.
  5. Policymakers should require all new science regulations be founded on research that meets strict reproducibility standards. Congress should pass a Reproducible Science Reform Act that requires all future regulations to be based on such standards. Policymakers should not make policy informed by scientific research unless they are sure that research can be reproduced.

Secretary Pruitt’s commendable initiative complements a great deal of excellent work by scientists, businesses, and private foundations to improve scientific reproducibility. Further work by the Federal government can and must complement the work Secretary Pruitt has begun.

Image Credit: Tim Evanson

  • Share

Most Commented

October 31, 2023


University of Washington Violated Non-Discrimination Policy, Internal Report Finds

A faculty hiring committee at the University of Washington “inappropriately considered candidates’ races when determining the order of offers,” provided “disparate op......

January 24, 2024


After Claudine

The idea has caught on that the radical left overplayed its hand in DEI and is now vulnerable to those of us who seek major reforms. This is not, however, the first time that the a......

December 9, 2023


The Presidents and Academic Freedom

What are the boundaries of “free speech?” They are pretty much the same as the boundaries of civilization. Savages need not apply....

Most Read

May 15, 2015


Where Did We Get the Idea That Only White People Can Be Racist?

A look at the double standard that has arisen regarding racism, illustrated recently by the reaction to a black professor's biased comments on Twitter....

October 12, 2010


Ask a Scholar: What is the True Definition of Latino?

What does it mean to be Latino? Are only Latin American people Latino, or does the term apply to anyone whose language derived from Latin?...

September 21, 2010


Ask a Scholar: What Does YHWH Elohim Mean?

A reader asks, "If Elohim refers to multiple 'gods,' then Yhwh Elohim really means Lord of Gods...the one of many, right?" A Hebrew expert answers....