David Randall: A Brief Reply to Zeke Hausfather

David Randall

Zeke Hausfather, Research Scientist at Berkeley Earth, wrote a comment to dispute NAS’s rendition of the debate between John Bates and Tom Karl about the reproducibility of National Oceanic and Atmospheric Administration (NOAA) climate data. Irreproducibility Crisis co-author David Randall replies briefly.

I welcome Mr. Hausfather’s civil critique of The Irreproducibility Crisis’s discussion of the John Bates/Tom Karl debate about proper archiving procedures at NOAA.

The Irreproducibility Crisis drew on John Bates’ February 4, 2017 discussion of the issues at Climate Etc. The crucial paragraph of Bates’ original article is this:

In 2013, prior to the Karl study, the National Climatic Data Center [NCDC, now the NOAA National Centers for Environmental Information (NCEI)] had just adopted much improved processes for formal review of Climate Data Records, a process I formulated [link]. The land temperature dataset used in the Karl study had never been processed through the station adjustment software before, which led me to believe something was amiss. When I pressed the co-authors, they said they had decided not to archive the dataset, but did not defend the decision. One of the co-authors said there were ‘some decisions [he was] not happy with’. The data used in the K15 paper were only made available through a web site, not in digital form, and lacking proper versioning and any notice that they were research and not operational data. I was dumbstruck that Tom Karl, the NCEI Director in charge of NOAA’s climate data archive, would not follow the policy of his own Agency nor the guidelines in Science magazine for dataset archival and documentation.

Mr. Hausfather’s critique draws significantly upon the response he drafted the next day, on February 5, 2017. Readers interested in the details of the debate should also see the counter-responses to Mr. Hausfather, and other critics, posted on Climate Etc. on February 6, 2017.

Mr. Hausfather’s reply does not address “the specific technical details of the data archiving procedures associated with the Karl et al paper,” which are the nub of the matter. The construction of datasets like those used in climate science is a complex process, and Karl failed to follow his agency's established procedures for documentation and quality control, which had been instituted due to past problems with data quality. It is not at all clear that the data now available on the FTP site to which Mr. Hausfather links are sufficient to allow reproduction of Karl et al. 2015.

The NAS shares Dr. Hausfather’s concern that climate science should be properly reproducible. It remains unclear to us whether Karl’s 2015 paper met that standard.


Image Credit: David Randall

  • Share

Most Commented

January 9, 2023


NAS Celebrates the Nomination of Reform-Minded Trustees to the New College of Florida Board

The National Association of Scholars is delighted with Governor Ron DeSantis’ nomination of six education reformers to the Board of Trustees of the New College of Florida....

December 7, 2022


New Study Tracks Rise of DEI in STEM Departments, Associations, Grants, and Literature

A new study published today by the National Association of Scholars, Ideological Intensification, offers an in-depth quantitative analysis of just how far DEI has advanced into STEM fields....

January 5, 2023


NAS Condemns the Attacks against Jordan Peterson

The National Association of Scholars condemns the unrelenting illiberal attacks being levied against Dr. Peterson and against anyone who dares push back against the enemies of intellectual f......

Most Read

May 15, 2015


Where Did We Get the Idea That Only White People Can Be Racist?

A look at the double standard that has arisen regarding racism, illustrated recently by the reaction to a black professor's biased comments on Twitter....

October 12, 2010


Ask a Scholar: What is the True Definition of Latino?

What does it mean to be Latino? Are only Latin American people Latino, or does the term apply to anyone whose language derived from Latin?...

March 22, 2023


How Many Confucius Institutes Are in the United States?

UPDATED: We're keeping track of all Confucius Institutes in the United States, including those that remain open, those that closed, and those that have announced their closing....