Sunday, October 8, 2023

Is it Defamation to Point Out Scientific Research Fraud?

A few weeks ago, I wrote about Francesca Gino, a researcher on dishonesty who last month was placed on administrative leave from Harvard Business School after allegations of systematic data manipulation in four papers she co-authored. The alleged data manipulation appeared, in a few cases, chillingly blatant. Looking at Microsoft Excel version control (which stores old versions of a current file), various rows in a spreadsheet of data seem manipulated. The data before the apparent manipulation failed to show evidence of the effect the researchers had hoped to find; the data after it did.

In total, three researchers — Joe Simmons, Leif Nelson, and Uri Simonsohn — published four blog posts to their blog Data Colada, pointing out places where the data in these papers shows signs of being manipulated. In 2021, they also privately reported their finding to Harvard, which conducted an investigation before placing Gino on leave and sending retraction notices for the papers in question.

Gino is now suing the three researchers who published the blog posts pointing out the alleged data manipulation, asking for “not less than $25 million.” (She is also suing Harvard.) Her argument is that because of the allegations of fraud, she lost her professional reputation and a lot of income. (Harvard Business School professors can make a lot of money through speaking appearances and book deals). I reached out to Gino for comment earlier this week but did not hear back before publication deadline.

Gino’s lawsuit argues that the researchers failed to consider other explanations for the “anomalies” in the data sets analyzed; that Harvard’s investigation into the allegations was “unfair and biased,” and that Harvard’s punishment was “overly harsh” — harsher than similar punishments when male professors were credibly accused of research misconduct.
Checking papers for data manipulation is good work

While Harvard, an institution with an endowment of more than $50 billion, has plenty of resources to defend itself, the lawsuit also targets Simmons, Nelson, and Simonsohn personally. They’re academics, and they’re not billionaires. Having to defend themselves in a defamation lawsuit is likely to be a substantial imposition for them.

Does Gino actually stand a chance of winning millions from them if the case goes to trial? Probably not.

If their statements are statements of opinion (“from comparing the data sets, I feel that Ms. Gino’s work was manipulated” would be an example of a statement of opinion), they are defensible. If they are statements of fact (like “the data in Table 3 has been manipulated in Excel to change the result”) and they are true, then they cannot be defamatory. If they’re false but the authors weren’t negligent in their publication (for instance, if they can substantiate their claims with adequate sourcing and that they considered other perspectives), then they may be defensible.

The problem, though, is that it will take years — and be extraordinarily expensive — to settle the factual question in court of whether the statements are true. “Your goal [as a defendant in a defamation case] is generally not ‘I’m going to win this at trial.’ Your goal is ‘I’m going to knock this out at the pretrial stage”,” attorney Ken White told me. “What you want is to be able to get away from all the stress and extreme expense of going through a defamation case and discovery; you want to knock it out at a motion to dismiss the case.”

But at that stage, the courts won’t evaluate complex questions of fact, like whether data was in fact manipulated. You can get a case dismissed by arguing successfully that your statements were statements of opinion, but a debate that turns on whether they are true or false may well go to trial. White says, “It’s very rare you can win a motion to dismiss on the theory, ‘Actually this was true.’”

“The process is the punishment”

Having read her case and spoken to defamation experts, I think Gino is unlikely to win at trial.

Gino would have to demonstrate that the claims the bloggers made aren’t true and that the bloggers should have known that. But the details contained in her lawsuit provide far more evidence that shows it was more likely that their claims were true and/or that they were not negligent in reaching those conclusions. Included in the appendices to the lawsuit are the analyses of the study data by an independent forensic firm Harvard hired to examine the situation. While the Data Colada researchers had to rely on public data for their analysis, they hypothesized that Harvard would be able to get more data from Qualtrics and other sources and compare it to the public data to find more evidence about whether manipulation happened. It appears that that’s exactly what Harvard did.

“The analysis of files demonstrated an apparent series of manipulations to a dataset prior to its publication ... Both the earlier version and the latest version of the data available for review were created in 2012 by Dr. Gino, and last saved by Dr. Gino, according to their Excel properties,” the forensic review of the 2014 paper concludes.

“There appear to be multiple discrepancies in certain score sets between the original data source (“Qualtrics Data”) and public repository data associated with the 2020 JPSP Paper (“OSF data”). ... Utilizing the same analyses for the Qualtrics data demonstrates that outcomes a) appear contrary to reported study effects, and b) have lower (or no) statistical significance,” the review of the 2020 paper concludes.

At this point, multiple independent examinations of the data have concluded that it appeared manipulated, in many cases in ways that made the authors’ hypothesis come true. This occurred across multiple papers that Gino co-authored.

Truth is always a defense to block defamation claims. But the lawsuit can still substantially harm the defendants even if the courts eventually find that they were telling the truth. “The system is so broken ... that a case like this will cost hundreds of thousands of dollars and go on for years,” White told me. “Realistically, you could wind up going to trial, and even if you’re going to win at trial eventually you’re going to be ruined doing it.”

“The process,” he added, “is the punishment.”

by Kelsey Piper, Vox |  Read more:
Image: Maddie Meyer/Getty Images
[ed. This story has been making the rounds lately, and for good reason. What happened to the time-honored tradition of investigating scientific replicability? Probably a couple things: 1) the kind of intimidation/retribution/professional mud-wrestling spectacle we see here; and 2) the glamour (and grant money) of discovering something new rather than retreading/verifying other researcher's work. Not the way science is supposed to operate. See also: A disgraced Harvard professor sued them for millions. Their recourse: GoFundMe.]