The subhead lays out the argument: “Ivermectin is a promising COVID treatment and prophylaxis, but the agency is denigrating it.”
In their article, the authors assert:3
The statistically significant evidence suggests that [ivermectin] is safe and works for both treating and preventing the disease. … Moreover, the drug can help prevent Covid-19. … If the FDA were driven by science and evidence, it would give an emergency-use authorization for ivermectin for COVID-19. Instead, the FDA asserts without evidence that ivermectin is dangerous.
If you had read this article in July 2021, you might have been left wondering—as have some of my patients—why physicians have been reluctant to recommend ivermectin to treat COVID-19. I don’t think of the average reader of The Wall Street Journal as a firebrand. That said, the online version of the article received 1,430 comments, many of which asserted the FDA response had been engineered by vaccine manufacturers seeking to enhance their profits.
In the byline, the article referenced the lead author’s affiliation with the Hoover Institution, “a public policy think tank that seeks to improve the human condition by advancing ideas that promote economic opportunity and prosperity, while securing and safeguarding peace for America and all mankind.”4 The article seems beyond reproach. Indeed, you would have to do quite a bit of homework to figure out that most of the article is misleading—or just plain wrong.
For example, only the most loyal readers of The Wall Street Journal probably noticed that two days after the article appeared, the authors published an erratum:
We, the authors … have egg on our faces. Relying on a summary of studies published in the American Journal of Therapeutics, we quoted the results from a study of 200 healthcare workers. After our article was published, we learned that this study, by Ahmed Elgazzar of Benha University in Egypt, has recently been retracted due to serious charges of data manipulation.
Perhaps the authors shouldn’t have felt too bad. On the one hand, Hoover Institute research fellows should have known better than to cite data from a review article without reviewing the original article—the academic equivalent of citing Wikipedia as a reference. That said, the claims made by Elgazzar’s group were dramatic: 94% of patients with severe COVID-19 improved after only four days of treatment with intravenous ivermectin, which was associated with a 10-fold improvement in mortality. Moreover, prophylactic treatment with ivermectin decreased the rate of transmission to close contacts from 10% to 2%.5
The results of the study were so impressive that, in preprint form, it was widely referenced by those who argued that vaccination was not the only way out of the pandemic. All told, the preprint was eventually cited by four meta-analyses and 20 scientific publications, in addition to The Wall Street Journal article.6
Had Henderson and Hooper read Elgazzar’s article for themselves, they might have picked up on the oddly stilted writing. Apparently, the non-idiomatic phrasing was due to the authors’ liberal use of a thesaurus to replace keywords, to obscure the fact that their introduction was largely lifted from websites and press releases. Severe acute respiratory syndrome, for example, became extreme intense respiratory syndrome.
With a little more digging, Henderson and Hooper might have noticed even more discrepancies:7
- The raw data included three children, although the article claimed to have studied only adults;
- The raw data recorded patient deaths that had not been reported in the final paper; and
- The raw data indicated that most of the deaths included in the study analysis occurred before the first subject had been enrolled.
All of these issues were noticed by Jack Lawrence, a student in the biomedical science program at St. George’s University of London, who read the article for a class he was taking. Further sleuthing revealed that numerous subjects in the control group had been cloned. Approximately 80 patients had their data entered more than once; the entries had been duplicated, down to the patient’s initials and typographical errors.8 Both Mr. Lawrence and The Guardian contacted Research Square, the company that hosted the preprint, regarding their concerns; the next day, the preprint was withdrawn.9
I, personally, have patients who have refused coronavirus vaccination based, in part, on their faith in ivermectin, hydroxychloroquine & other pipe dreams. It is truly sobering to think how many deaths during this pandemic may be attributable to fraudulent studies.
By that time, unfortunately, the damage had been done. The fraudulent study was so large and the findings so significant that it overwhelmed every analysis that included it. Even now, many articles, such as the original opinion piece that appeared in The Wall Street Journal, reference Elgazzar’s paper as proof of ivermectin’s promise. These articles, in turn, have influenced policy makers and public forums, much to our detriment.
The Ivermectin Experience
Elgazzar’s study is not the only one that supported the use of ivermectin for the treatment of COVID-19. That said, many other ivermectin studies have also been tainted by allegations of fraud.
One large study from Lebanon was retracted after it was found that the analysis was based, accidentally, on a test data set, comprising information from the same seven patients repeated numerous times. Other large studies from Iran and Italy have demonstrated inconsistencies indicating a lack of randomization. A study from Brazil was called into question when one of the hospitals listed as a study site reported that it had not participated in the trial.10
A review of 26 randomized controlled trials examining the use of ivermectin for COVID-19 found that 10 had obvious evidence of fraud (e.g., identical data used for multiple patients, evidence of non-random treatment allocation, mathematical errors or lack of approval by local regulatory agencies). Approximately half of the studies refused to share their raw data for independent review.11
Fame and fortune are the obvious motivations for committing fraud. Last year, a joke regarding a manuscript submitted to a journal for publication was circulating on the internet: the article had failed to include the words SARS, coronavirus or COVID; because this was an obvious oversight, the article was being returned immediately to the authors for revision. Particularly early in the pandemic, when we knew nothing, I think it’s safe to say that the threshold for publishing an article on SARS-CoV-2 was lower than usual. Because faking a 500-subject study is not 10 times harder than faking a 50-subject study, the temptation to commit fraud was likely too great for some.
The ivermectin experience has called into question how meta-analyses are conducted. It is standard practice to conduct a meta-analysis based on summary data alone. Given the dubious quality of many ivermectin studies, future meta-analyses may require a review of individual patient data from each included study to protect such analyses from using falsified information.12
Such data reviews may become standard for primary research articles as well. The peer review process was never designed to identify fraud. The ivermectin experience shows us this needs to change. In the future, requiring all clinical trials to submit their raw data for statistical analysis prior to publication will likely become standard.
More broadly speaking, the ivermectin experience has also demonstrated the importance of ethics training for physicians and for anyone involved in the conduct of clinical trials. As someone who has doodled his way through more lectures on autonomy, beneficence and justice than he can count, I am the last person to suggest another mandatory module. Instead, I hope someone takes the ivermectin experience as impetus to create a new approach to teaching medical ethics that highlights how fraudulent research has impacted all of our lives.
I personally have patients who have refused coronavirus vaccination based, in part, on their faith in ivermectin, hydroxychloroquine and other pipe dreams. It is truly sobering to think how many deaths during this pandemic may be attributable to fraudulent studies.
Publishers, academic institutions and professional societies need to ensure that punitive penalties are attached to fraudulent research, beyond the usual effete gnashing of teeth. Policing our colleagues’ work is always uncomfortable, but throughout the pandemic, we have asked for our patients’ trust; now, we need to make certain that we have earned it.
Philip Seo, MD, MHS, is an associate professor of medicine at the Johns Hopkins University School of Medicine, Baltimore. He is director of both the Johns Hopkins Vasculitis Center and the Johns Hopkins Rheumatology Fellowship Program.
References
- Lee BY. ‘Vaccine police’ founder claims drinking urine is COVID-19 antidote. Forbes. 2022 Jan 10.
- Merck statement on ivermectin use during the COVID-19 pandemic. Merck. 2021 Feb 4.
- Henderson DR, Hooper CL. Why is the FDA attacking a safe, effective drug? The Wall Street Journal. 2021 Jul 28.
- About Hoover. Hoover Institution.
- Elgazzar AG, Hany B, Yousssaf SMA, et al. Efficacy and safety of ivermectin for treatment and prophylaxis of COVID-19 pandemic [withdrawn]. Research Square.
- El-Gazzar AG, Hany B, Yousssaf SMA, et al. Efficacy and safety of ivermectin for treatment and prophylaxis of COVID-19 pandemic. Scite. 2020.
- Davey M. Huge study supporting ivermectin as COVID treatment withdrawn over ethical concerns. The Guardian. 2021 Jul 15.
- Brown N. Some problems in the dataset of a large study of ivermectin for the treatment of COVID-19. Nick Brown’s blog. 2021 Jul 15.
- Lawrence J. Why was a major study on ivermectin for COVID-19 just retracted? Grftr. 2021 Jul 15.
- Piper K. How bad research clouded our understanding of COVID-19. Vox. 2021 Dec 17.
- Schraer R, Goodman J. Ivermectin: How false science created a COVID ‘miracle’ drug. BBC. 2021 Oct 6.
- Lawrence J M, Meyerowitz-Katz G, Heathers JAJ, et al. The lesson of ivermectin: Meta-analyses based on summary data alone are inherently unreliable. Nature Medicine. 2021 Sep;27:1853–1854.