FRIDAY, OCTOBER 14, 2011
High crimes, deceit, and piracy in international health research
By Prathap Tharyan
Posted on October 14, 2011
The menace of piracy on the high seas, involving modern-day Somali-based seafaring pirates, continues to plague the nautical world.
What is puzzling is that an apparently motley crew of ill-equipped brigands could hold the combined naval and coast guard fleets of regional and global super-powers at bay, and their governments and people to ransom.
Even more spine-chilling are the tales, increasingly heard, of high crimes, deceit and piracy involving international drug cartels that use sophisticated, and often subtle, methods to deceive and avoid deception; as well as individual fraudsters whose methods, in retrospect, were sometimes clumsy.
Equally puzzling is the ineptitude of the world in deterring, detecting or dealing with research fraud, even though it affects the lives of many more people than piracy on the high seas does.
Exposing research fraud
In July 2005, a series of articles in the BMJ chronicled the perseverance of its previous editor, Richard Smith, who over a period of more than 10 years had attempted to investigate and publicly expose as fraudulent, the 1992 publication by Dr. Ram B. Singh, a private practitioner from Moradabad, India, and six co-authors. Singh had claimed that patients randomized to take a low-fat, fiber-rich diet had nearly half the risk of dying from any cause over a year’s follow-up, compared to those on a reduced fat diet alone.1
The journal’s actions included an editorial,2 a detailed account of its failed attempt to find a legitimate authority in India to investigate its concerns and adjudicate,3 a forensic-statistical investigation that concluded that the data from this paper were strongly indicative of fabrication,4 and an “expression of concern” about the validity of the paper.5
By then, this fraudulent article had already been cited 225 times in other research publications.3
In January 2006, the dean of research affairs at Seoul National University announced that the research reports published in 2004 and 2005 in the prestigious journal Science by Woo Suk Hwang and his co-workers were fabricated.
These reports, purporting to the production of the first stem cell line produced from a cloned human embryo, and the creation of 11 stem cell lines that genetically matched people with spinal cord injury, diabetes, and an immune system disorder, had been hailed at publication as seminal scientific breakthroughs in stem cell research.6
What was heralded as the dawn of a new age of novel treatments for a host of hitherto untreatable conditions, dramatically culminated in the international disgrace of one of South Korea’s national heroes.
SCIENTISTS BEHAVING ABYSMALLY
These, and many other, high-profile and scandalous instances of fraudulent research have blighted the image of health science researchers as objective and respected scientists in search of the truth.
While many scientists are above reproach and their work is laudable, scientific fraud appears to be on the rise. This is evidenced by a sharp increase in papers retracted in PubMed over the past decade due to research misconduct.7
Research misconduct (fabrication, falsification and plagiarism) is not restricted to the usual suspects, such as researchers from India or China, but involves virtually every country where research is undertaken. In one survey, papers identified as retracted in PubMed due to research misconduct, rather than errors, involved more US authors than from other countries.8 This startling revelation could merely reflect the North American preponderance of journals indexed in PubMed, and, perhaps, greater alertness by their peer-reviews, editors, and readers in suspecting and confirming research fraud.
REPEAT OFFENDERS OR ISOLATED OFFENSES?
The BMJ editorial and related articles also raised suspicions about many of Singh’s previous publications.
In the same month and year as the BMJ exposed Dr. Ram B. Singh, the Lancet published an “expression of concern” by its editor, Richard Horton, with details of the investigations and findings that indicted Dr. Singh of fabricating a previous Lancet paper.9
Earlier in February 2005, the editor of Nutrition retracted as fraudulent, a 2001 paper by a Canadian researcher who now lives and works in India, Ranjit Kumar Chandra.10
In this publication, Chandra claimed that elderly people randomized to physiological amounts of vitamins and trace elements had improved cognitive functions compared to those given a placebo. This paper had been earlier rejected by the BMJ due to concerns about data fabrication during peer review.
Serious doubts were also expressed in 2003 about another similar study by Chandra published in in 1992 in the Lancet that had been cited more than 300 times.10 In 2006, the Canadian Broadcasting Corporation aired serious doubts about several of Dr. Chandra’s other previous publications.10
From 2000 to 2010, PubMed identified 788 research studies in the English language as having being retracted by journals, mostly due to errors or for ambiguous reasons. However, 27% of these retractions were for data fabrication, falsification, or data plagiarism, and less commonly due to plagiarism of the ideas or the words of others.
As in the cases of Singh and Chandra, approximately 53% of these fraudulent retracted papers were by repeat offenders with prior retracted publications.8
Investigating previous publications by fraudulent authors is necessary, but proving fraud is often difficult. When an detailed investigation does occur, as it did with John Darsee, a one-time protégé of the eminent Harvard cardiologist Eugene Braunwald, over 100 of his previous studies were also found be fabricated.10
THE IMPACT OF FRAUDULENT RESEARCH
Fraudulent research is often published in prestigious journals with high Impact Factors. Fraud is difficult to prove as fabricated or falsified papers are often indistinguishable from non-fraudulent ones.
Even if suspicions of fabrication are substantiated, over a third of fraudulent papers are either never retracted, or are slow in being retracted; particularly when senior researchers are implicated.
Such retractions are also not readily evident, as the statement of concern or retraction appears in subsequent issues of the journal, and the fraudulent article continues to be available unaltered. The PubMed abstract for the fraudulent paper carries a citation and link to the journal’s statement of retraction, or concern; but this is usually identified as a comment rather than a retraction. Even if these links are checked, access to the content of the comment may be limited by access to the journals, if they are not open access publications.
Fraudulent papers, even if retracted, continue to be cited and influence subsequent research.
One conservative estimate identified over 5000 citations in 851 secondary studies to 180 primary studies involving clinical research in humans that were identified as retracted due to fraud in PubMed. The 180 retracted fraudulent primary studies enrolled 28,000 people, 9189 of whom were in the treatment arms; the 851 secondary studies which cited a retracted paper enrolled 400,000 people, of whom 70,501 patients were allocated to the dubious experimental interventions.11
In another example, a retracted paper continued to be cited in high impact journals even as long as 24 years after retraction.12
Given the likelihood that many fraudsters were repeat offenders, it is worrying that these numbers reflect only a fraction of the actual number of fraudulent primary research publications.
Also inestimable is the number of secondary publications that cite them or test the effects of supposedly effective and safe treatments on unsuspecting research subjects.
Even if not evaluated in further research, using the results of fraudulent research may result in harm, or deny people the benefits of alternative and better proven interventions.
DEALING WITH RESEARCH MISCONDUCT
Investigating and dealing firmly with research misconduct is important, but the question of who should investigate is far from clear.
Richard Smith and the BMJ served as whistle-blowers in the Singh case but, as Smith argues, while journals do have a duty to inform its readers, they do not have sufficient legitimacy to investigate or to initiate due process.10
Journals are well advised to have an ethics committee to provide independent guidance regarding the complex ethical issues journals and editors’ face. This helped the BMJ decide on making public the dismal saga involving Singh.13
The organization ideally placed to initiate investigations when fraudulent research is suspected or reported is the employing institution, often a medical college, university, or hospital.2
Unfortunately, it is highly doubtful whether most such institutions in India, or in other resource constrained countries, have established processes or mechanisms, or the will, to deal with issues pertaining to breaches of research integrity. The situation becomes more complex when the accused is also part of the management, or the head as in the case of Singh, of a private institution.
Regulatory bodies such as the Office of the Drug Controller General of India, and the Medical Council of India, as well government agencies such as the Indian Council of Medical Research (ICMR), and its parent organization, the Department of Health Research, could promulgate measures to investigate and deal with allegations of research misconduct.
However, unless the many draft bills currently languishing in parliament that pertain to these agencies include effective statutory provisions to deal with such allegations, it is inconceivable that these bodies will be empowered effectively to deal with allegations of research misconduct.
The Medical Council of India, in its current and future avatars, needs to consider dealing with researchers accused of misconduct as a legitimate activity within its purview; but even if that unlikely event does miraculously happen, mechanisms to deal with fraudulent research by non-medical researchers are also needed.
Research misconduct and violation of human rights
The National Human Rights Commission (NHRC) has the powers of a civil court and can summon records in the public domain. It can initiate investigations into allegations of violations of human rights or their abetment, or negligence by a public servant in preventing such violations.
In the investigations into the allegations against Singh, the NHRC forwarded the complaint from the BMJ to the Indian Council of Medical Research that in turn pleaded inability to take disciplinary action against a person not employed by the ICMR.3
If the study in question was funded by the ICMR, or another funding agency, then the funding agency could initiate the request for an investigation, but would require the full cooperation of the accused researcher and implicated co-researchers, as well as the host institution(s).
Hopefully, the NHRC will see it fit to initiate investigations, should allegations of misconduct be received in the future, since it appears that no other organization in India is willing, or equipped, to deal with allegations of this nature.
Undertaking research on human subjects and falsifying results, or publishing fraudulent research in the public domain that can harm others, is surely a violation of the human rights of numerous people.
However, Chapter VII, 36 (2) of the Protection of Human Rights Act, 1993 [As amended by the Protection of Human Rights (Amendment) Act, 2006–No. 43 of 2006] limits the period of enquiry that the NHRC or a state commission is empowered to deal with, to within a year of commitment of the violation.
Greater clarity is needed in determining what exactly this means in the context of investigating allegations of research misconduct.
The NHRC is also mandated in Chapter III, 12 (g) of the above Act to “undertake and promote research in the field of human rights.”
The link to “Research Studies and Projects” in the website of the NHRC details the many completed research studies and those in progress. However, none deal with any aspect of research misconduct.
CAN YOU HELP?
Are you concerned about the issues raised in this blog-post?
Are there legal experts out there who are willing to provide advice on what legal mechanisms one can employ to deal with allegations of research misconduct, should institutional mechanisms fail?
Are there young researchers interested in approaching the NHRC or the ICMR to seek sponsorship to undertake qualitative and quantitative research regarding research misconduct in India?
Are you aware of any initiatives to prevent research misconduct and if such initiatives have had any measured outcomes or impact?
Is anyone interested in registering a title and undertaking a systematic review (perhaps jointly undertaken by the Cochrane Collaboration and the Campbell Collaboration) on “Interventions to prevent research misconduct”? Neither The Cochrane Library nor The Campbell Library currently contains such a systematic review.
If the answer to any of the above questions is affirmative, do post a comment.
Also do watch this space for more blog-posts on: Deception in international health research, and on a hitherto unknown international detective agency that is working tirelessly to expose high crimes, deceit, and piracy in international health research.
About the author:
Prathap Tharyan is Professor of Psychiatry at the Christian Medical College, Vellore, Tamil Nadu, India. He is also Director of the South Asian Cochrane Network & Centre, an independent Centre of the Cochrane Collaboration. Evidence-Informed Musings is an activity of the Effective Health Care Research Consortium.
The views expressed in this blog-post are those of the author and are not necessarily shared by any of the organizations named herein, their partners, or any funding agency.
E-mail the author at: email@example.com.
1. Singh RB, Rastogi SS, Verma R, Laxmi B, Singh R, Ghosh S, et al. Randomised controlled trial of cardioprotective diet in patients with recent acute myocardial infarction: results of one year follow up. BMJ. 1992 Apr 18;304(6833):1015-9.
2. Smith J, Godlee F. Investigating allegations of scientific misconduct. BMJ. 2005 Jul 30;331(7511):245-6.
3. White C. Suspected research fraud: difficulties of getting at the truth. BMJ. 2005 Jul 30;331(7511):281-8.
4. Al-Marzouki S, Evans S, Marshall T, Roberts I. Are these data real? Statistical methods for the detection of data fabrication in clinical trials. BMJ. 2005 Jul 30;331(7511):267-70.
5. Expression of concern. BMJ 2005;331:266.
6. Smith R. Research misconduct: the poisoning of the well. J R Soc Med. 2006 May;99(5):232-7.
7. Steen RG. Retractions in the scientific literature: is the incidence of research fraud increasing? J Med Ethics. 2010 Apr;37(4):249-53.
8. Steen RG. Retractions in the scientific literature: do authors deliberately commit research fraud? J Med Ethics. 2010 Feb;37(2):113-7.
9. Horton R. Expression of concern: Indo-Mediterranean Diet Heart Study. Lancet. 2005 Jul 30-Aug 5;366(9483):354-6.
10. Smith R. Investigating the previous studies of a fraudulent author. BMJ. 2005 Jul 30;331(7511):288-91.
11. Steen RG. Retractions in the medical literature: how many patients are put at risk by flawed research? J Med Ethics. 2011 May 17. [epub ahead of print].
12. Korpela KM. How long does it take for the scientific literature to purge itself of fraudulent material?: the Breuning case revisited.Curr Med Res Opin. Apr;26(4):843-7.
13. Wager E. Experiences of the BMJ ethics committee. BMJ. 2004 Aug 28;329(7464):510-2.