Risk of cystic fibrosis clinical trial ending uninformatively

How can we estimate the risk of a cystic fibrosis clinical trial ending uninformatively from the protocol?

Clinical trials are the cornerstone of advancing medical knowledge and patient care. However, the risk of clinical trial failure looms large, and this is especially critical for cystic fibrosis, a rare inherited genetic condition that causes breathing and digestive problems.

Cystic Fibrosis (CF) trials come with a unique set of challenges. Trials are complex, time-consuming, and expensive. Recruitment is difficult. It is important that trials are conducted in a way that is likely to deliver informative results.

We are working with the definition of “informativeness” proposed by Zarin et al in Harms From Uninformative Clinical Trials, JAMA 2019.[1] You can read more about how the Clinical Trial Risk Tool quantifies the risk of a trial ending without delivering informative results in our article in Clinical Leader.

A CF trial which fails to deliver informative results can have serious implications, both financially and, more importantly, for the patients who have been waiting for an effective treatment.

One of the significant issues affecting CF clinical trial outcomes is their informativeness - the ability of a trial to guide clinical, policy, or research decisions. A study by Hutchinson et al,[3] investigating trial informativeness, found only 26.4% of trials met four conditions for informativeness, adding a significant factor to the risk profile.

A pivotal question that arises is this: Is there a way to quantify the risk of an uninformative outcome associated with a CF clinical trial from its protocol?.

Fast Data Science’s Clinical Trial Risk Tool hopes to provide this estimate. The tool combines the lessons learned from past trials with state-of-the-art machine learning algorithms to predict trial risk from the protocol text.

This approach allows us to identify potential risks early in the trial design process and adjust accordingly, increasing the trial’s chances of informative completion.

The development of such a risk prediction tool becomes increasingly important given the cost and implications of CF clinical trials. Each trial, potentially costing more than £100,000 per patient per year, represents a significant investment.

Machine learning offers us the opportunity not just to cut costs and time in CF clinical trials, but to significantly increase our chances of success. It enables us to make better-informed decisions right at the start and control the risk parameters throughout.

References

  1. Zarin, Deborah A., Steven N. Goodman, and Jonathan Kimmelman. Harms from uninformative clinical trials. JAMA 322.9 (2019): 813-814.
  2. Halpern, Scott D., Jason HT Karlawish, and Jesse A. Berlin. The continuing unethical conduct of underpowered clinical trials. JAMA 288.3 (2002): 358-362.
  3. Hutchinson N, Moyer H, Zarin DA, Kimmelman J. The proportion of randomized controlled trials that inform clinical practice. Elife. 2022 Aug 17;11:e79491. doi: 10.7554/eLife.79491. PMID: 35975784; PMCID: PMC9427100.
  4. Wood TA and McNair D. Clinical Trial Risk Tool: software application using natural language processing to identify the risk of trial uninformativeness. Gates Open Res 2023, 7:56 doi: 10.12688/gatesopenres.14416.1.

Other clinical trial risk, cost, informativeness, and complexity assessments