We have developed a machine learning and rule-based tool using natural language processing which allows a user to upload a trial protocol, and which categorises the protocol as high, medium or low risk of ending uninformatively. The tool is at https://clinicaltrialrisk.org/tool and is open-sourced on Github. You can read an explanation of how the tool works here, and a description of how we validated its accuracy here.
There are several indicators of high risk of uninformativeness which can be identified in a protocol, such as a lack of and or an inadequate statistical analysis plan, use of non-standard endpoints, or the use of cluster randomisation. One of the most common causes of a trial ending uninformatively is underpowering. Low-risk trials are often run by well-known institutions with external funding and an international or intercontinental array of sites. These indicators can be referred to as features or parameters.
This project is an initial Proof of Concept (POC) which to showcase what is possible with natural language processing, with a view to moving towards a more comprehensive main project which may identify a more complete set of cost, complexity, or uninformativeness risk factors.
The tool is designed with a feedback form so that inaccurate data extractions can be reported back to the developers.
In addition the MIT License means that you are free to add features or extend the scope of the tool.
We hope that researchers who are considering submitting a protocol of a trial to a prospective source of funding will be able to use the tool as a kind of checklist to ensure that their trial is designed to reduce risk and increase the prospects of being funded.
Creating clinical trial budgets from protocols Creating a clinical trial budget is a fiddly and time consuming process. The playbook for running the clinical trial is a document called the protocol. You can find examples of protocols here. The protocol states how many participants will take part in the trial and also what visits and procedures will take place. Above: a protocol. Source: NCT04128579 A clinical trial manager must read the protocol and look for all pieces of information in the protocol that is relevant to the budget, in particular the Schedule of Events (also called Schedule of Assessments or Schedule of Activities), which is a table or series of tables which indicate which procedures and assessments will take place on which the visits.
We have improved the Clinical Trial Risk Tool in the last 6 months, making it more user friendly and taking on board the feedback that we’ve received. We’ve improved the accuracy of the machine learning components too. The tool now outputs its key figures such as risk levels and estimated cost in easily readable cards, so you can see at a glance the key takeaways from your protocol: The risk factors are now organised into collapsible categories, so you can explore them easily without an information overload.
Guest post by Safeer Khan, Lecturer at Department of Pharmaceutical Sciences, Government College University, Lahore, Pakistan Introduction The success of a clinical trial is strongly dependent on the structure and coordination of the teams managing it. Given the high stakes and significant impact of every decision made during the trial, it is essential for each team member to collaborate efficiently in order to meet strict deadlines, comply with regulations, and ensure reliable results.
