A pragmatic trial of an Artificial intelligence DRiven appOInTment maNagEment SyStem (ADROITNESS) in NHS outpatient departments: WP1 Accuracy - Phase 2b Evaluation Report

DrDoctor is an artificial intelligence system that seeks to predict the probability of outpatient not attending their appointment (phase 1) predicting linked clincis (phase2a) and predicting out of sequence linked appointments (phase 2b). LSBU were commissioned by NHS England to evaluate the use of the DrDoctor system in two NHS trusts to see if it is accurate, safe, effective provides value and explore person centred aspects. A report of the evaluation of phase 2b of DrDoctor AI Outpatient management system evaluating the process adopted for identifying out of sequence linked appointments. For example a diagnostic test appointment occurring after the clinician review. Report covers approach to evaluation detailed findings, conclusions and recommendations. This report considered the process adopted for phase2b. Due to delays in DrDoctor development the report excluded consideration of outcomes. A key recommendation was the clinical review of its predicted linked appointments out of sequence for their accuracy and also consideration of missed out of sequence linked appointments.