Background: Artificial intelligence (AI) is expected to play a greater role in neurosurgery. There is a need for neurosurgeons capable of critically appraising AI literature to evaluate its implementation or communicate information to patients. However, there are a lack of courses delivered at a level appropriate for individuals to develop such skills. We assessed the impact of an online digital literacy course on the ability of individuals to critically appraise AI literature in neurosurgery.

Methods: We performed a prospective, non-randomised, controlled study with a mixed-methods analysis. The intervention arm comprised of individuals enrolled in our two-day digital health literacy course, with a waiting-list control arm used for comparison. We assessed participants’ pre- and post-course knowledge, confidence and course acceptability using Qualtrics surveys.

Results: A total of 62 participants (33 participants, 29 waitlist controls), including neurosurgical trainees and both undergraduate and post-graduate students, attended the course and completed the pre-course survey. The two groups did not vary significantly in terms of age or demographics. Following the course, participants significantly improved in their knowledge of AI (mean difference=3.86, 95% CI=2.97-4.75, p-value<0.0001) and confidence in critically appraising literature using AI (p-value=0.002). Similar differences in knowledge (mean difference=3.15, 95% CI=1.82-4.47, p-value<0.0001) and confidence (p-value<0.0001) were found when compared to the control group.

Conclusion: Bespoke courses delivered at an appropriate level can improve clinicians’ understanding of the application of AI in neurosurgery, without the need for in-depth technical knowledge or programming skills.