EdTech & Innovation
Educational Quality, Reliability, and Actionability of YouTube E-FAST Ultrasound Training Videos
Sezer et alJournal of evaluation in clinical practice
A cross-sectional study evaluated the educational quality, information reliability, and understandability and actionability of Extended Focused Assessment with Sonography for Trauma (E-FAST) training videos accessible on YouTube.
Evaluations utilized the Global Quality Scale (GQS), JAMA Benchmark Criteria, DISCERN tool, and the Patient Education Materials Assessment Tool for Audiovisual Materials (PEMAT-A/V). A study-specific composite PEMAT-A/V score equally weighted understandability and actionability, defining educational adequacy as a score of ≥ 70%.
Across the 74 videos, the median GQS score was 3.50 and the median DISCERN score was 59.75. Only 33 videos (44.6%) met the ≥ 70% composite PEMAT-A/V adequacy threshold, meaning more than half fell short of acceptable understandability and actionability standards. Videos uploaded by institutions achieved higher GQS, DISCERN, and composite PEMAT-A/V scores compared to those from individual uploaders, whereas differences on JAMA criteria were not significant. PEMAT-A/V composite scores correlated positively with GQS (r = 0.669), DISCERN (r = 0.542), and JAMA scores (r = 0.353).
In the primary adjusted logistic regression model, higher GQS score (odds ratio [OR] = 12.95, 95% CI: 1.80–93.31) and institutional uploader status (OR = 4.52, 95% CI: 1.14–18.18) were associated with adequate classification. The positive association with GQS persisted across sensitivity analyses, whereas associations for uploader type and other rating scales varied depending on outcome definitions. The authors noted that these quality and reliability ratings should not be interpreted as evidence of improved learning or clinical performance.
Key Takeaways
- Only 33 of 74 evaluated videos (44.6%) met the prespecified ≥ 70% adequacy threshold on the composite PEMAT-A/V understandability and actionability metric, despite overall median GQS and DISCERN scores of 3.50 and 59.75, respectively.
- In multivariable analysis, higher Global Quality Scale scores (OR = 12.95, 95% CI: 1.80–93.31) and institutional uploader status (OR = 4.52, 95% CI: 1.14–18.18) were independently associated with achieving PEMAT-A/V adequacy.
Read the original sourceJournal of evaluation in clinical practice
