Evidence-Based Guidelines for Podcasts

Podcasts production is growing in our tech-savvy culture. But how do you know which ones are high quality and who to trust?

Credibility must be established.

Transparency is essential.

Centered on learner competency development and outcomes, Drs. Becky Carson and Brad Sobolewski wrote the first ever “Evidence-Based Guidelines for Podcast Production and Use in Competency-Based Health Professions Education” in the Journal of Pediatric Healthcare.

Peer Review

The Peds NP introduced a novel approach to peer review in podcasting during the Acute Care Faculty Series with a standardized, semi-blind peer review process that parallels scholarly journal article reviews.

The article, “Pre-publication Podcast Peer Review: Summary of an Innovation,” is published in the Journal of Continuing Education in Health Professions.

The Peds NP Peer Review Process

  • Script and Desk Edit

    Authors plan and write the script, complete with citations and references. The host completes a desk edit to align the episode with the style and voice of The Peds NP.

  • Semi-Blind Peer Review

    Volunteer peer reviewers are assigned by the host to an episode based on their expertise. The reviewer reads the script and completes a 5-question survey (with optional comments) based on the rMETRIQ quality evaluation tool. The rMETRIQ tool was modified to remove all post-publication questions as this peer review process is pre-publication. The reviewer is anonymized to only the Academic Team (select group members dedicated to dissemination of the work).

  • Edit and Repeat

    The peer review score is out of 15 possible points. The Peds NP is dedicated to quality, so any comment or category not given the highest score was evaluated with subsequent script editing. The peer reviewer was then asked to repeat the review and rescore the episode. Episodes move forward to recording once the maximum score is achieved. One exception is opinion pieces, which have a maximum score of 13/15.

It’s more than just a podcast.