For speech-language pathologists
How do SLPs use evidence-based practice day to day?
Published · Updated
The short answer
Evidence-based practice (EBP), as ASHA defines it, integrates three components: clinical expertise, evidence (external research plus your own client data) and the perspectives of the client and family. In practice it’s a four-step cycle: frame a clinical question, often in PICO form; gather evidence, starting with appraised sources such as ASHA’s Evidence Maps and Cochrane reviews; assess it for relevance and quality; then make the decision and monitor it with your client’s data.
ASHA’s framework: three components, four steps
ASHA defines EBP as the integration of clinical expertise and expert opinion, external and internal evidence, and client, patient and caregiver perspectives (ASHA). External evidence is the research literature; internal evidence is the data you collect on your own client over time (ASHA). ASHA lays out the process in four steps: frame your clinical question, gather evidence, assess the evidence, and make your clinical decision (ASHA). It’s also an ethical duty: ASHA’s Code of Ethics requires certificate holders to use independent and evidence-based clinical judgment, keeping the best interests of those served paramount (ASHA, 2023).
The barriers are familiar. In a survey of 317 SLPs, inadequate time for research and workload or caseload size remained the most significant barriers. Exposure to EBP in graduate school and the clinical fellowship, and EBP training later in their careers, predicted more use of EBP. The authors called for time-saving resources, a consistent process for posing and answering questions, and support from employers (Greenwell & Walsh, 2021). The steps below are that consistent process, kept short.
Step 1: ask a PICO question
ASHA describes PICO as one widely used way to frame a clinical question (ASHA):
- P, population: the characteristics or condition of the group.
- I, intervention: the screening, assessment, treatment or service delivery model you’re considering.
- C, comparison: the main alternative. ASHA notes some questions won’t have one.
- O, outcome: what you want to accomplish, measure or improve.
An example from a school caseload: “For school-age children with residual /r/ errors (P), does adding visual biofeedback to motor-based treatment (I), compared with motor-based treatment alone (C), lead to greater accuracy on untreated words (O)?” For background on that question, see biofeedback for the R sound.
ASHA says there’s no single correct way to build a PICO question. It should be specific enough to guide the search but not so specific that you find nothing, and it should include what matters about this particular client. If you have several questions, write them all down and search one at a time (ASHA).
Step 2: where to find evidence
ASHA suggests starting with evidence that has already been appraised or synthesized, such as guidelines, systematic reviews and meta-analyses, and searching for individual studies when those are unavailable, out of date, unreliable or irrelevant (ASHA).
| Source | What it holds | Good for |
|---|---|---|
| ASHA Evidence Maps | For external evidence, only evidence-based guidelines and systematic reviews, plus consensus statements from guidelines and ASHA policy documents (clinical expertise) and research on client perspectives. No individual studies. Inclusion doesn’t mean ASHA endorses a document’s conclusions (ASHA). | A first look at what reviews exist on a topic |
| Cochrane Library | Cochrane reviews: systematic reviews of health care research, published in the Cochrane Database of Systematic Reviews and updated as new evidence appears (Cochrane Library). Reviews published without an open-access fee become free to read 12 months after publication (Cochrane Library). | Rigorous answers on whether a treatment works |
| speechBITE | A database of intervention studies across speech pathology, an initiative of the University of Sydney and Speech Pathology Australia launched in 2008. It indexes systematic reviews, randomized and non-randomized controlled trials, single-case experimental designs, case series and clinical practice guidelines (speechBITE). | Treatment studies, with quality ratings on trials |
| PubMed | More than 40 million citations and abstracts in biomedicine and health, free to search, maintained by the National Library of Medicine. It doesn’t host journal full text itself but often links to it, and its PubMed Central component is a full-text archive (NLM). | Individual studies and the newest research |
ASHA also points to ASHAWire and ERIC as discipline-specific places to start, to the What Works Clearinghouse and the Campbell Collaboration for synthesized evidence, and to PsycNet and JSTOR for individual studies. It notes that databases like these are free to search but may not provide the full text of every article, which a university or local library or the publisher may supply (ASHA).
Step 3: levels of evidence, and reading a study quickly
Many evidence hierarchies rank studies by design alone, but ASHA cautions that design alone doesn’t make good evidence. It matches designs to questions instead: for treatment efficacy, a randomized controlled trial is preferred, with controlled trials and single-case experimental designs as other relevant designs; for diagnosis, a prospective, blind comparison with a reference standard (ASHA). A quick read, in order:
- Relevance. How closely do the aim, participants, method and results match your PICO question? Use judgment on whether the participants are comparable to your client (ASHA).
- Design and bias. Is the aim clear and focused? Was there random assignment or blinding? Watch for conflicts of interest and publication bias, and treat sources with another agenda or no peer review with caution (ASHA). speechBITE rates trials on the PEDro-P scale, scored out of 10 for internal validity and interpretable statistics, but warns that a high score doesn’t mean a treatment will be useful in practice (speechBITE).
- Statistical vs clinical significance. A p value can’t tell you whether a result is clinically important. Sample size, confidence intervals and effect sizes show how large and how precise an effect is (ASHA). For example, a Cochrane review found therapy effective for phonological difficulties with a standardized mean difference of 0.44, but a 95% confidence interval of 0.01 to 0.86, so the true effect could be anywhere from negligible to substantial (Law, Garrett & Nye, 2003).
- Effect sizes need the right yardstick. Cohen’s benchmarks of 0.2, 0.5 and 0.8 were set for comparing two independent groups and may not apply to single-subject research. From 135 preschoolers in single-subject phonological treatment studies, researchers estimated preliminary benchmarks of 1.4, 3.6 and 10.1 for small, medium and large generalization effects, specific to that population (Gierut, Morrisette & Dickinson, 2015). A group study reporting d = 1.31 and a single-case study reporting 1.31 aren’t saying the same thing.
- Single-case designs. These are the most frequently indexed design on speechBITE (speechBITE). Each participant serves as their own control, and experimental control comes from replicating the effect across phases, participants, behaviors or settings; a simple A-B design has no replication, so it can’t rule out outside factors (Byiers, Reichle & Symons, 2012). Check for a stable baseline of at least three points and look at level, trend and variability (Byiers, Reichle & Symons, 2012). Because the data are perceptual ratings, also check how the authors measured rater agreement: see how reliable speech sound ratings are.
When the evidence is thin
In child speech and language, it often is. A Cochrane review of non-speech oral motor exercises found only three small studies with 22 children in total (Lee & Gibbon, 2015), and a systematic review of school service delivery models found only 5 studies that met its criteria (Cirrin et al., 2010). ASHA’s guidance for this situation:
- A lack of evidence isn’t evidence of no effect. A treatment isn’t ruled out because external evidence is scarce, but it calls for careful consideration and monitoring (ASHA).
- Widen the search first. Reconsider the PICO question, broaden it, and add synonyms and common acronyms (ASHA).
- Look sideways. Consider research on similar populations, interventions or outcomes, or an alternative option that does have evidence, and lean more on your client’s own data (ASHA).
- Run a trial period. Use a trial period, collect internal evidence, and cycle through the process again if progress stalls (ASHA). Be open with the client and family about the plan, its rationale, and its possible benefits and harms (ASHA).
- Make your own data more like a study. Take at least three baseline points before starting, and measure a skill you aren’t treating as a control, so you can tell a treatment effect from maturation (Byiers, Reichle & Symons, 2012; Olswang & Bain, 1994). Even an A-B comparison is a useful preliminary step when time is short (Byiers, Reichle & Symons, 2012).
For setting up probes and tracking change, see progress monitoring in speech sound therapy.
Evaluating products, programs and apps
The same steps apply to anything you’re asked to buy or use. ASHA’s Code of Ethics requires certificate holders to evaluate the effectiveness of the services, technology and products they use, and to use them only when benefit can reasonably be expected (ASHA, 2023). ASHA’s guidance on evaluating products adds (ASHA):
- Credible research is peer-reviewed, replicated and shows benefit to clients. Claims should rest on more than anecdotes and client reviews.
- “Extraordinary treatment claims require extraordinary evidence.” Be wary of claims that sound too good to be true, outcomes described in vague, feel-good terms, and promoters who dismiss findings that question their product.
- Credentials aren’t evidence. A developer’s credentials don’t necessarily determine a product’s value. Look for reviews that both confirm and refute the majority opinion.
- For apps and AI tools, ask what data is collected, what the tool was trained on, whether you can opt out of tracking, and whether the free version is enough.
The wider evidence on apps is a reason for caution: a review of 132 children’s speech therapy apps rated none as excellent quality (Furlong et al., 2018). For a full checklist covering accuracy, privacy law and fit with the treatment plan, see choosing speech therapy technology.
Questions SLPs ask
What are the three components of evidence-based practice?
ASHA defines EBP as the integration of clinical expertise, evidence (external research and your own client data), and the perspectives of the client, patient or caregiver.
What is a PICO question in speech therapy?
A way to frame a clinical question by its population, intervention, comparison and outcome. ASHA notes that some questions have no comparison and that the question should reflect the individual client.
Where can SLPs find research for free?
PubMed is free to search, and Cochrane reviews published without an open-access fee become free to read 12 months after publication. ASHA’s Evidence Maps and speechBITE are good starting points, though not every full-text article they point to is free.
What should I do if there’s no research on a treatment?
ASHA says a lack of evidence isn’t evidence of no effect. Look at research on similar populations or treatments, run a trial period, and rely on your client’s own data to decide whether to continue.
Do single-case studies count as evidence?
Yes. ASHA lists single-case experimental designs as relevant evidence for treatment questions. The strongest replicate the effect across phases, participants or behaviors; a simple A-B design can’t rule out outside factors.
Sources
- ASHA: Evidence-based practice (EBP).
- ASHA: Evidence-based practice, step 2: Gather evidence.
- ASHA: Evidence-based practice process.
- ASHA (2023). Code of ethics (effective March 1, 2023).
- Greenwell, T., & Walsh, B. (2021). Evidence-based practice in speech-language pathology: Where are we now? American Journal of Speech-Language Pathology, 30(1), 186–198.
- ASHA: Evidence-based practice, step 1: Frame your clinical question.
- ASHA: Evidence Maps: Learn about our process.
- Cochrane Library: About Cochrane reviews.
- Cochrane Library: Open access options for the Cochrane Database of Systematic Reviews.
- speechBITE: Background.
- National Library of Medicine: About PubMed.
- ASHA: Evidence-based practice, step 3: Assess the evidence.
- speechBITE: Group comparison studies (the PEDro-P scale).
- Law, J., Garrett, Z., & Nye, C. (2003). Speech and language therapy interventions for children with primary speech and language delay or disorder. Cochrane Database of Systematic Reviews, (3), CD004110.
- Gierut, J. A., Morrisette, M. L., & Dickinson, S. L. (2015). Effect size for single-subject design in phonological treatment. Journal of Speech, Language, and Hearing Research, 58(5), 1464–1481.
- speechBITE: Single-case designs.
- Byiers, B. J., Reichle, J., & Symons, F. J. (2012). Single-subject experimental design for evidence-based practice. American Journal of Speech-Language Pathology, 21(4), 397–414.
- Lee, A. S., & Gibbon, F. E. (2015). Non-speech oral motor treatment for children with developmental speech sound disorders. Cochrane Database of Systematic Reviews, 2015(3), CD009383.
- Cirrin, F. M., Schooling, T. L., Nelson, N. W., et al. (2010). Evidence-based systematic review: Effects of different service delivery models on communication outcomes for elementary school-age children. Language, Speech, and Hearing Services in Schools, 41(3), 233–264.
- ASHA: Evidence-based practice, step 4: Make your clinical decision.
- Olswang, L. B., & Bain, B. (1994). Data collection: Monitoring children’s treatment progress. American Journal of Speech-Language Pathology, 3(3), 55–66.
- ASHA: Evaluating procedures, products, or programs: Considerations for audiologists and speech-language pathologists.
- Furlong, L., Morris, M., Serry, T., & Erickson, S. (2018). Mobile apps for treatment of speech disorders in children: An evidence-based analysis of quality and efficacy. PLOS ONE, 13(8), e0201513.