Skip to main content

Advertisement

Log in

Abstract

This review offers practical recommendations regarding research on training in evidence-based practices for mental health and substance abuse treatment. When designing training research, we recommend: (a) aligning with the larger dissemination and implementation literature to consider contextual variables and clearly defining terminology, (b) critically examining the implicit assumptions underlying the stage model of psychotherapy development, (c) incorporating research methods from other disciplines that embrace the principles of formative evaluation and iterative review, and (d) thinking about how technology can be used to take training to scale throughout all stages of a training research project. An example demonstrates the implementation of these recommendations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. We will use competence going forward as this is the more widely used term.

References

  • Ajzen, I. (1988). Attitudes, personality and behavior. Milton Keynes, England: Open University Press

  • Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. doi:10.1016/0749-5978(91)90020-T.

    Article  Google Scholar 

  • American Academy of Child and Adolescent Psychiatry. (2006). American academy of child and adolescent psychiatry policy statement on evidence-based practice in psychiatry. Retrieved from http://www.aacap.org/cs/root/policy_statements/evidence_based_practice

  • American Psychological Association. (2005). American psychological association policy statement on evidence-based practice in psychology. Retrieved from http://www.apa.org/practice/ebpreport.pdf

  • Atkins, M., Frazier, S., & Cappella, E. (2006). Hybrid research models. Natural opportunities for examining mental health in context. Clinical Psychology: Science and Practice, 13, 105–107. doi:10.1111/j.1468-2850.2006.00012.x.

    Article  Google Scholar 

  • Atkins, M., Frazier, S., Leathers, S., Graczyk, P., Talbott, E., Jakobsons, L., et al. (2008). Teacher key opinion leaders and mental health consultation in low-income urban schools. Journal of Consulting and Clinical Psychology, 76, 905–908. doi:10.1037/a0013036.

    Article  PubMed  Google Scholar 

  • Beck, A., Rush, A., Shaw, B., & Emory, G. (1987). Cognitive therapy of depression. New York: Guilford Press.

    Google Scholar 

  • Beidas, R., Barmish, A., & Kendall, P. (2009). Training as usual: Can clinician behavior change following reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? The Behavior Clinician, 32(5), 97–101.

    Google Scholar 

  • Beidas, R. S., Edmunds, J., & Kendall, P. (2010, June). A comparison of training methods for dissemination. In S. Stirman (Chair), Therapist and client outcomes of community-based training programs in evidence-based treatments. Symposium conducted at the meeting of the World Congress of Behavioral and Cognitive Therapies, Boston, Massachusetts.

  • Beidas, R. S., & Kendall, P. C. (2010). Training clinicians in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science & Practice, 17, 1–30. doi:10.1111/j.1468-2850.2009.01187.x.

    Article  Google Scholar 

  • Bennett-Levy, J., Richards, D., Farrand, P., Christensen, H., Griffiths, K., Kavanagh, D., et al. (Eds.). (2010). Oxford guide to low intensity CBT interventions. London, England: Oxford University Press.

    Google Scholar 

  • Bondi, A. (2000). Characteristics of scalability and their impact on performance. Proceedings of the 2nd international workshop on Software and performance, Ottawa, Ontario, Canada.

  • Borntrager, C., Chorpita, B., Higa-McMillan, C., & Weisz, J. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services, 60, 677–681. doi:10.1176/appi.ps.60.5.677.

    Article  PubMed  Google Scholar 

  • Bradach, J. (2010). Scaling impact: How to get100X the results with 2X the organization. Stanford Social Innovation Review, Summer, 27–28. Retrieved from http://www.ssireview.org/articles/entry/scaling_impact/

  • Bradley, E., Curry, L., Ramandhan, S., Rowe, L., Nembhard, I., & Krumholz, H. (2009). Research in action: Using positive deviance to improve quality of health care. Implementation Science, 4, 25. doi:10.1186/1748-5908-4-25.

    Article  PubMed  Google Scholar 

  • Bray, J., Mills, M., Bray, L., Lennox, R., McRee, B., Goehner, D., et al. (2009). Evaluating web-based training for employee assistance program counselors on the use of screening and brief intervention for at-risk alcohol use. Journal of Workplace Behavioral Health, 24, 307–319. doi:10.1080/15555240903176146.

    Article  Google Scholar 

  • Carroll, K., & Rounsaville, B. (2003). Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatric Services, 54, 333–339. doi:10.1176/appi.ps.54.3.333.

    Article  PubMed  Google Scholar 

  • Caspar, E. (2007). The theory of planned behavior applied to continuing education for mental health professionals. Psychiatric Services, 58, 1324–1329. doi:10.1176/appi.ps.58.10.1324.

    Article  Google Scholar 

  • Chambless, D., & Hollon, S. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7–18. doi:10.1037//0022-006X.66.1.7.

    Article  PubMed  CAS  Google Scholar 

  • Chorpita, B., Becker, K., & Daleiden, E. (2008). Understanding the common elements of evidence-based practice: Misconceptions and clinical examples. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 647–652. doi:10.1097/chi.0b013e318033ff71.

    Article  Google Scholar 

  • Chorpita, B., & Daleiden, E. (2009). Matching evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77, 566–579. doi:10.1037/a0014565.

    Article  PubMed  Google Scholar 

  • Chorpita, B., & Mueller, C. (2008). Toward new models for research, community, and consumer partnerships: Some guiding principles and an illustration. Clinical Psychology: Science and Practice, 15, 144–148. doi:10.1111/j.1468-2850.2008.00123.x.

    Article  Google Scholar 

  • Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008). Internet-based learning in the health professions: A meta-analysis. JAMA, 300, 1181–1196. doi:10.1001/jama.300.10.1181.

    Article  PubMed  CAS  Google Scholar 

  • Cottam, H & Leadbeater, C. (2004). Health: Co-creating services. London: Design Council. Retrieved from http://www.designcouncil.info/RED/health/REDPaper01.pdf

  • Crawford, C., & Di Benedetto, A. (2010). New products management (9th ed.). Burr Ridge, IL: Irwin-McGraw Hill.

    Google Scholar 

  • Cross, W., Matthieu, M., Cerel, J., & Knox, K. (2007). Proximate outcomes of gatekeeper training for suicide prevention in the workplace. Suicide and Life-Threatening Behavior, 37, 659–670. doi:10.1521/suli.2007.37.6.659.

    Article  PubMed  Google Scholar 

  • Crossouard, B. (2008). Developing alternative models of doctoral supervision with online formative assessment. Studies in Continuing Education, 30, 51–67. doi:10.1080/01580370701841549.

    Article  Google Scholar 

  • Cucciare, M., Weingardt, K., & Villafranca, S. (2008). Using blended learning to implement evidence-based psychotherapies. Clinical Psychology: Science and Practice, 15, 299–307. doi:10.1111/j.1468-2850.2008.00141.x.

    Article  Google Scholar 

  • Curran, G., Bauer, M., Mittman, B., Stetler, C., Pyne, J., Fortney, J., et al. (2010). A new ‘Hybrid’? Combining elements of clinical effectiveness and implementation research trials. Poster presented at the VA HSR&D field-based meeting on mental health and substance use disorders, Little Rock, AR.

  • Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. doi:10.1186/1748-5908-4-50.

    Article  PubMed  Google Scholar 

  • Darken, R. (2009). Identifying the limits of training system effectiveness through taxonomies of human performance. Theoretical Issues in Ergonomics Science, 10, 231–243. doi:10.1080/14639220802151625.

    Article  Google Scholar 

  • Davies, P., Walker, A., & Grimshaw, J. (2010). A systemic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implementation Science, 5. doi:10.1186/1748-5908-5-14.

  • DeAngelis, T. (2010, June). Closing the gap between research and practice. Monitor on Psychology, 41(6). Retrieved from http://www.apa.org/monitor

  • Dimeff, L., Koerner, K., Woodcock, E., Beadnell, B., Brown, M., Skutch, J., et al. (2009). Which training method works best? A randomized controlled trial comparing three methods of training clinicians in dialectical behavior therapy skills. Behavior Research and Therapy, 47, 921–930. doi:10.1016/j.brat.2009.07.011.

    Article  Google Scholar 

  • Donabedian, A. (1981). Criteria, norms, and standard of quality: What do they mean? American Journal of Public Health, 71, 409–412. Retrieved from ajph.aphapublications.org/cgi/reprint/71/4/409.pdf.

  • Donovant, B. (2009). To Internet or Not? Assessing the efficacy or online police training. American Journal for Criminal Justice, 34, 224–237. doi:10.1007/s12103-009-9061-7.

    Article  Google Scholar 

  • Doumit, G., Gattellari, M., Grimshaw, J., & O’Brien, M. (2007). Local opinion leaders: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews, 1. Retrieved from www.cochrane.org/reviews/en/ab000125.html, doi:10.1007/s12103-009-9061-7.

  • Eccles, R., & Graham, I. (Eds.). (2009). Special issue on United States Department of Veteran Affairs Quality Enhancement Research Initiative (QUERI). Implementation Science, 4, entire issue. Retrieved from http://www.implementationscience.com/

  • Ericsson, K., & Charness, N. (1994). Expert performance: Its structure and acquisition. The American Psychologist, 49, 725–747. doi:10.1037/0003-066X.49.8.725.

    Article  Google Scholar 

  • Farmer, A., Legare, F., Turcot, L., Grimshaw, J., Harvey, E., McGowan, J. et al. (2008). Printed educational materials: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews, 3. Retrieved from http://www2.cochrane.org/reviews/en/ab004398.html

  • Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., &Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, The Louis de la Parte Florida Mental Health Institute. Department of Child & Family Studies. Retrieved from http://nirn.fmhi.usf.edu

  • Follette, W., & Callaghan, G. (1995). Do as I do, not as I say: A behavior-analytic approach to supervision. Professional Psychology: Research and Practice, 26, 413–421. doi:10.1037/0735-7028.26.4.413.

    Article  Google Scholar 

  • Forman, S., Olin, S., Hoagwood, K., Crowe, M., & Saka, N. (2009). Evidence-based interventions in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1, 26–36. doi:10.1007/s12310-008-9002-5.

    Article  Google Scholar 

  • Fouad, N., Grus, C., Hatcher, R., Kaslow, N., Hutchings, P., Madson, M., et al. (2009). Competency benchmarks: A model for understanding and measuring competence in professional psychology across training levels. Training and Education in Professional Psychology, 3, S5–S26. doi:10.1037/a0015832.

    Article  Google Scholar 

  • Francis, J., Eccles, M., Johnston, M., Walker, A., Grimshaw, J., Foy, R. et al. (2004). Constructing questionnaires based on the theory of planned behavior: A manual for health services researchers. United Kingdom: Center for Health Services Research. Retrieved from www.people.umass.edu/…/Francis%20etal.TPB%20research%20manual.pdf

  • Garland, A., Brookman-Frazee, L., Hurlburt, M., Accurso, A., Zoffness, R., Haine-Schlagel, R., et al. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61, 788–795. doi:10.1176/appi.ps.61.8.788.

    Article  PubMed  Google Scholar 

  • Glasgow, R., Vogt, T., & Boles, S. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327. doi:10.2105/AJPH.89.9.1322.

    Article  PubMed  CAS  Google Scholar 

  • Graham, I., Logan, J., Harrison, M., Straus, S., Tetroe, J., Caswell, W., et al. (2006). Lost in knowledge translation: Time for a map? The Journal of Continuing Education in the Health Professions, 26, 13–24. doi:10.1002/chp.47.

    Article  PubMed  Google Scholar 

  • Greenberg, L., & Pinsoff, W. (Eds.). (1986). The psychotherapeutic process: A research handbook. New York: Guilford Press.

    Google Scholar 

  • Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systemic review and recommendations. Milbank Quarterly, 82, 581–629. doi:10.1111/j.0887-378X.2004.00325.x.

    Article  PubMed  Google Scholar 

  • Grol, R., Bosch, M., Hulscher, M., Eccles, M., & Wensing, M. (2007). Planning and studying improvement in patient care: The use of theoretical perspectives. The Milbank Quarterly, 85, 93–138. doi:10.1111/j.1468-0009.2007.00478.x.

    Article  PubMed  Google Scholar 

  • Hansen, S., & Avital, M. (2005). Share and share alike: The social and technological influences on knowledge sharing behavior. Sprouts: Working Papers on Information Systems, 5, 5–13. Retrieved from http://sprouts.aisnet.org/5-13/

  • Hopko, D. R., Lejuez, C. W., Ruggiero, K. J., & Eifert, G. H. (2003). Contemporary behavioral activation treatments for depression: Procedures, principles, and progress. Clinical Psychology Review, 23, 699–717. doi:10.1016/S0272-7358(03)00070-9.

    Article  PubMed  Google Scholar 

  • Improving Access to Psychological Therapies. (2008). Improving access to psychological therapies implementation plan: Curriculum for high-intensity therapies workers. Retrieved from http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyandGuidance/DH_083150

  • Institute of Health Economics. (2008). Effective dissemination of findings from research. Retrieved from http://www.ihe.ca/publications/library/2008/effective-dissemination-of-findings-from-research

  • Jacobson, N. S., Dobson, K. S., Truax, P. A., Addis, M. E., Koerner, K., Gollan, J., et al. (1996). A component analysis of cognitive-behavioral treatment for depression. Journal of Consulting and Clinical Psychology, 64, 295–304. doi:10.1037/0022-006X.64.2.295.

    Article  PubMed  CAS  Google Scholar 

  • Kahn, K. (2004). The PDMA handbook of new product development. Hoboken, NJ: Wiley.

    Book  Google Scholar 

  • Kanter, J. W., Manos, R. C., Bowe, W. M., Baruch, D. E., Busch, A. M., & Rusch, L. R. (2010). What is behavioral activation: A review of the empirical literature. Clinical Psychology Review, 30, 608–620. doi:10.1016/j.cpr.2010.04.001.

    Article  PubMed  Google Scholar 

  • Kaslow, N., Grus, C., Campbell, L., Fouad, N., Hatcher, N., & Rodolfo, E. (2009). Competency assessment toolkit for professional psychology. Training and Education in Professional Psychology, 3, S27–S45.

    Article  Google Scholar 

  • Kendall, P. C., & Beidas, R. S. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology: Research and Practice, 38, 13–19. doi:10.1037/0735-7028.38.1.13.

    Article  Google Scholar 

  • Kendall, P. C., & Comer, J. S. (2011). Research methods in clinical psychology. In D. Barlow (Ed.), Oxford handbook of clinical psychology. New York: Oxford University Press.

    Google Scholar 

  • Kendall, P. C., Gosch, E., Furr, J., & Sood, E. (2008). Flexibility within fidelity. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 987–993. doi:10.1097/CHI.0b013e31817eed2f.

    Article  PubMed  Google Scholar 

  • Kendall, P. C., & Hedtke, K. A. (2006). Cognitive-behavioral therapy for anxious children: Clinician manual (3rd ed.). Ardmore, PA: Workbook Publishing.

    Google Scholar 

  • Kendall, P. C., & Khanna, M. S. (2008). CBT4CBT: Computer-based training to become a cognitive-behavioral therapist…for anxious youth. Ardmore, PA: Workbook Publishing Inc.

    Google Scholar 

  • Kitson, A., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008). Evaluating the successful implementation of evidence into practice using the PARiHS framework: Theoretical and practical challenges. Implementation Science, 3. doi:10.1186/1748-5908-3-1.

  • Koerner, K., Dimeff, L., & Swenson, C. (2007). Adopt or adapt? Fidelity matters. In L. Dimeff & K. Koerner (Eds.), Dialectical behavioral therapy in clinical practice. New York: Guildford Press.

    Google Scholar 

  • Kroll, P., & Kruchten, P. (2003). The rational unified process made easy: A clinician’s guide to the RUP. Addison-Wesley Professional.

  • Kulier, R., Hadley, J., Weinbrenner, S., Meyerrose, B., Decsi, T., Horvath, A., et al. (2008). Harmonizing evidence-based medicine teaching: a study of the outcomes of e-learning in five European Countries. BMC Medical Education, 8, 27–37. doi:10.1186/1472-6920-8-27.

    Article  PubMed  Google Scholar 

  • Linehan, M. (1993a). Skills training manual for treating borderline personality disorder. New York: Guilford Press.

    Google Scholar 

  • Linehan, M. (1993b). Cognitive-behavioral treatment of borderline personality disorder. New York: Guilford Press.

    Google Scholar 

  • Luoma, J., Hayes, S., & Walser, R. (2007). Learning ACT: An acceptance and commitment therapy skills training manual for therapists. California: New Harbinger Press.

    Google Scholar 

  • March, J., Silva, S., Compton, S., Shapiro, M., Califf, R., & Krishnan, R. (2005). The case for practical clinical trials in psychiatry. American Journal of Psychiatry, 162, 836–846. doi:10.1176/appi.ajp.162.5.836.

    Article  PubMed  Google Scholar 

  • Markiewicz, J., Ebert, L., Ling., D., Amaya-Jackson, L., & Kisiel, C. (2006). Learning collaborative toolkit. Los Angeles, CA and Durham, NC: National Center for Child Traumatic Stress.

  • McGaghie, W., Siddal, V., Masmanian, P., & Myers, J. (2009). Lessons for continuing medical education from simulation research in undergraduate and graduate medical education. Chest, 135S, 62–68. doi:10.1378/chest.08-2521.

    Article  Google Scholar 

  • McHugh, R. K., & Barlow, D. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. The American Psychologist, 65, 73–84. doi:10.1037/a0018121.

    Article  PubMed  Google Scholar 

  • Miller, W., Sorensen, J., Selzer, J., & Brigham, G. (2006). Disseminating evidence- based practices in substance abuse treatment: A review with suggestions. Journal of Substance Abuse Treatment, 31, 25–39. doi:10.1016/j.jsat.2006.03.005.

    Article  PubMed  Google Scholar 

  • Moore, J. L., & Marra, R. M. (2005). A comparative analysis of online discussion participation protocols. Journal of Research on Technology in Education, 38, 191–212. Retrieved from http://www.iste.org/

  • Morgenstern, J., & McKay, J. R. (2007). Rethinking the paradigms that inform behavioral treatment research for substance use disorders. Addiction, 102, 1377–1389. doi:10.1111/j.1360-0443.2007.01882.x.

    Article  PubMed  Google Scholar 

  • Moyers, T., Martin, T., Catley, D., Harris, K., & Ahluwalia, J. (2003). Assessing the integrity of motivational interviewing interventions: Reliability of the motivational interviewing skills code. Behavioral and Cognitive Psychotherapy, 31, 177–184. doi:10.1017/S1352465803002054.

    Article  Google Scholar 

  • National Crime Victims Research & Treatment Center. (2007). TF-CBT Web: First Year Report. Charleston, SC: Medical University of South Carolina. Retrieved from http://tfcbt.musc.edu/

  • Onken, L. S., Blaine, J. D., & Battjes, R. (1996). Behavioral therapy research: A conceptualization of a process. In S. W. Henggeler & A. B. Santos (Eds.), Innovative approaches for difficult-to-treat populations. Washington, DC: American Psychiatric Press.

    Google Scholar 

  • Orvis, K., Fisher, S., & Wasserman, M. (2009). Power to the people: Using learner control to improve trainee reactions and learning in web-based instructional environments. Journal of Applied Psychology, 94, 960–971. doi:10.1037/a0014977.

    Article  PubMed  Google Scholar 

  • Ottoson, J. (1997). Beyond transfer of training: Using multiple lenses to assess community education programs. New Directions for Adult and Continuing Education, 75, 87–96. doi:10.1002/ace.7508.

    Article  Google Scholar 

  • Perpepletchikova, F., & Kazdin, A. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383. doi:10.1093/clipsy/bpi045.

    Article  Google Scholar 

  • President’s New Freedom Commission on Mental Health. (2004). Report of the President’s New Freedom Commission on Mental Health. Retrieved from http://www.mentalhealthcommission.gov/reports/FinalReport/toc.html

  • Rakovshik, S., & McManus, F. (2010). Establishing evidence-based in training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30, 496–516. doi:10.1016/j.cpr.2010.03.004.

    Article  PubMed  Google Scholar 

  • Rashiq, S., Barton, P., Harstall, C., Schopflocher, D., Taenzer, P., & Alberta Ambassador Program Team. (2006). The Alberta ambassador program: Delivering health technology assessment results to rural clinicians. BMC Medical Education, 31, 6–21. doi:10.1186/1472-6920-6-21.

    Google Scholar 

  • Ricciardi, J. (2005). Achieving human service outcomes through competency-based training: A guide for managers. Behavior Modification, 29, 488–507. doi:10.1177/0145445504273281.

    Article  PubMed  Google Scholar 

  • Roth, A., & Pilling, S. (2008). Using an evidence-based methodology to identify the ompetences required to deliver effective cognitive and behavioral therapy for depression and anxiety disorders. Behavioral and Cognitive Psychotherapy, 36, 129–147. doi:10.1017/S1352465808004141.

    Article  Google Scholar 

  • Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001). A stage model of behavioral therapies research: Getting started and moving on from Stage I. Clinical Psychology: Science and Practice, 8, 133–142. doi:10.1093/clipsy/8.2.133.

    Article  Google Scholar 

  • Rourke, L., & Anderson, T. (2002). Using peer teams to lead online discussions. Journal of Interactive Media in Education, 1, 1–21. Retrieved from http://www-jime.open.ac.uk/

  • Scherl, C., & Haley, J. (2000). Computer monitor supervision: A clinical note. The American Journal of family Therapy, 28, 275–282. doi:10.1080/01926180050081702.

    Article  Google Scholar 

  • Schoenwald, S., Sheidow, A., & Letourneau, E. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, clinician fidelity, and child outcomes. Journal of Clinical Child and Adolescent Psychology, 33, 94–104. doi:10.1207/S15374424JCCP3301_10.

    Article  PubMed  Google Scholar 

  • Shostack, L. G. (1982). How to design a service. European Journal of Marketing, 16, 49–63. doi:10.1108/EUM0000000004799.

    Article  Google Scholar 

  • Shostack, L. G. (1984). Design services that deliver. Harvard Business Review, 84115, 133–139. Retrieved from http://hbr.org/1984/01/designing-services-that-deliver/ar/1

  • Sitzmann, T., Bell, B., Kraiger, K., & Kanar, A. (2009). A multilevel analysis of the effect of prompting self-regulation in technology-delivered instruction. Personnel Psychology, 62, 697–734. doi:10.1111/j.1744-6570.2009.01155.x.

    Article  Google Scholar 

  • Stetler, C., Legro, M., Wallace, C., Bowman, C., Guihan, M., Hagedorn, H., et al. (2006). The role of formative evaluation in implementation research and the QUERI experience. Journal of General Internal Medicine, 21, S1–S8. doi:10.1007/s11606-006-0267-9.

    Article  PubMed  Google Scholar 

  • Tunis, S., Stryer, D., & Clancy, C. (2003). Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. JAMA, 290, 1624–1632. doi:10.1001/jama.290.12.1624.

    Article  PubMed  CAS  Google Scholar 

  • Turner, K., & Sanders, M. (2005). Dissemination of evidence-based parenting and family support strategies: Learning from the Triple P—Positive parenting program system approach. Aggression and Violent Behavior, 11, 176–193. doi:10.1016/j.avb.2005.07.005.

    Article  Google Scholar 

  • Twigg, C. (2001). Innovations in online learning: Moving beyond no significant difference. The Pew Learning and Technology Program. Retrieved from http://www.thencat.org/Monographs/Innovations.html

  • von Hippel, E. (2005). Democritizing innovation. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Webb, C., DeRubeis, R., & Barber, J. (2010). Clinician adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78, 200–211. doi:10.1037/a0018912.

    Article  PubMed  Google Scholar 

  • Weingardt, K. (2004). The role of instructional design and technology in the dissemination of empirically supported, manual based therapies. Clinical Psychology: Science & Practice, 11, 313–331. doi:10.1093/clipsy/bph087.

    Article  Google Scholar 

  • Weingardt, K., Cucciare, M., Bellotti, C., & Lai, W. (2009). A randomized trial comparing two models of web based training in cognitive-behavioral therapy for substance abuse counselors. Journal of Substance Abuse Treatment, 37, 219–227. doi:10.1016/j.jsat.2009.01.002.

    Article  PubMed  Google Scholar 

  • Weingardt, K., Villafranca, S., & Levin, C. (2006). Technology-based training in cognitive behavioral therapy for substance abuse counselors. Substance Abuse, 27, 19–25. doi:10.1300/J465v27n03_04.

    Article  PubMed  Google Scholar 

  • Weisz, J., & Chorpita, B. (in press). Mod squad for youth psychotherapy: Restructuring evidence-based treatment for clinical practice. In P. C. Kendall (Ed.), Child and adolescent therapy: Cognitive-behavioral procedures (4th ed.). New York: Guilford Press.

  • Williams, C., & Martinez, R. (2008). Increasing access to CBT: Stepped care and CBT self-help models in practice. Behavioral and Cognitive Psychotherapy, 36, 675–683. doi:10.1017/S1352465808004864.

    Article  Google Scholar 

  • Young, J., & Beck, A. (1980). The development of the Cognitive Therapy Scale. Unpublished manuscript, University of Pennsylvania, Philadelphia, PA.

Download references

Acknowledgments

This work was facilitated by NIH grant MH083333 (Ms. Beidas) and MH64484 (Dr. Kendall). Ms. Beidas and Dr. Koerner contributed equally to this manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rinad S. Beidas.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Beidas, R.S., Koerner, K., Weingardt, K.R. et al. Training Research: Practical Recommendations for Maximum Impact. Adm Policy Ment Health 38, 223–237 (2011). https://doi.org/10.1007/s10488-011-0338-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-011-0338-z

Keywords

Navigation