Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–94.

Article  PubMed  PubMed Central  Google Scholar 

Goodman D, Ogrinc G, Davies L, Baker GR, Barnsteiner J, Foster TC, et al. Explanation and elaboration of the SQUIRE (Standards for Quality Improvement Reporting Excellence) Guidelines, V. 2.0: examples of SQUIRE elements in the healthcare improvement literature. BMJ qual saf. 2016;25(12):e7-e.

Article  Google Scholar 

Krause J, Van Lieshout J, Klomp R, Huntink E, Aakhus E, Flottorp S, et al. Identifying determinants of care for tailoring implementation in chronic diseases: an evaluation of different methods. Implement Sci. 2014;9(1):1–12.

Article  Google Scholar 

Baker R, Camosso‐Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N, Wensing M, Fiander M, Eccles MP, Godycki‐Cwirko M. Tailored interventions to address determinants of practice. Cochrane Database Syst Rev. 2015(4).

Wensing M. The tailored implementation in chronic diseases (TICD) project: introduction and main findings. Implement Sci. 2017;12(1):5.

Article  PubMed  PubMed Central  Google Scholar 

Lewis CC, Scott K, Marriott BR. A methodology for generating a tailored implementation blueprint: an exemplar from a youth residential setting. Implement Sci. 2018;13(1):1–13.

Article  Google Scholar 

Lewis CC, Boyd M, Puspitasari A, Navarro E, Howard J, Kassab H, et al. Implementing measurement-based care in behavioral health: a review. JAMA Psychiat. 2019;76(3):324–35.

Article  Google Scholar 

Lambert MJ, Whipple JL, Hawkins EJ, Vermeersch DA, Nielsen SL, Smart DW. Is it time for clinicians to routinely track patient outcome? a meta-analysis. Clin Psychol Sci Pract. 2003;10(3):288.

Article  Google Scholar 

Lambert MJ, Whipple JL, Kleinstäuber M. Collecting and delivering progress feedback: a meta-analysis of routine outcome monitoring. Psychotherapy. 2018;55(4):520.

Article  PubMed  Google Scholar 

Brattland H, Koksvik JM, Burkeland O, Gråwe RW, Klöckner C, Linaker OM, et al. The effects of routine outcome monitoring (ROM) on therapy outcomes in the course of an implementation process: a randomized clinical trial. J Couns Psychol. 2018;65(5):641.

Article  PubMed  Google Scholar 

Peterson AP, Fagan C. Training the next generation in routine outcome monitoring: current practices in psychology training clinics. Train Educ Prof Psychol. 2017;11(3):182.

Google Scholar 

Lewis CC, Marti CN, Scott K, Walker MR, Boyd M, Puspitasari A, et al. Standardized versus tailored implementation of measurement-based care for depression in community mental health clinics. Psychiatric Services. 2022:appi. ps. 202100284.

Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.

Article  PubMed  Google Scholar 

Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs—principles and practices. Health Serv Res. 2013;48(6pt2):2134–56.

Article  PubMed  PubMed Central  Google Scholar 

Löwe B, Kroenke K, Fau - Herzog W, Herzog W, Fau - Gräfe K, Gräfe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9). J Affect Disord. 2004;81(1):61–6.

Article  PubMed  Google Scholar 

Levis B, Benedetti A, Thombs BD. Accuracy of Patient Health Questionnaire-9 (PHQ-9) for screening to detect major depression: individual participant data meta-analysis. BMJ. 2019;365:l1476.

Article  PubMed  PubMed Central  Google Scholar 

Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59.

Article  PubMed  Google Scholar 

Schoonenboom J, Johnson RB. How to construct a mixed methods research design. KZfSS Kölner Zeitschrift für Soz Sozialpsychol. 2017;69(2):107–31.

Article  Google Scholar 

Chamberlain P, Brown CH, Saldana L, Reid J, Wang W, Marsenich L, et al. Engaging and recruiting counties in an experiment on implementing evidence-based practice in California. Admin Policy Ment Health Ment Health Serv Res. 2008;35(4):250–60.

Article  Google Scholar 

Lewis CC, Scott K, Marti CN, Marriott BR, Kroenke K, Putz JW, et al. Implementing measurement-based care (iMBC) for depression in community mental health: a dynamic cluster randomized trial study protocol. Implement Sci. 2015;10(1):1–14.

Article  Google Scholar 

Lewis CC, Puspitasari A, Boyd MR, Scott K, Marriott BR, Hoffman M, et al. Implementing measurement based care in community mental health: a description of tailored and standardized methods. BMC Health Serv Res. 2018;11(1):76.

Google Scholar 

Valente TW, Chou CP, Pentz MA. Community coalitions as a system: effects of network change on adoption of evidence-based substance abuse prevention. Am J Public Health. 2007;97(5):880–6.

Article  PubMed  PubMed Central  Google Scholar 

Jensen-Doss A, Haimes EM, Smith AM, Lyon AR, Lewis CC, Stanick CF, Hawley KM. Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Adm Policy Mental Health Mental Health Serv Res. 2018;45(1):48–61.

Mendel P, Meredith L, Schoenbaum M, Sherbourne C, Wells K. Interventions in organizational and community context: a framework for building evidence on dissemination and implementation in health services research. Admin Policy Ment Health Men Health Serv Res. 2008;35(1–2):21–37.

Article  Google Scholar 

Singer JD, Willet JB. Applied longitudinal data analysis: modeling change and event occurrence. New York, NY: Oxford University Press; 2003.

Book  Google Scholar 

RStudio Team. RStudio: integrated development environment for R. RStudio, PBC. 2021.

MacKinnon D. Introduction to statistical mediation analysis. New York, NY: Routledge Academic; 2008.

Bates DM, Sarkar D. lme4: linear mixed-effects models using S4 classes. Package 0.99875–6 ed: Comprehensive R Archive Network; 2007.

Knowles JE, Frederick C. merTools: tools for analyzing mixed effect regression models. 2019.

Rubin M. When to adjust alpha during multiple testing: a consideration of disjunction, conjunction, and individual testing. Synthese. 2021;199(3):10969–1000.

Article  Google Scholar 

Gelman A, Hill J. Data analysis using regression and multilevel/hierarchical models (final version: 5 July 2006) Please do not reproduce in any form without permission.

Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Admin Policy Ment Health Ment Health Serv Res. 2015;42(5):533–44.

Article  Google Scholar 

Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24(2):105–12.

Article  CAS  PubMed  Google Scholar 

Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.

Article  PubMed  Google Scholar 

Charmaz K. Constructing grounded theory: a practical guide through qualitative analysis. London: Sage Publications; 2006.

Google Scholar 

Hair J, Anderson R, Black B, Babin B. Multivariate data analysis: pearson education; 2016.

Broome KM, Flynn PM, Knight DK, Simpson DD. Program structure, staff perceptions, and client engagement in treatment. J Subst Abuse Treat. 2007;33(2):149–58.

Article  PubMed  PubMed Central  Google Scholar 

Salyers MP, Rollins AL, McGuire AB, Gearhart T. Barriers and facilitators in implementing illness management and recovery for consumers with severe mental illness: trainee perspectives. Adm Policy Ment Health. 2009;36(2):102–11.

Article  PubMed  Google Scholar 

Boyd MR, Powell BJ, Endicott D, Lewis CC. A method for tracking implementation strategies: an exemplar implementing measurement-based care in community behavioral health clinics. Behav Ther. 2018;49(4):525–37.

Article  PubMed  Google Scholar 

Franco GE. Productivity standards: do they result in less productive and satisfied therapists? US: Educational Publishing Foundation; 2016. p. 91–106.

Google Scholar 

Burke LA, Saks AM. Accountability in training transfer: adapting schlenker’s model of responsibility to a persistent but solvable problem. Hum Resour Dev Rev. 2009;8(3):382–402.

Article  Google Scholar 

Westerlund A, Nilsen P, Sundberg L. Implementation of implementation science knowledge: the research practice gap paradox. Worldviews Evid-Based Nurs. 2019;16(5):332.

Article  PubMed  PubMed Central  Google Scholar 

Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10:11.

Article  PubMed  PubMed Central  Google Scholar 

Skar AS, Braathu N, Peters N, Bækkelund H, Endsjø M, Babaii A, et al. A stepped-wedge randomized trial investigating the effect of the Leadership and Organizational Change for Implementation (LOCI) intervention on implementation and transformational leadership, and implementation climate. BMC Health Serv Res. 2022;22(1):298.

Article  PubMed  PubMed Central  Google Scholar 

Lyon AR, Liu FF, Connors EH, King KM, Coifman JI, Cook H, McRee E, Ludwig K, Law A, Dorsey S, McCauley E. How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care. Implement Sci Commun. 2022;3(1):1–5.

Aarons GA, Sommerfeld DH, Willging CE. The soft underbelly of system change: the role of leadership and organizational climate in turnover during statewide behavioral health reform. Psychol Serv. 2011;8(4):269–81.

Article  PubMed  PubMed Central  Google Scholar 

Bunger AC, Birken SA, Hoffman JA, MacDowell H, Choy-Brown M, Magier E. Elucidating the influence of supervisors’ roles on implementation climate. Implement Sci. 2019;14(1):93.

Article  PubMed  PubMed Central  Google Scholar 

Brimhall KC, Fenwick K, Farahnak LR, Hurlburt MS, Roesch SC, Aarons GA. Leadership, organizational climate, and perceived burden of evidence-based practice in mental health services. Adm Policy Ment Health. 2016;43(5):629–39.

Article  PubMed  PubMed Central  Google Scholar 

Tang MY, Rhodes S, Powell R, McGowan L, Howarth E, Brown B, et al. How effective are social norms interventions in changing the clinical behaviours of healthcare workers? A systematic review and meta-analysis. Implement Sci. 2021;16(1):8.

Article  PubMed  PubMed Central  Google Scholar 

Schneider B, Ehrhart MG, Macey WH. Organizational climate and culture. Annu Rev Psychol. 2013;64:361–88.

Article  PubMed