This resource collection contains resources and tools that evaluators can use to develop logic models; select outcomes; and design, conduct, and synthesize implementation and impact findings.
Logic Models
Innovation Network, Inc. Logic Model Workbook. Washington, DC: Innovation Network, Inc.; n.d.
Petersen D, Taylor EF, Peikes D. Logic Models: The Foundation to Implement, Study, and Refine Patient-Centered Medical Home Models. AHRQ Publication No.13-0029-EF. Rockville, MD: Agency for Healthcare Research and Quality; March 2013.
W.K. Kellogg Foundation. Logic Model Development Guide. Battle Creek, MI: W.K. Kellogg Foundation; December 2001:35-48.
Agency for Healthcare Research and Quality. Consumer Assessment of Healthcare Providers and Systems (CAHPS). Rockville, MD: Agency for Healthcare Research and Quality; 2012.
Rosenthal M, Abrams M, Bitton A. The Patient-Centered Medical Home Evaluators’ Collaborative. Recommended core measures for evaluating the patient-centered medical home: cost, utilization, and clinical quality. Commonwealth Fund; May 2012(12).
Implementation Analysis
Alexander JA, Hearld LR. The science of quality improvement implementation: developing capacity to make a difference. Med Care. 2011 December;49(Suppl):S6-20.
Bitton A, Schwartz GR, Stewart EE, et al. Off the hamster wheel? Qualitative evaluation of a payment-linked patient-centered medical home (PCMH) pilot. Milbank Q. 2012 September;90(3):484-515. doi: 10.1111/j.1468-0009.2012.00672.x.
Bloom H, ed. Learning More from Social Experiments. New York: Russell Sage Foundation; 2006.
Crabtree B, Workgroup Collaborators. Evaluation of Patient Centered Medical Home Practice Transformation Initiatives. Washington: The Commonwealth Fund; November 2010.
Damschroder L, Aron D, Keith R, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci.2009;4(1):50.
Damschroder L, Peikes D, Petersen D. Using Implementation Research to Guide Adaptation, Implementation, and Dissemination of Patient-Centered Medical Home Models. AHRQ Publication No.13-0027-EF. Rockville, MD: Agency for Healthcare Research and Quality; March 2013.
Goldman RE, Borkan J. Anthropological Approaches: Uncovering Unexpected Insights About the Implementation and Outcomes of Patient-Centered Medical Home Models. Rockville, MD: Agency for Healthcare Research and Quality; March 2013. AHRQ Publication No.13-0022-EF.
Nutting PA, Crabtree BF, Stewart EE, et al. Effects of facilitation on practice outcomes in the National Demonstration Project model of the patient-centered medical home. Ann Fam Med. 2010;8(Suppl1):s33-s44.
Plsek PE, Greenhalgh T. Complexity science: the challenge of complexity in health care. BMJ 2001;323:625-8.
Potworowski G, Green, LA. Cognitive Task Analysis: Methods to Improve Patient-Centered Medical Home Models by Understanding and Leveraging Its Knowledge Work. AHRQ Publication No.13-0023-EF.Rockville, MD: Agency for Healthcare Research and Quality; March 2013.
Rossi PH, Lipsey MW, Freeman HE. Evaluation: A Systematic Approach. 7th ed. Thousand Oaks, CA: Sage Publications; 2004.
Stange K, Nutting PA, Miller WL, et al. Defining and measuring the patient-centered medical home. J Gen Int Med. June 2010;25(6):601-12.
Wholey JS, Hatry HP, and Newcomer KE, eds. Handbook of Practical Program Evaluation. San Francisco: Jossey-Bass/John Wiley & Sons; 2010.
Impact Analysis
Overview
Hickam, D, Totten A, Berg A, et al., eds. The PCORI Methodology Report. November 2013.
Jaén CR, Ferrer RL, Miller WL, et al. Patient outcomes at 26 months in the patient-centered medical home. National Demonstration Project. Ann Fam Med. 2010;8(Suppl 1):s57-s67.
Meyers D, Peikes D, Dale S, et al. Improving Evaluations of the Medical Home. Rockville, MD: Agency for Healthcare Research and Quality; September 2011. AHRQ Publication No. 11-0091.
Orr, L. Social Experiments: Evaluating Public Programs with Experimental Methods. Thousand Oaks, CA: Sage Publications; 1999.
Shadish, WR, Cook, TD, Campbell, DT. Experimental and Quasi-Experimental Designs for General Causal Inference. Boston: Houghton Mifflin Company; 2001.
Stepped Wedge (Randomized Rollout) Designs
Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28:182-91.
Calculating Power When Data Are Clustered
Peikes D, Dale S, Lundquist E, et al. Building the Evidence Base for the Medical Home: What Sample and Sample Size Do Studies Need? Rockville, MD: Agency for Healthcare Research and Quality; October 2011. AHRQ Publication No. 11-0100-EF. White paper prepared by Mathematica Policy Research under contract no. HHSA290200900019I TO2.
Adjusting for Multiple Comparisons
Schochet, PZ. An Approach for Addressing the Multiple Testing Problem in Social Policy Impact Evaluations. Eval Rev. 2009 December;33(6).
Orthogonal Design
Collins LM, Murphy S, Strecher V. The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART). New methods for more potent ehealth interventions. Am J Prev Med. 2007;32:112‐18.
Zurovac J, Peikes D, Zutshi A, Brown R. Efficient Orthogonal Designs: Testing the Comparative Effectiveness of Alternative Ways of Implementing Patient-Centered Medical Home Models. AHRQ Publication No.13-0024-EF. Rockville, MD: Agency for Healthcare Research and Quality; March 2013.
Propensity Score Matching
Peikes D, Moreno L, Orzol S. Propensity score matching: A note of caution for evaluators of social programs. Am Statistician 2008;62:222-31. Methods
Creswell JW, Klassen AC, Plano Clark VL, et al., for the Office of Behavioral and Social Sciences Research. Best Practices for Mixed Methods Research in the Health Sciences. Bethesda, MD: National Institutes of Health; August 2011.
Miller WL, Crabtree BF, Harrison MI, et al. Integrating mixed methods in health services and delivery system research. Health Serv Res. 2013 December;48(6 Part II).
Wisdom J, Creswell JW. Mixed Methods: Integrating Quantitative and Qualitative Data Collection and Analysis While Studying Patient-Centered Medical Home Models. AHRQ Publication No.13-0028-EF. Rockville, MD: Agency for Healthcare Research and Quality; March 2013.
