Skip to main content
Sign In


Online and published resources for Funding, Study Planning and Evaluation in Dissemination and Implementation


Highlighted Resources include: 

Recent Internal Resources from the D&I Program:

Holtrop, J., Rabin B., Glasgow, R. (2018) Dissemination and Implementation Science in Primary Care Research and Practice: Contributions and Opportunities. J Am Board Fam Med. DOI: 10.3122/jabfm.2018.03.170259. vol. 31 no. 3. (466-478) Read the Article​

Rabin, B., Mccreight, M., Battaglia, C., Ayele, R., Burke, R., Hess, P., . . . Glasgow, R. (2018). Systematic, Multimethod Assessment of Adaptations Across Four Diverse Health Systems Interventions. Frontiers in Public Health, 6, 102. Read the Article​

Harden, S., Smith, M., Ory, M., Smith-Ray, R., Estabrooks, P., & Glasgow, R. (2018). RE-AIM in Clinical, Community, and Corporate Settings: Perspectives, Strategies, and Recommendations to Enhance Public Health Impact. Frontiers in Public Health, 6, 71. Read the Article​

Holtrop, J., Rabin, B., & Glasgow, R. (2018) Qualitative approaches to use of the RE-AIM framework: rationale and methods. BMC Health Services Research. 18:177. doi: 10.1186/s12913-018-2938-8. Read the Article

COIN | VA Triple Aim QUERI project has developed an Adaptations Interview Guide for staff implementing the TAQ program. ​Guide Under Development and COMING SOON

Glasgow RE, Estabrooks PE. (2018). Pragmatic Applications of RE-AIM for Health Care Initiatives in Community and Clinical Settings. Prev Chronic Dis;15:170271.  Read the Article​

Holtrop, J. S., et al. (2018). "Using Social Network Analysis to Examine the Effect of Care Management Structure on Chronic Disease Management Communication Within Primary Care." J Gen Intern Med. Read the Article​

RE-AIM Planning Approach to Enhance Translation and Dissemination: Questions to ask when planning programs or developing assessment plans Download the RE-AIM guide​

Feldstein, A. C. and R. E. Glasgow (2008). "A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice." Jt Comm J Qual Patient Saf 34(4): 228-243. Download the Article

Glasgow, & Russell E. (2010). Interactive Media for Diabetes Self-Management: Issues in Maximizing Public Health Impact. Medical Decision Making, 30(6), 745-758.​ Download the Article

Kwan, B., Chadha, S., Hamer, M., Spagnolo, D., & Kee, S. (2017). Mixed methods evaluation of a collaborative care implementation using RE-AIM. Families, Systems & Health : The Journal of Collaborative Family Healthcare,35(3), 295-307. Read the Article 

Holtrop JS, Hall TL, Rubinson C, Dickinson LM, Glasgow RE. What Makes for Successful Registry Implementation: A Qualitative Comparative Analysis. J Am Board Fam Med. 2017 Sep-Oct;30(5):657-665. doi: 10.3122/jabfm.2017.05.170096. PubMed PMID: 28923818. Read the Article

Luoma, K. A., Leavitt, I. M., Marrs, J. C., Nederveld, A. L., Regensteiner, J. G., Dunn, A. L., . . . Huebschmann, A. G. (2017, June 06). How can clinical practices pragmatically increase physical activity for patients with type 2 diabetes? A systematic       review. PMID: 28589531 DOI: 10.1007/s13142-017-0502-4 Read the Article

Bayliss, E. A., Bonds, D. E., Boyd, C. M., Davis, M. M., Finke, B., Fox, M. H., . . . Stange, K. C. (2014, May). Understanding the Context of Health for Persons With Multiple Chronic Conditions: Moving From What Is the Matter to What Matters. ​Annals of Family Medicine. May/June 2014. Vol.12, No.3. 260-269. Download the Article

Glasgow, Russell E. (2013). What Does It Mean to Be Pragmatic? Pragmatic Methods, Measures, and Models to Facilitate Research Translation. Health Education & Behavior, 40(3), 257-265. Read the Article​

Morrato, E., Rabin, B., Proctor, J., Cicutto, L., Battaglia, C., Lambert-Kerzner, A., . . . Kempe, A. (2015). Bringing it home: Expanding the local reach of dissemination and implementation training via a university-based workshop. Implementation Science : IS, 10, 94. Read the Article​

Smith, M., & Morrato, E. (2014). Advancing the Field of Pharmaceutical Risk Minimization Through Application of Implementation Science Best Practices. Drug Safety,37(8), 569-580. Read the Article

Solberg, L., Crain, A., Maciosek, M., Unützer, J., Ohnsorg, K., Beck, A., . . . Glasgow, R. (2015). A stepped-wedge evaluation of an initiative to spread the collaborative care model for depression in primary care. Annals of Family Medicine, 13(5), 412-20. Read the Article


Cover thumbnail.JPG
Getting D&I Ideas Funded Workbook 

 --Developed by the University of Colorado Denver D&I Program and affiliates.

D&I Competencies​

  --Developed by R. Brownson and MT-DIRC colleagues

​Atkins, Kilbourne, & Shulkin. (n.d.). Moving From Discovery to System-Wide Change: The Role of Research in a Learning Health Care System: Experience from Three Decades of Health Systems Research in the Veterans Health Administration. Annual Review of Public Health, 38, 467-487. Read the Article​

Brownson, R., Eyler, A., Harris, J., Moore, J., & Tabak, R. (2018). Getting the Word Out: New Approaches for Disseminating Public Health Science. Journal of Public Health Management and Practice : JPHMP, 24(2), 102-111. Read the article

Brownson, Allen, Jacob, Harris, Duggan, Hipp, & Erwin. (2015). Understanding Mis-implementation in Public Health Practice. American Journal of Preventive Medicine, 48(5), 543-551. Read the Article​​​​ 

Burke, R., & Shojania, K. (2018). Rigorous evaluations of evolving interventions: Can we have our cake and eat it too? BMJ Quality & Safety, BMJ Quality & Safety, 9 February 2018. Read the Article

Colquhoun, H., Leeman, J., Michie, S., Lokker, C., Bragge, P., Hempel, S., . . . Grimshaw, J. (2014). Towards a common terminology: A simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implementation Science : IS, 9, 51. Read the Article

Forrest, C., Chesley, F., Tregear, M., & Mistry, K. (2017). Development of the Learning Health System Researcher Core Competencies. Health Services Research, Health services research, 04 August 2017. Read the Article​

Hamilton, A., Mittman, B., Campbell, D., Hutchinson, C., Liu, H., Moss, N., & Wyatt, G. (2018). Understanding the impact of external context on community-based implementation of an evidence-based HIV risk reduction intervention. BMC Health Services Research,18(1), 11. Read the Article​

Kilbourne, A. M., et al. (2007). "Implementing evidence-based interventions in health care: application of the replicating effective programs framework." Implement Sci 2: 42. Read the Article​

Kilbourne, A. M., Elwy, A. R., Sales, A. E., & Atkins, D. (2017). Accelerating Research Impact in a Learning Health Care System: VA’s Quality Enhancement Research Initiative in the Choice Act Era. Medical Care, 55 Suppl 7 Suppl 1(7 Suppl 1), S4-S12. Read the Article

Kimmey, Laura. (2015). PCORI Dissemination and Implementation Framework. 1Download the Framework

Lokker, C., McKibbon, K., Colquhoun, H., & Hempel, S. (2015). A scoping review of classification schemes of interventions to promote and integrate evidence into practice in healthcare. Implementation Science : IS, 10, Implementation Science : IS, 2015, Vol.10. Read the Article

Moore, J., Mascarenhas, A., Bain, J., & Straus, S. (2017). Developing a comprehensive definition of sustainability. Implementation Science : IS, 12(1), 110. Read the Article

Padek, M., Mir, N., Jacob, R., Chambers, D., Dobbins, M., Emmons, K., . . . Brownson, R. (2018). Training scholars in dissemination and implementation research for cancer prevention and control: A mentored approach. Implementation Science : IS, 13(1), 18.

Persaud, D. D. (2014). Enhancing Learning, Innovation, Adaptation, and Sustainability in Health Care Organizations: The ELIAS Performance Management Framework. The Health Care Manager, 33(3), 183-204. Read the Article​​

Tinkle, M., et al. (2013). "Dissemination and Implementation Research Funded by the US National Institutes of Health, 2005–2012." Nursing Research and Practice 2013(4). Read the Article​

Weiss CH, Krishnan JA, Au DH, et al.  An Official American Thoracic Society Research Statement: Implementation Science in Pulmonary, Critical Care, and Sleep Medicine.  American Journal of Respiratory and Critical Care Medicine. 2016 Oct; 194(8). Read the Article​


Resources for Practical Measures for D&I Research​​    

The ‘Ultimate Use’ question for D&I measurement (a goal; not achievable in any one project but to guide priority setting):

“what interventions (programs or policies) and what components of these interventions, conducted under what conditions and in what settings, conducted by which agents, is effective in producing which outcomes, for which populations (and subgroups), how much does it cost, and how does it comes about?​"

​Click Title to view Article source

Burke, R., & Shojania, K. (2018). Rigorous evaluations of evolving interventions: Can we have our cake and eat it too?​ BMJ Quality & Safety, BMJ Quality & Safety, 9 February 2018.

Rabin B, Purcell P, and Glasgow RE (2013). Harmonizing Measures for Implementation Science using Crowd-Sourcing. Clinical Medicine and Research, September;11(3):158.

Rabin B, Purcell P, Naveed S, Moser R, Henton M, Proctor EK, Brownson RC, Glasgow RE (2012). Advancing the Application, Quality, and Harmonization of Implementation Science Measures. Implementation Science, Dec 11;7:119

Glasgow RE (2009). Critical Measure Issues in Translational Research. Research on Social Work Practice 19:560-568.

Glasgow RE, Kaplan R, Ockene J, Fisher EB, Emmons KM, Society of Behavioral Medicine Health Policy Committee (2012). Patient-Reported Measures of Psychosocial Issues And Health Behavior Should be Added to Electronic Health RecordsHealth Affairs   31:3497-504. 

Fernald, D.H., Froshaug, D., Dickinson, M., Balasubramanian, B.A., Dodoo, M., Holtrop, J.S., Hung, D., Glasgow, R.E., et al. (2008). A field test of brief health behavior measures in primary care: Results from the COMBO study. American Journal of Preventive Medicine 35(5S):S414-S422.

Fisher, L., Glasgow, R.E., Mullan, J., Skaff, M. (2008). Development of a Brief Diabetes Distress Screening Instrument. Annals of Family Medicine 6(3):246-252.

McCormack, L.A., Bann, C., Williams-Piehota, P.A., Burton, J., Kamerow, D., Square, C., Fisher, E., Glasgow, R.E.. (2008). Development and Validation of an Instrument to Measure Resources and Support for Illness Self-Management: A Model Using Diabetes. The Diabetes Educator, 34(4):707-718.

Schmittdiel, J., Mosen, D.M., Glasgow, R.E., Hibbard, J., Sobel, D., Remmers, C., Bellows, J. (2008) Patient Assessment of Chronic Illness Care (PACIC) and Improve Processes and Outcomes for Chronic Conditions. Journal of General Internal Medicine, 23(1)77-80.

Glasgow, R. E., Toobert, D.J., and Barrera, M., Jr. (2005). The Chronic Illness Resources Survey: Cross-Validation and Sensitivity to Intervention. Health Education Research, 29(4):402-409.1.

Glasgow, R. E., Ory, M.G., Klesges, L.M., Cifuentes, M., Fernald, D.H., and Green, L.A. (2005). Practical and Relevant Self-Report Measures of Patient Health Behaviors for Primary Care Research. Annals of Family Medicine, 3:73-81.

Glasgow, R. E., Wagner, E., Schaefer, J., Mahoney, L., Reid, R.J., and Greene, S. (2005). Development and Validation of the Patient Assessment of Chronic Illness Care (PACIC). Medical Care, 43(5):436-444.

Bonomi, A.E., Glasgow, R. E., Wagner, E.H., et al. (2002). Assessment of Chronic Illness Care: A Practical Tool for Quality Improvement. Health Services Research 37(3):791-820.

Glasgow, R. E., Gillette, C., Toobert, D.J. (2001) Psychosocial Barriers to Diabetes Self-Management and Quality of Life. Diabetes Spectrum, 14(1):

Glasgow, R. E., Strycker, L.A., Toobert, D.J., and Eakin, E.G. (2000). The Chronic Illness Resources Survey: A social-ecologic support for disease self-management. Journal of Behavioral Medicine, 2000;23:559-583.

Toobert, D. J., Glasgow, R. E., and Hampson, S. (2000). The Summary of Diabetes Self-Care Activities Measure: Results from Seven Studies and a Revised Scale. Diabetes Care, 2000;23:943-950.

Glasgow RE and Riley T (2013). Pragmatic Measures: What They Are and Why We Need Them.​ American Journal of Preventive Medicine, August;45(2):237-43.

Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., . . . Halko, H. (2017). Psychometric assessment of three newly developed implementation outcome measures. Implementation Science. 12:108.

Sauro, J., Johnson, K., Meenan, C. (2017) “From Snake-Oil to Science: Measuring UX Maturity.” Proceedings of the Conference in Human Factors in Computing Systems. Denver, CO, USA.

Bennett, W. L., et al. (2017). AHRQ Comparative Effectiveness Reviews. Methods for Evaluating Natural Experiments in Obesity: Systematic Evidence Review. Rockville (MD), Agency for Healthcare Research and Quality (US).

Resources for Intervention Design 

​​​Making Communication More Patient-Centered

Patient-centered communication has been linked to greater patient satisfaction, treatment adherence, and quality of life, and has the potential to help patients:

Handle the emotional impact of a diagnosis
Make sense of complex medical information
Manage side effects and symptoms
Make informed decisions about their care
Deal with uncertainties
Adopt health-promoting behaviors

RTI International, along with partners from the University of North Carolina at Chapel Hill and Fight Colorectal Cancer, recently developed a publicly available, easy-to-use survey and user guide for measuring patient-centered communication in cancer care.
The user guide aims to help cancer researchers and practitioners identify gaps in patient-centered communication, which considers the patient’s needs and values, involves the patient in care decisions, and builds stronger patient-clinician relationships. The ultimate goal of this tool is to improve communication with patients who have cancer.

This instrument​ is available as both a 36- and 6-item questionnaire and can be self-administered using a paper- or Web-based survey.​
D&I Evaluation Resources​

   Other References for D&I​

King, D., Gonzalez, S., Hartje, J., Hanson, B., Edney, C., Snell, H., . . . Roget, N. (2018). Examining the sustainability potential of a multisite pilot to integrate alcohol screening and brief intervention within three primary care systems. Translational Behavioral Medicine, Translational behavioral medicine, 23 January 2018.

Bartholomew, L.K., Parcel, G.S., Kok, G., Gottlieb, N.H., and Fernández, M.E., Planning Health Promotion Programs: An Intervention Mapping Approach. 3rd ed ed. 2011, San Francisco: Jossey-Bass.

Brownson, R.C., Colditz, G.A., and Proctor, E.K., Dissemination and implementation research in health:  Translating science to practice. 1st ed. 2012, New York: Oxford University Press.

Fort, D. G., Herr, T. M., Shaw, P. L., Gutzman, K. E., & Starren, J. B. (2017). Mapping the evolving definitions of translational research. Journal of Clinical and Translational Science1(1), 60–66.

Fleuren, M., Wiefferink, K., & Paulussen, T. (2004). Determinants of innovation within health care organizations: Literature review and Delphi study. International Journal for Quality in Health Care : Journal of the International Society for Quality in Health Care, 16(2), 107-23.

Flottorp, Signe, F., Oxman, Andrew David, O., Krause, Jane, K., Musila, Nyokabi R., M., Wensing, Michel, W., Godycki-Cwirko, Maciek, G., . . . Eccles, Martin P., E. (2013). A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. 8(1), 35.

Klesges, L.M., Estabrooks, P.A., Dzewaltowski, D.A., Bull, S.S., and Glasgow, R.E. (2005) Beginning with the application in mind: designing and planning health behavior change interventions to enhance dissemination. Annals of behavioral medicine : a publication of the Society of Behavioral Medicine. 29 Suppl: 66-75.

McDonald, K.M. (2013) Considering context in quality improvement interventions and implementation: concepts, frameworks, and application. Academic pediatrics. 13(6 Suppl): S45-53.

Proctor, E., Powell, B.J., and McMillen, J.C. (2013) Implementation strategies: recommendations for specifying and reporting. Implementation science : IS. 8: 139.

Rogers, E.M., Diffusion of innovations. 5th ed. 2003, New York: Free Press. xxi, 551 p.

Tomoaia-Cotisel, A., Scammon, D.L., Waitzman, N.J., Cronholm, P.F., Halladay, J.R., Driscoll, D.L., Solberg, L.I., Hsu, C., Tai-Seale, M., Hiratsuka, V., Shih, S.C., Fetters, M.D., Wise, C.G., Alexander, J.A., Hauser, D., McMullen, C.K., Scholle, S.H., Tirodkar, M.A., Schmidt, L., Donahue, K.E., Parchman, M.L., and Stange, K.C. (2013) Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Annals of family medicine. 11 Suppl 1: S115-23.​

Chambers, D.A., Glasgow, R.E., and Stange, K.C. (2013) The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implementation science : IS. 8: 117.

Davidoff, F., Batalden, P., Stevens, D., Ogrinc, G., Mooney, S., and Group, S.D. (2008) Publication guidelines for improvement studies in health care: evolution of the SQUIRE Project. Annals of internal medicine. 149(9): 670-6.

Gaglio, B., Shoup, J.A., and Glasgow, R.E. (2013) The RE-AIM framework: a systematic review of use over time. American journal of public health. 103(6): e38-46.

Glasgow, R.E.and Emmons, K.M. (2007) How can we increase translation of research into practice? Types of evidence needed. Annual review of public health. 28: 413-33.

Glasgow, R.E., Vinson, C., Chambers, D., Khoury, M.J., Kaplan, R.M., and Hunter, C. (2012) National Institutes of Health approaches to dissemination and implementation science: current and future directions. American journal of public health. 102(7): 1274-81.

Glasgow, R.E.and Chambers, D. (2012) Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clinical and translational science. 5(1): 48-55.​

Gold, M.R., Siegel, J.E., Russell, L.B., and Weinstein, M.C., Cost-effectiveness in health and medicine. 2003, New York: Oxford University Press.

Green, L.W.and Glasgow, R.E. (2006) Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Evaluation & the health professions. 29(1): 126-53.​

Husereau, D., Drummond, M., Petrou, S., Carswell, C., Moher, D., Greenberg, D., Augustovski, F., Briggs, A.H., Mauskopf, J., Loder, E., and Force, C.T. (2013) Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Bmj. 346: f1049.

Kessler, R.S., Purcell, E.P., Glasgow, R.E., Klesges, L.​M., Benkeser, R.M., and Peek, C.J. (2013) What does it mean to "employ" the RE-AIM model? Evaluation & the health professions. 36(1): 44-66.

Klassen, A.C., Creswell, J., Plano Clark, V.L., Smith, K.C., and Meissner, H.I. (2012) Best practices in mixed methods for quality of life research. Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation. 21(3): 377-80.

Leviton, L.C., Khan, L.K., Rog, D., Dawkins, N., and Cotton, D. (2010) Evaluability assessment to improve public health policies, programs, and practices. Annual review of public health. 31: 213-33.

Peters, D.H., Adam, T., Alonge, O., Agyepong, I.A., and Tran, N. (2013) Implementation research: what it is and how to do it. Bmj. 347: f6753.

Riley, W.T., Glasgow, R.E., Etheredge, L., and Abernethy, A.P. (2013) Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise. Clinical and translational medicine. 2(1): 10.

Ritzwoller, D.P., Sukhanova, A., Gaglio, B., and Glasgow, R.E. (2009) Costing behavioral interventions: a practical guide to enhance translation. Annals of behavioral medicine : a publication of the Society of Behavioral Medicine. 37(2): 218-27.

Stokols, D. (2000) Social ecology and behavioral medicine: implications for training, practice, and policy. Behavioral medicine. 26(3): 129-38.

Stirman, S.W., Miller, C.J., Toder, K., and Calloway, A. (2013) Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation science : IS. 8: 65.

Tabak, R.G., Khoong, E.C., Chambers, D.A., and Brownson, R.C. (2012) Bridging research and practice: models for dissemination and implementation research. American journal of preventive medicine. 43(3): 337-50.​

Thorpe, K.E., Zwarenstein, M., Oxman, A.D., Treweek, S., Furberg, C.D., Altman, D.G., Tunis, S., Bergel, E., Harvey, I., Magid, D.J., and Chalkidou, K. (2009) A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne. 180(10): E47-57.

Zwarenstein, M., Treweek, S., Gagnier, J.J., Altman, D.G., Tunis, S., Haynes, B., Oxman, A.D., Moher, D., group, C., and Pragmatic Trials in Healthcare, g. (2008) Improving the reporting of pragmatic trials: an extension of the CONSORT statement. Bmj. 337: a2390.​​


​ - More References and Annotations In Development- ​

10 ingred vid thumb.JPG10 Key Ingredients for D&I Research Proposals​ - This helpful animation was developed in collaboration with colleagues from ACCORDS & CCTSI and adapted from materials presented by experts at Washington University, STL.​

D4D thumb.JPGWhether you are a researcher, policy planner, or community organizer , this tool is designed to guide you on how a project can be designed with greater dissemination potential.​

ExCONSORT fillable thumb.JPG 

FILLABLE PDF - Expanded CONSORT Figure - Developed by ACCORDS D&I Program investigators & collaborators

This file contains an overview, the fillable form, a completed example, a users' guide with row-by-row instruction, ​FAQ, and supplemental resources.



Tips for Getting Funded: Checklists, Tools, Self-ratings and Guides for Successful Proposals in Dissemination and Implementation (D&I) Research​ Visit the Site

Resources developed by Enola Proctor, Ross Brownson, Byron Powell, Ana Baumann, Ashley Hamilton and Ryan Santens / Adapted into website form by Amy Huebschmann, Chase Cameron, Demetria McNeal and Russell Glasgow​


NIH Living Textbook.JPGThe Living Textbook​ reflects a collection of expert consensus regarding special considerations, standard approaches, and best practices in the design, conduct, and reporting of pragmatic clinical trials. Given the rapid pace of change in this field, this electronic textbook will continue to be added to and updated.

RE_AIM Toolkit.JPGThe RE-AIM Online Training is a web-based module that provides instruction and case examples to illustrate the five dimensions of the RE-AIM framework: Reach, Effectiveness or efficacy, Adoption, Implementation, and Maintenance. The RE-AIM framework is useful for planning new interventions, adapting existing interventions, and designing evaluations that assess the potential public health impact of interventions. The module provides users with examples of real-life application to policy/environmental change interventions.

DIpreview.JPG The Make Research Matter website​ consists of four main tools:

  1. Planning Tool-an interactive survey which provides a tailored report that aids researchers with their dissemination plan;
  2. Resource Library-a searchable database consisting of a compilation of D&I related articles from multiple sources which is updated monthly;
  3. Narrative Library-a freely accessible online library containing video vignettes and transcripts with junior and senior D&I experts of "how-to" knowledge to D&I problems;
  4. Glossary-containing over 100 definitions of terminology used in D&I health research. Additionally, users of the MRM website can learn more about current publications and presentations, and current news related to D&I. was designed to help researchers and practitioners to select the D&I Model that best fits their research question or practice problem, adapt the model to the study or practice context, fully integrate the model into the research or practice process, and find existing measurement instruments for the model constructs. The term ‘Models’ is used to refer to both theories and frameworks that enhance dissemination and implementation of evidence-based interventions more likely.

 ​"CRISP eBooks"
Pragmatic trials are randomized controlled studies whose purpose is to inform decisions about practice.  They address questions of major clinical and public health importance and produce results that can be generalized and applied in usual care settings. Because they produce real-world evidence, they help to close the translation gap between discovery and practice.

This workbook is designed to be a navigation guide providing key references and online resources to aid you in further study and application. ​

"CRISP eBooks"​

​​​Closing the gap between research discovery and clinical and community practice is essential if we are to succeed in improving our nation’s health. Understanding how best to disseminate and implement evidence-based healthcare and prevention, while not implementing inappropriate or unnecessary services, is challenging.

This Guide was developed by the Center for Research in Implementation Science and Prevention (CRISP) in partnership with colleagues from the Colorado Clinical and Translational Sciences Institute (CCTSI), the Kaiser Permanente Center for Health Education Dissemination and Implementation Research, and the Department of Veterans Affairs.


RE-AIM Tools and Calculators​​ This site provides an explanation of and resources for those wanting to apply the RE-AIM framework. The RE-AIM framework is designed to enhance the quality, speed, and public health impact of efforts to translate research into practice.

 ​GemThumb.JPGGEM's "D&I" Measures​ - The Grid-Enabled Measures Database (GEM) is a web-based collaborative tool containing behavioral, social science, and other relevant scientific measures. The goal of GEM is "to support and encourage a community of users to drive consensus on best measures and share the resulting data from those measures."
Because users can search for and download measures by subject area or keyword, this web resource is a great place for dissemination and implementation experts to access, contribute toward, rate and even add to a database of measures for D & I and other areas.​

​ ​


 CU Family Medicine Evaluation Hub​ - The Evaluation Hub is a resource available to all members of the Department of Family Medicine (DFM) - that brings together evaluation expertise and resources via one easy access point. The DFM has made available a limited amount of funding to facilitate access to evaluation consultation services at no cost to you.

If you are working on a departmental program or project that needs evaluation help, the Hub is here to support you! 


Measuresperson.JPGMeasures for Person Centred Coordinated Care - The website is an online database of Patient Reported Outcomes Measures (PROMs) and Patient Reported Experience Measures (PREMs) that can be utilized within programs that aim to deliver or evaluate person centred coordinated care (P3C).

This project is designed to be of value to a range of stakeholders (such as healthcare professionals, commissioners and managers), but the resource is also a useful research tool, with features such as links to PubMed literature. ​


BetterevalThumb.JPGBetter Evaluation - An international collaboration to improve evaluation practice and theory by sharing and generating information about options (methods or processes) and approaches.

Having an agreed set of Key Evaluation Questions (KEQs) makes it easier to decide what data to collect, how to analyze it, and how to report it. The link above will take you directly to the entry on "Key Evaluation Questions."

SIRC.JPGThe Society for Implementation Research Collaboration (SIRC)​ SIRC is a society that brings together researchers and stakeholders committed to the rigorous evaluation of implementation of evidence based psychosocial interventions. SIRC conferences occur biennially. The next conference will be held in Seattle on September 25 & 26, 2015 centered around the theme of “Advancing Efficient Methodologies through Community Partnerships and Team Science.” 

Resources on the site include event registration, information on past conferences, news, updates, description of initiatives and access to the SIRC "Network of Expertise" (NoE). While the core group of the NoE includes experienced investigators, practitioners​, and champions of EBP, the network is welcome to members at all levels.  
​​​​ ​​​​​​

Brownson, R., Proctor, E., Luke, D., Baumann, A., Staub, M., Brown, M., & Johnson, M. (2017). Building capacity for dissemination and implementation research: One university's experience. Implementation Science : IS, 12(1), 104. Read the Article

Chambers DA, Proctor EK, Brownson RC, Straus SE. Mapping training needs for dissemination and implementation research: lessons from a synthesis of existing D&I research training programs. Transl Behav Med. 2016 Mar 30 Read the Abstract

Handley, M., Gorukanti, A., & Cattamanchi, A. (2016). Strategies for implementing implementation science: A methodological overview. Emergency Medicine Journal,Emergency Medicine Journal, 18 February 2016. Read the Article

Luke DA, Baumann AA, Carothers BJ, Landsverk J, Proctor EK. Forging a link between mentoring and collaboration: a new training model for implementation science. Implement Sci. 2016;11(1):137. Download the PDF

Meissner HI, Glasgow RE, Vinson CA, et al. The U.S. training institute for dissemination and implementation research in health. Implement Sci. 2013;8:12.  Read the Article

Padek M, Colditz G, Dobbins M, et al. Developing educational competencies for dissemination and implementation research training programs: an exploratory analysis using card sorts. Implement Sci. 2015;10:114. Read the Article

Proctor, E., & Chambers, K. (2017). Training in dissemination and implementation research: A field-wide perspective. Translational Behavioral Medicine, 7(3), 624-635. Read the Article

Proctor EK, Landsverk J, Baumann AA, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8:105.  Download the PDF

Shea, C., Young, M., Powell, T., Rohweder, L., Enga, B., Scott, J., . . . Corbie-Smith, Z. (2017). Researcher readiness for participating in community-engaged dissemination and implementation research: A conceptual framework of core competencies. Translational Behavioral Medicine, 7(3), 393-404. Read the Article

Tabak, Padek, Kerner, Stange, Proctor, Dobbins, . . . Brownson. (2017). Dissemination and Implementation Science Training Needs: Insights From Practitioners and Researchers. American Journal of Preventive Medicine, 52(3), S322-S329.  Read the Article


Glasgow R. (April 2018) Pragmatic Approaches for Dissemination and Implemntations (D&I) Research to Enhance Population Impact. Keynote presentation at the University of California at San Diego D&I Research Conference.

UCSD Main talk_BF_v1.pptDownload the Slide Deck

Glasgow R. (April 2018) The Promise and Challenge of Dissemination and Implementation Science (DIS). Plenary presentation at the University of California at San Diego D&I Research Conference.

TIDIRC Intro DC.pdfDownload the Slide Deck​

Chambers, D. (February 2018) Dissemination and Implementation Models and Theories. Grand Rounds presentation at TIDIRC/NCI.

TIDIRC Intro DC.pdfDownload the Slide Deck

Glasgow, R. (December 2017) Writing Implementation Reseach Grant Proposals: 10 key ingredients...and a few reflections. Plenary presentation at the Academy Health D&I meeting. Arlington, VA.

10 key ingredients grants_Russ_v1.pdfDownload the Slide Deck

Glasgow, R. (December 2017) Dissemination and Implementatio Research: Past, present, and future (one view). Plenary presentation at the Academy Health D&I meeting. Arlington, VA.

NIH DI FINAL Glasgow.pdfDowload the Slide Deck

Glasgow, R. (November 2017) What Can Researchers Do to Address Health Inequities? Pragmatic models, methods, and measures. Panel presentation at the CCTSI Research Ethics Conference. Denver, CO.

Disparities FINAL conference_UC Nov 2017.pdfDowload the Slide Deck

Glasgow, R. (October 2017) Pragmatic Models, Methods and Measures for Dissemination and Implementation Research (and Population Impact). Plenary presentation. Washington, DC.

Nursing Presentation, DC fall 2017.pdfDownload the Slide Deck

Straus, S. (September 2017) Mobilisation of Vulnerable Elders in Ontario: MOVE ON. Grand Rounds presentation. Aurora, CO.

Sharon Grand Rounds_MOVE_ON_Sept2017.pdfDowload the Slide Deck

Rabin, B. (September 2017) Establishing a Common Language: D4D terms and definitions. Keynote presentation at the ACCORDS Designing for Dissemination intensive. Aurora, CO.

D4D methods intensive_Rabin v1.pdfDownload the Slide Deck

Glasgow, R. (August 2017) Translating Research Into Practice - Pragmatic Research Approaches. Plenary talk at the National Network of Depression Centers (NNDC). Ann Arbor, MI.

NNDC Talk 8-10-162.pdfDownload the Slide Deck

Glasgow, R., McCreight, M., Rabin, B. (July 2017) Documenting Adaptations in The Triple AIM QUERI Projects: Tracking Changes. Presentation at VAHSRD/QUERI National Conference. Alexandria, VA.

VA HSRD_QUERI National Conference 071017_BR[2].pdfDownload the Slide Deck

Proctor, E. (June 2017) Writing D&I grants: Getting started in a fast moving field. Keynote presentation at Getting D&I Ideas Funded: an interactive, pragmatic workshop. Aurora, CO.

D1_1 Keynote - Proctor.pdfDowload the Slide Deck

Estabrooks, P. (June 2017) Practical use of dissemination and implementation outcomes, thoeries, and research designs.​ Plenary presentation at Getting D&I Ideas Funded: an interactive, pragmatic workshop. Aurora, CO.

​​​​Practical Use of DI Outcomes Theories and Research Designs 2017.pdfDownload the Slide Deck

Matlock, D., Glasgow, R. (June 2017) Implementation Science: How It Can Complement, Extend, and Challenge How You Do Science (and increase your success). Grand Rounds presentation at the Eastern Colorado VA and University of Colorado Medical School. Aurora, CO.

GRECC implementation science talk.pdfDowload the Slide Deck

Rabin, B., Glasgow, R. (June 2013) Implementation Science: Opportunities and Resources. Presentation to D&I experts to assess the status of the field and make recommendations to close exsisting gaps.

Rabin-Glasgow - NIH VA IS summary - v 11-8-20131.pdfDownload the Slide Deck

Glasgow, R. (May 2013) Implementation Science Perspectives on Opportunities and Challenges for ISRII. Grand Rounds presentation at ISRII 6th Scientific Meeting. Chicago, IL.

​​Glasgow - ISRII eHealth Presentation - FINAL - May 2013 - v 5-8-13.pdfDownload the Slide Deck

Rating forms to use for systematic review articles with a goal to promote intervention dissemination and implementation:

Rating both pragmatism and effectiveness to identify evidence-based interventions with strong dissemination potential

Weblink materials developed and supported by the Dissemination and Implementation Science (D&I) team at the University of Colorado Adult and Child Consortium for Outcomes Research and Delivery Science (ACCORDS)

Welcome to this list of resources for authors of systematic reviews.  If the systematic review that you will author is meant to identify interventions for translation into real-world systems, then the resources on this website may be of great assistance to you.  This website includes resources for rating both the pragmatism and effectiveness of interventions, in order to identify evidence-based interventions with strong dissemination potential.

Scoring guides:

1. The first scoring guide was utilized for a systematic review of eHealth interventions for cancer prevention, and includes measures of pragmatism from the PRECIS framework and other factors related to external validity from the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework, as published by Sanchez MA, Rabin BA, Gaglio B, Henton M, Elzarrad MK, Purcell P, et al. A systematic review of eHealth cancer prevention and control interventions: new technology, same methods and designs? Transl Behav Med. 2013;3(4):392-401.

Click Here for the Scoring Guide

Click Here to Read the Article

2. The second scoring guide was adapted from the first guide, but used PRECIS-2 framework assessments instead of PRECIS assessments, as the PRECIS-2 had been developed in the intervening time period.  This review was also published: Luoma KA, Leavitt IM, Marrs JC, Nederveld AL, Regensteiner JG, Dunn AL, et al. How can clinical practices pragmatically increase physical activity for patients with type 2 diabetes? A systematic review. Transl Behav Med. 2017: doi:10.1007/s13142-017-0502-4. [epub ahead of print].

Click Here for the Scoring Guide​

Click Here to Read the Article​

We share these resources as open-access, for others who would like to assess pragmatism and effectiveness in systematic reviews.  Individuals should attribute these citations if they are adapting these measures of pragmatism to the content of their systematic review.  Scientists with questions about how to adapt these guides for their population may contact Dr. Amy Huebschmann of the ACCORDS D&I team at