Implementation science is the scientific study of methods to promote the integration of research findings and evidence-based interventions into health care policy and practice and hence to improve the quality and effectiveness of health services and care. Implementation science is distinguished from monitoring and evaluation by its emphasis on the use of the scientific method. The origins of implementation science include operations research, industrial engineering, and management science. Today, implementation science encompasses a broader range of methods and skills including decision science and operations research, health systems research, health outcomes research, health and behavioral economics, epidemiology, statistics, organization and management science, finance, policy analysis, anthropology, sociology, and ethics. Examples of implementation science research are presented for HIV prevention (prevention of mother-to-child transmission of HIV, male circumcision) and HIV and drug use (syringe distribution, treating drug users with antiretroviral therapy and opioid substitution therapy). For implementation science to become an established field in HIV/AIDS research, there needs to be better coordination between funders of research and funders of program delivery and greater consensus on scientific research approaches and standards of evidence.
From the *Department of Public Health, Weill Cornell Medical College, New York, NY.
Portions of this article were presented at the National Institute on Drug Abuse and International AIDS Society Consultation Meeting on the Prevention and Treatment of HIV/AIDS among Drug Using Populations: A Global Perspective, January 11-12, 2010, Washington, DC.
Correspondence to: Bruce R. Schackman, PhD, Associate Professor of Public Health, Department of Public Health, Weill Cornell Medical College, 402 East 67th Street, New York, NY 10065 (e-mail: firstname.lastname@example.org).
Implementation science and operational research have been gaining recognition and support as evidenced by recent National Institutes of Health (NIH) funding announcements,1,2 conferences and workshops,3-5 and the establishment of an academic journal.6 In the United States, two large integrated health systems have formal organizational initiatives in implementation science: the Veteran's Affairs Center for Implementation Practice and Research Support and the Kaiser Permanente Center for Health Dissemination and Implementation Research. In the global HIV field, implementation science has been recognized by the Framework for Operations and Implementation Research of the Global Fund to Fight AIDS, Tuberculosis, and Malaria7 and the establishment of the William J Clinton Foundation Center for Strategic HIV Operations Research. This article defines implementation science research and how it differs from dissemination research, describes its evolution, and describes examples relevant to global HIV/AIDS prevention and specific implementation issues relevant to HIV/AIDS in drug users. It concludes with a discussion of challenges and opportunities to better establish implementation science as a field in HIV/AIDS research.
IMPLEMENTATION SCIENCE DEFINITION
Implementation science is the scientific study of methods to promote the integration of research findings and evidence-based interventions into health care policy and practice and hence to improve the quality and effectiveness of health services and care.2,6 Different funders and international organizations use different words to describe this concept, although all specify that this is a research (ie, scientific) discipline. The US NIH uses the term “implementation research,” the Global Fund and World Health Organization use “operational research,” and the US President's Emergency Plan for AIDS Relief and the International AIDS Society use “operations research.” In this article, “implementation science” is used to represent all of these terms.
WHERE IS THE SCIENCE IN IMPLEMENTATION SCIENCE?
Implementation science is distinguished from monitoring and evaluation by its emphasis on the use of scientific method. President's Emergency Plan for AIDS Relief has contributed to the confusion between monitoring and evaluation and implementation science by grouping operations research along with monitoring and program evaluation in its 5-year strategy.8
Hirschhorn et al9 have described the difference between implementation science and monitoring and evaluation as follows: “in general, the objectives of monitoring and evaluation programs and implementation are similar: to understand what is working well, what is not working, and why. However, most monitoring and evaluation activities necessarily focus on measuring the services provided rather than on the barriers to implementation. The scientific rigor of implementation research broadens the scope of monitoring and evaluation activities to understand the etiology of gaps between expected results and observed outcomes.”
Implementation science is also different from dissemination research. Dissemination is “the targeted distribution of information and intervention materials to a specific public health or clinical practice audience... to spread knowledge and the associated evidence-based interventions.”2 Dissemination research studies “identify mechanisms and approaches to package and convey the evidence-based information necessary to improve public health and clinical care services.”2 Dissemination is necessary, but it is often not sufficient because interventions that were developed and tested in efficacy and effectiveness trials require local adaptation for implementation.
The origins of implementation science include several quantitative research traditions: operations research, industrial engineering, and management science. Operations research is “the discipline of applying advanced analytical methods to optimize decisions, utilizing mathematical and statistical modeling.”9 Examples of early applications of operations research include research by Babbage in the 19th century that led to the organization of the English postal services and research during World War II that improved the effectiveness of Allied forces in using radar technology.4
Industrial engineering encompasses “the design, improvement and installation of integrated systems of people, materials, information, equipment and energy.”10 Examples include time studies conducted by Taylor in the 19th century and motion studies conducted by the Gilbreths in the early 20th century. These techniques were subsequently combined as time and motion studies that continue to be used to improve the efficiency of work processes.
Management science applies scientific methods more broadly to managerial decisions. In the 19th century, important innovations included developing the concepts of quality control and cost accounting. In the early 20th century, innovations in scheduling and project management by Gantt (the developer of the Gantt chart) led the way toward improved processes for management of complex systems that were later employed by organizations such as the US National Aeronautics and Space Administration.
Today, implementation science encompasses a broader range of methods and skills. Examples of methods include state transition and agent-based simulation models designed to answer questions about feasibility and efficiency and cost effectiveness; experimental and quasi experimental studies including cluster-randomized trials and before vs. after comparisons of systemic interventions or “packages” of interventions; behavioral economics studies of incentive-based interventions; quality improvement studies that examine the requirements for fidelity versus customization in the field or implement continuous process improvement techniques; and methodological studies that test theoretical models of implementation processes or develop process and outcome measures. Skills required for implementation science research can include decision science and operations research, health systems research, health outcomes research, health and behavioral economics, epidemiology, statistics, organization and management science, finance, policy analysis, anthropology, sociology, and ethics.
Implementation science is a key element of translational research. The NIH-funded Clinical and Translational Science Awards program now encompasses 46 medical research institutions located in 26 states.11 The Clinical and Translational Science Awards have adopted the T1-T3 characterization of translational research,12 in which T1 represents translation from basic science to the clinic, T2 studies comparative effectiveness, and T3 focuses on the “how” of health care delivery using implementation science. An example of these distinctions is the adoption of primary percutaneous coronary intervention (PCI) which includes clinical efficacy results from clinical trials (T1), comparative effectiveness and health services research that established a standard of 90 minutes between arrival in the emergency department and commencement of PCI (T2), and implementation research to identify hospital-based strategies to reduce the time to PCI (T3).13 Others have expanded the definition of translational research to include T0, basic research that identifies opportunities and approaches to a health problem, and T4 which is translating practice to population health impact through policy.14,15
EXAMPLES OF IMPLEMENTATION RESEARCH IN HIV PREVENTION
Evidence for the effectiveness of protocols for the prevention of mother-to-child transmission (PMTC) of HIV is clear.16 However, implementation has been challenging.17 The PEARL study is evaluating prevention of mother-to-child transmission coverage in 4 East African countries.18 Using cord blood surveillance, investigators tracked the coverage “cascade” and identified losses at many stages. Starting with 100% deliveries that were cord blood positive, 92% were missing information in the folder (chart), 84% were offered an HIV test, 81% were HIV tested, 74% had HIV test results documented in the folder, 71% had documented maternal receipt of nevirapine, 57% had evidence of nevirapine in cord blood, and only 50% had full coverage including treatment of both the mother and the child.18 Results also varied substantially by site. Each of the losses in the cascade represents a potential point of intervention. A participatory quality improvement project implemented in 1 rural region in South Africa identified barriers to improvement of several steps in the cascade, developed interventions to address them, and had significant impact in improving performance. Antenatal HIV testing increased from 88% to 98%, CD4 testing of HIV-positive mothers increased from 40% to 97%, maternal nevirapine from 57% to 96%, and infant nevirapine from 15% to 68%; 6 week PCR testing also increased from 24% to 68%.19
The effectiveness of male circumcision in preventing HIV transmission to heterosexual men has been shown in 3 large trials conducted in Africa.20-22 Yet there are substantial barriers to implementation related to organizational and health systems, economics, cultural and environmental factors, social networks, and individual behaviors.4 A World Health Organization consultation examined operations research implications of several different models for providing male circumcision services, including vertical and integrated health system models. A list of 22 high priority research topics was created, with the 5 highest being studies of: task-shifting to nonphysicians; the effectiveness and cost-effectiveness of different delivery models; counseling strategies to reduce potential risk compensation and unsafe sexual activity immediately after surgery; the acceptability and feasibility of newborn circumcision; and how to build mutually agreeable linkages between traditional circumcisers and the formal health care system.23 Recent implementation research studies include an evaluation of the number of male circumcision procedures required to achieve optimal competency24 and the use of a questionnaire and GPS data to strategically locate male circumcision services in Nyanza Province, Kenya.25
EXAMPLES OF IMPLEMENTATION RESEARCH IN HIV AND DRUG USE
The effectiveness and cost-effectiveness of syringe distribution to injection drug users (IDUs) for prevention of HIV infection have been well established.26 However, there are important challenges to the implementation of these programs. Attitudes of local law enforcement are critical; for example, in a qualitative study conducted in a Russian city, investigators found that street policing “stop and search” activities inhibited drug users' willingness to carry injection equipment in public.27 Even when the environment is safe, it is unclear what the target level of coverage should be for syringe distribution to have an impact on local transmission rates. The target rate will vary based on the epidemiologic and behavioral characteristics of the drug-using population. In a recent modeling study, Vickerman et al28 projected a threshold coverage rate of 15%-20% in Svetlogorsk, Belarus, and 20% in London. Using retrospective data, an intervention in Dhaka, Bangladesh, that included needle/syringe exchange and treatment of sexually transmitted diseases for IDUs and reduced harassment of drug users by police was estimated to have 31%-81% coverage. This was associated with an estimated 90% reduced HIV incidence among IDUs and an estimated HIV prevalence of 10%, compared with an estimated 42% prevalence, had the intervention not been implemented.29
Evidence from prospective cluster-randomized and quasi experimental studies has also shown the efficacy of providing a package of interventions at the individual and system level. A cross-border project implemented at 5 sites in Vietnam and 4 sites in China worked with law enforcement officials and government officials and provided sterile injection equipment and peer counsellors. This program was successful in reducing HIV incidence and prevalence among drug users.30 In a cluster-randomized trial of needle social marketing strategies in 4 communities in China, needle sharing behaviors dropped 62% in the intervention communities compared with the control communities, and there was a statistically significant decline in HIV incidence among IDUs in one intervention township.31
Social and structural barriers and individual-level behaviors affect access to and use of HIV treatment for substance users.32,33 Overcoming such barriers can yield substantial health gains for drug users, and in communities where drugs are fuelling the spread of HIV, drug abuse treatment can have wider benefits for general public health and the community at large. A modeling study of different HIV treatment allocation strategies in St Petersburg found that a strategy targeting IDUs prevented 40,000 HIV infections during 20 years, 75% of which were estimated to be among non-IDUs. By contrast, a strategy targeting non-IDUs prevented only 10,000 infections. Targeting IDUs actually prevented more non-IDU infections than targeting non-IDUs. A more politically acceptable strategy that targeted non-IDUs and IDUs equally had a less attractive cost-effectiveness ratio than the IDU targeted strategy, but it was estimated to prevent the most infections using the optimistic coverage assumption of 80% for both groups.34
In a longitudinal cohort study conducted at opioid substitution therapy (OST) sites in Asia, Eastern Europe, Australia, and Iran, OST was shown to be associated with a reduction in injection risks for HIV.35 OST in HIV-infected patients is also associated with initiating ART,36 better adherence on ART,37 and improved virologic outcomes.38,39 Buprenorphine/naloxone treatment is an OST alternative to traditional methadone maintenance treatment.40 In the United States, it has substantial advantages in terms of patient acceptability because it can be dispensed at a community pharmacy whereas methadone must be dispensed by a Federally regulated OST program that frequently requires daily visits by the patient. However, physician adoption of buprenorphine/naloxone in the United States has been relatively slow due to regulatory, financial, and attitudinal barriers.41-43 A pilot study of integrated buprenorphine/naloxone treatment and HIV care found it to be feasible in an HIV clinical care setting.44 However, routine implementation of such programs in HIV care settings requires changes to care processes and quality assessments and incurs additional costs that may not be reimbursed under current funding arrangements. These implementation issues are now under study at 10 sites, with support from the HIV/AIDS Bureau of the Health Resources and Services Administration, to create model implementation programs of integrated buprenorphine/naloxone treatment and HIV care.42
CHALLENGES AND OPPORTUNITIES
At the Expert Consultation on Implementation Science held by the NIH Office of AIDS Research in July 2009,4 Dr. Stefano Bertozzi pointed out that although there is increasing recognition of the critical role implementation science can play in improved delivery of HIV/AIDS prevention and treatment, there are several challenges to its broader use. First, because “no one owns implementation science” there is insufficient coordination between those funding the research and those supporting delivery. Second, “implementation science necessitates interdisciplinary collaboration, and there is a lack of consensus on optimal scientific research approaches in the field.” Third, the impact of HIV/AIDS interventions is frequently difficult to determine, particularly for prevention interventions where measures of incidence and behavioral outcomes have limitations. Related to these considerations, researchers and implementers have different expectations about validity and generalizability. Researchers want a high degree of certainty and want to be able to claim broad generalizability. Implementers place value on any information that reduces uncertainty, recognizing that there is a difference between quality and precision. Moreover, the expectation of generalizability of results may not always be possible or necessary. Thus research that will be most valued by implementers may be the least similar to the type of research studies typically supported by NIH.
For implementation science to become an established field in HIV/AIDS research, there needs to be better coordination between funders of research and funders of service delivery and greater consensus on scientific research approaches and standards of evidence. Rigorous implementation science research that is responsive to the needs of implementers can dramatically improve the effectiveness of delivering proven interventions to prevent and treat HIV/AIDS, both globally and locally. With improved funding support, better coordination, and greater scientific clarity, implementation science researchers will be able to deliver on this promise.
The author acknowledges Dr. Stefano Bertozzi and Chris Collins for generously sharing their presentations and for permission to summarize Dr. Bertozzi's remarks at the Workshop on Implementation Science Research: A Requirement for Effective HIV/AIDS Prevention and Treatment Scale-Up in Cape Town, South Africa, July 23-24, 2009.
5. Schmid G. Operations Research at IAS 2009 Track D Report. Presented at: 5th IAS Conference on HIV Pathogenesis and Treatment; 2009; Cape Town, South Africa.
6. Eccles MP, Mittman BS. Welcome to implementation science Implement Sci
7. Global Fund to Fight AIDS Tuberculosis and Malaria, UNICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases. Framework for Operations and Implementations Research in Health and Disease Control Programs
. Geneva, Switzerland; 2008. Available at: http://www.theglobalfund.org/documents/me/FrameworkForOperationsResearch.pdf
. Accessed September 29, 2010.
8. United States President's Emergency Plan for AIDS Relief. The US President's Emergency Plan for AIDS Relief: 5-year strategy; Annex: PEPFAR's contribution to the Global Health Initiative; 2009. Available at: http://www.pepfar.gov/documents/organization/133437.pdf
. Accessed September 29, 2010.
9. Hirschhorn LR, Ojikutu B, Rodriguez W. Research for change: using implementation research to strengthen HIV care and treatment scale-up in resource-limited settings. J Infect Dis
. 2007;196(Suppl 3):S516-S522.
12. Dougherty D, Conway PH. The “3T's” road map to transform US health care: the “how” of high-quality care. JAMA
13. Naik AD, Petersen LA. The neglected purpose of comparative-effectiveness research. N Engl J Med
15. Khoury MJ, Gwinn M, Yoon PW, et al. The continuum of translation research in genomic medicine: how can we accelerate the appropriate integration of human genome discoveries into health care and disease prevention? Genet Med
16. Dao H, Mofenson LM, Ekpini R, et al. International recommendations on antiretroviral drugs for treatment of HIV-infected women and prevention of mother-to-child HIV transmission in resource-limited settings: 2006 update. Am J Obstet Gynecol
. 2007;197(3 Suppl):S42-S55.
17. The Interagency Task Team (IATT) on Prevention of HIV Infection in Pregnant Women Mothers and their Children. Guidance on Global Scale-Up of the Prevention of Mother-to-Child Transmission of HIV
. Geneva, Switzerland: World Health Organization; 2007.
18. Coetzee D, Stringer EM, Chi BH, et al. Evaluation of PMTCT coverage in four African countries: the PEARL study. (WELBD101). Presented at: 5th IAS Conference on HIV Pathogenesis and Treatment; July 22, 2009; Cape Town, South Africa.
19. Mate KS, Bennett B, Mphatswe W, et al. Challenges for routine health system data management in a large public programme to prevent mother-to-child HIV transmission in South Africa. PLoS One
20. Auvert B, Taljaard D, Lagarde E, et al. Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 Trial. PLoS Med
21. Bailey RC, Moses S, Parker CB, et al. Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial. Lancet
22. Gray RH, Kigozi G, Serwadda D, et al. Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial. Lancet
24. Kiggundu V, Watya S, Kigozi G, et al. The number of procedures required to achieve optimal competency with male circumcision: findings from a randomized trial in Rakai, Uganda. BJU Int
25. Herman-Roloff A, Llewellyn E, Bailey R, et al. Using health facility assessment data to strategically roll-out male circumcision in Nyanza province, Kenya: a mixed method approach. (MOPDC1). Presented at: 5th IAS Conference on HIV Pathogenesis and Treatment; July 7, 2009; Cape Town, South Africa.
26. Wodak A, Cooney A. Do needle syringe programs reduce HIV infection among injecting drug users: a comprehensive review of the international evidence. Subst Use Misuse
27. Rhodes T, Platt L, Sarang A, et al. Street policing, injecting drug use and harm reduction in a Russian city: a qualitative study of police perspectives. J Urban Health
28. Vickerman P, Hickman M, Rhodes T, et al. Model projections on the required coverage of syringe distribution to prevent HIV epidemics among injecting drug users. J Acquir Immune Defic Syndr
29. Foss AM, Watts CH, Vickerman P, et al. Could the CARE-SHAKTI intervention for injecting drug users be maintaining the low HIV prevalence in Dhaka, Bangladesh? Addiction
30. Des Jarlais DC, Kling R, Hammett TM, et al. Reducing HIV infection among new injecting drug users in the China-Vietnam Cross Border Project. AIDS
. 2007;21(Suppl 8):S109-S114.
31. Wu Z, Luo W, Sullivan SG, et al. Evaluation of a needle social marketing strategy to control HIV among injecting drug users in China. AIDS
. 2007;21(Suppl 8):S115-S122.
32. Krusi A, Wood E, Montaner J, et al. Social and structural determinants of HAART access and adherence among injection drug users. Int J Drug Policy
33. Wood E, Kerr T, Tyndall MW, et al. A review of barriers and facilitators of HIV treatment among injection drug users. AIDS
34. Long EF, Brandeau ML, Galvin CM, et al. Effectiveness and cost-effectiveness of strategies to expand antiretroviral therapy in St. Petersburg, Russia. AIDS
35. Lawrinson P, Ali R, Buavirat A, et al. Key findings from the WHO collaborative study on substitution therapy for opioid dependence and HIV/AIDS. Addiction
36. Wood E, Hogg RS, Kerr T, et al. Impact of accessing methadone on the time to initiating HIV treatment among antiretroviral-naive HIV-infected injection drug users. AIDS
37. Moatti JP, Carrieri MP, Spire B, et al. Adherence to HAART in French HIV-infected injecting drug users: the contribution of buprenorphine drug maintenance treatment. The Manif 2000 study group. AIDS
38. Roux P, Carrieri MP, Cohen J, et al. Retention in opioid substitution treatment: a major predictor of long-term virological success for HIV-infected injection drug users receiving antiretroviral treatment. Clin Infect Dis
39. Roux P, Carrieri MP, Villes V, et al. The impact of methadone or buprenorphine treatment and ongoing injection on highly active antiretroviral therapy (HAART) adherence: evidence from the MANIF2000 cohort study. Addiction
40. Fiellin DA, Friedland GH, Gourevitch MN. Opioid dependence: rationale for and efficacy of existing and new treatments. Clin Infect Dis
. 2006;43(Suppl 4):S173-S177.
41. Cunningham CO, Kunins HV, Roose RJ, et al. Barriers to obtaining waivers to prescribe buprenorphine for opioid addiction treatment among HIV physicians. J Gen Intern Med
42. Netherland J, Botsko M, Egan JE, et al. Factors affecting willingness to provide buprenorphine treatment. J Subst Abuse Treat
43. Schackman BR, Merrill JO, McCarty D, et al. Overcoming policy and financing barriers to integrated buprenorphine and HIV primary care. Clin Infect Dis
. 2006;43(Suppl 4):S247-S253.
44. Sullivan LE, Barry D, Moore BA, et al. A trial of integrated buprenorphine/naloxone and HIV clinical care. Clin Infect Dis
. 2006;43(Suppl 4):S184-S190.