Efficacy versus effectiveness trials: informing guidelines for asthma management : Current Opinion in Allergy and Clinical Immunology

Secondary Logo

Journal Logo

MECHANISMS OF ALLERGY AND ADULT ASTHMA: Edited by Stephen T. Holgate and J. Andrew Grant

Efficacy versus effectiveness trials

informing guidelines for asthma management

Price, David; Hillyer, Elizabeth V.; van der Molen, Thys

Author Information
Current Opinion in Allergy and Clinical Immunology 13(1):p 50-57, February 2013. | DOI: 10.1097/ACI.0b013e32835ad059
  • Free

Abstract

INTRODUCTION

Most asthma management guidelines use similar rankings for categorizing the evidence to support their recommendations, listing randomized controlled trials (RCTs) at the top as the gold standard for evidence of therapeutic efficacy, meta-analyses at or near the top, and nonrandomized and observational studies two or more rungs below [1–3]. Although classical RCTs, also known as explanatory or efficacy trials, may shed light on possible mechanisms in disease pathogenesis and are important to test the efficacy of therapies in ideal circumstances, their limitations are increasingly recognized with regard to characterizing real-life efficacy, known as effectiveness [4▪▪,5▪▪,6,7▪]. Instead, effectiveness trials, including pragmatic trials and observational studies, aim to evaluate treatment outcomes for real-life patients in real-life clinical settings [5▪▪,8▪].

Efficacy trial results may be overgraded by guideline reviewers when applied to make recommendations for everyday clinical practice, in which conditions are less idealized and patient populations much more diverse than in RCTs [4▪▪,6,9,10▪]. Moreover, cost-effectiveness determinations are best made using real-life data, as payors want to understand the true cost impact of utilizing interventions in real life [7▪,11].

This review summarizes the strengths and limitations of efficacy and effectiveness trials. Examples of current effectiveness trials in asthma are reviewed to illustrate the importance of this work and how these trials differ from efficacy trials.

F1-10
Box 1:
no caption available

EFFICACY VERSUS EFFECTIVENESS TRIALS: STRENGTHS AND LIMITATIONS

‘Hierarchies place RCTs on an undeserved pedestal … Hierarchies of evidence should be replaced by accepting – indeed embracing – a diversity of approaches’. – Sir Michael Rawlins, Harveian Oration, 2008 [12]

The ideal (pure) classical RCT lies on the opposite end of a continuum from the ideal (pure) pragmatic trial. Classical RCTs, or efficacy trials, are designed to maximize internal validity in order to test whether an intervention has a benefit under ideal circumstances, usually as compared with placebo. Instead, pragmatic trials are designed to compare interventions under usual clinical circumstances, thereby to maximize applicability of findings to real-life issues and inform everyday clinical decision-making [13,14â–ª,15,16â–ª]. Table 1 summarizes the features of RCTs as compared with pragmatic trials in asthma using the 10 domains of the pragmatic-explanatory continuum indicator summary (PRECIS) tool, developed to help trialists assess where trials lie on this continuum [17].

T1-10
Table 1:
Efficacy to effectiveness continuum for clinical trials in asthma

The major limitation of classical RCT design is the sacrifice of external validity (generalizability) in favor of maximizing internal validity. The design of asthma RCTs typically incorporates frequent patient monitoring, including lung function testing, and patient instruction in using treatment technologies such as inhalers, which cannot easily be duplicated in everyday practice, in which time and equipment limitations are operative, and clinic visit frequency, treatment adherence and inhaler technique are often suboptimal. Moreover, many clinically important patient populations are not studied in RCTs, including smokers and those with ‘insufficient’ bronchodilator reversibility, serious comorbidities and adherence or other psychosocial problems [5▪▪,18]. Only a small minority of patients with asthma are eligible for asthma RCTs, estimated at 3.3% in one study [19].

In short, the patients and procedures of efficacy trials occur outside the ecology of normal care, and many important issues that influence asthma control in real life, summarized in Fig. 1, are usually not captured in an RCT design [18,20,21â–ª,22,23]. Moreover, the usual 4-week to 8-week length of RCTs does not provide information to guide long-term asthma management strategies. These limitations may then be incorporated, and hidden, in meta-analyses of RCTs [24].

F2-10
FIGURE 1:
Reasons for poor asthma control in real-life clinical practice, few or none of which is accounted for in most classical randomized controlled (efficacy) trials. Adapted from [20].

The goal of pragmatic trials is to assess treatment outcomes in the complete context of real-life clinical practice. Pragmatic trial design incorporates relevant practice settings, everyday (usual) clinical care, a heterogeneous patient population and outcomes relevant to interested parties, including patient-oriented measures, with a duration sufficient to answer practical clinical questions for healthcare providers, patients and policymakers.

By focusing on external validity (generalizability), the naturalistic design of pragmatic trials necessarily sacrifices internal validity. A challenge in conducting pragmatic trials is maintaining patient follow-up without the close monitoring that occurs in an RCT. Even the knowledge of being studied or observed can alter behavior, a phenomenon known as the Hawthorne effect [25]. Introducing more monitoring and engagement than usual care can eliminate differences between two interventions being tested, particularly with regard to patient-reported measures, because the experience of receiving care can have beneficial effects on subjective outcomes [26â–ª,27]. This fact can be used to advantage, however. For example, in a recent pragmatic trial comparing twice-daily mobile phone based or paper-based self-monitoring, with both groups receiving the same structured clinical and educational intervention, the changes in asthma control at 6 months were similar in the two treatment groups [26â–ª]. The authors thus concluded that mobile technology did not improve asthma control or self-efficacy beyond the provision of clinical care to guidelines standards; moreover, the mobile technology was not cost-effective.

Another challenge of pragmatic trial design is detecting what is often a small difference in treatment effect between two interventions under conditions of usual clinical care; this requires either a large study population or use of a validated survey instrument that is very sensitive to the treatment effect [16▪]. In addition, the lack of blinding may introduce bias in patient self-assessments because of preconceived notions about intervention effectiveness; therefore, the concurrent use of objective outcome measures, such as test results and survival, is recommended [16▪]. The increasing availability of routine electronic health records (EHRs) and the potential for cross-linking with anonymized medical databases may facilitate the implementation of pragmatic trials, an approach currently being tested in the UK in two randomized evaluations of accepted choices in treatment (REACT) trials [28▪▪].

OBSERVATIONAL STUDIES: STRENGTHS AND LIMITATIONS

Observational studies, including cohort, case–control and cross-sectional studies, can be used to study real-life effectiveness, safety and tolerability of interventions over long periods of time in large patient populations; data collection can be prospective or retrospective from sources, including EHRs and anonymized medical research, pharmacy and administrative claims databases. Studies comparing observational studies with RCTs on the same topic have concluded that well designed observational studies can provide answers similar to those of RCTs [29,30]. Moreover, results of observational studies can be obtained more quickly and often at a lower cost than RCTs, although rigorously conducted observational studies are not inexpensive.

The limitations of observational studies include the potential for bias, introduced if there is flawed information or patient selection, and for confounding [31]. Confounding occurs when an unidentified factor is responsible for an effect or outcome that is mistakenly attributed to another factor. Moreover, missing data in observational studies can limit the interpretation of findings. Patients included in observational studies are not randomly assigned to interventions, and patients and healthcare providers are not blinded.

The validity of observational studies is strengthened by the a priori (namely, before observation or study) identification of patient characteristics and testing rules, as well as the a priori identification of potential confounding factors, based on knowledge of the condition and intervention under study; registration of observational studies as for RCTs is encouraged [32]. Analytic methods to reduce the possibility of bias or confounding include propensity score matching or matched cohort analyses using key patient and disease-related characteristics, and applying statistical adjustments for confounding factors.

For patients with asthma, clinically important indicators of asthma control and severity that can be used for matching include demographic characteristics (age and sex) and baseline frequency of exacerbations (hospitalizations or oral corticosteroid prescriptions), asthma consultations, use of short-acting β2-agonist and inhaled corticosteroid (ICS) dose [33▪]. The frequency of nonasthma general practitioner (GP) consultations is a factor predictive of future asthma control (specifically exacerbations), particularly among nonadherent patients [34]. Work is ongoing by several research groups to define and validate database indicators of asthma control and medication adherence [35▪▪,36▪,37].

Detailed information on the strengths and limitations of efficacy and effectiveness trials [5▪▪,12,24,31] and guidelines for reporting pragmatic trials and observational studies have been published [15,38].

RECENT EFFECTIVENESS TRIALS IN ASTHMA

Recent pragmatic trials and observational studies have examined outcomes of interventions for diverse real-life patient populations, including smokers and patients with variable adherence, inhaler technique and baseline asthma control.

Choice of controller therapy

Asthma management guidelines list ICS as the most ‘effective’ controller (preventer) therapy for adults and older children; leukotriene receptor antagonists (LTRAs) are listed as a secondary option for initiating controller therapy (at step 2) in the United States (US) and Global Initiative for Asthma (GINA) guidelines [1,3] and as a secondary option for add-on therapy to ICS (at step 3) in US, UK and GINA guidelines [1–3]. The results of a recent meta-analysis of asthma RCTs support the superior efficacy of ICS monotherapy compared with antileukotrienes in adults and children [39▪]. A second meta-analysis comparing long-acting β2-agonist (LABA) with LTRA as an add-on therapy to ICS reports mostly modest differences for adults, and no conclusions were drawn for children [40▪].

The results of recent pragmatic trials and observational studies provide a fuller picture of the effectiveness of LTRA in clinical practice and challenge asthma guideline recommendations. In two pragmatic trials conducted in the UK primary care setting, a patient-oriented measure of quality of life (QoL) was equivalent at 2 months for LTRAs compared with ICS as monotherapy and LABA as an add-on to ICS for adults with physician-diagnosed asthma [41▪▪]. At 2 years, equivalence in QoL was not proven; however, asthma control scores and exacerbation rates were comparable. Adherence rates with LTRA were 65 and 74% as compared with 41 and 46% with ICS in the two trials, respectively. Similarly, better adherence with LTRA than ICS was observed in a matched cohort study [42▪] of 227 children and adolescents (2–17 years old); outcomes were similar or better for patients prescribed LTRA, including a significantly lower rate of hospital admissions for asthma and rescue β2-agonist use than in the ICS cohort.

The findings of these studies suggest that, in real-life clinical practice, better patient adherence with an oral (LTRA) than inhaled medication (ICS) may eliminate the efficacy advantage of ICS seen in the idealized settings of RCTs. Moreover, patients with rhinitis may benefit from systemic antileukotriene effects, and smokers may respond better to LTRAs than ICS [8▪,41▪▪]. In another larger database study [43▪] of children ages 5–15 years (n = 27 355), the risk of asthma exacerbations was significantly lower with LTRA than ICS for patients with no exacerbations at baseline but was similar for those with at least one exacerbation at baseline. Interestingly, there were no differences in patient adherence with LTRA and ICS, but the proportion of days covered with prescriptions’ supply was higher for LTRA than ICS, suggesting that in practice ICS was being prescribed as an intermittent rather than daily controller.

Choice of inhaled corticosteroid and inhaler device

Asthma guidelines and results of systematic reviews and meta-analyses of RCTs comparing corticosteroids [44,45] and inhaler devices [46,47] provide little guidance for clinicians faced with several choices when prescribing ICS for patients with asthma. In recent years, ICS have been developed with extrafine particles that show more uniform and deeper airways penetration than the larger particle ICS [48]. Whether distribution of ICS to the peripheral small airways provides additional clinical benefit in asthma is an area of active investigation for which observational studies are ideally suited because of the ability to study large patient populations over long timelines.

In a matched cohort study [33▪] using a UK primary care database, the adjusted odds of achieving asthma control over 1 year were significantly greater for patients (ages 5–60 years) initiating ICS (n = 11 528) or stepping up dose of ICS (n = 774) with extrafine particle beclomethasone rather than the larger particle chlorofluorocarbon-beclomethasone. These results supported those of an earlier, similarly designed study [49] comparing extrafine particle beclomethasone with fluticasone, a larger particle ICS.

Brusselle et al. [50▪▪] used a prospective cohort study to evaluate the real-life effectiveness of extrafine particle beclomethasone in fixed-dose combination (FDC) with formoterol for adult patients, including those who smoked (n = 123/619). They recorded significant improvements in patient-reported and physician-evaluated measures of asthma control over 1 year for nonsmokers as well as for current or ex-smokers. In a small cross-sectional study (n = 111) [51▪], the extrafine beclomethasone–formoterol combination delivered by pressurized metered-dose inhaler (pMDI) provided significantly better asthma control, and at a lower ICS dose, than two larger particle FDC ICS/LABA delivered by dry powder inhaler. Cumulatively, the results of these studies suggest better effectiveness of extrafine particle than larger particle ICS.

Inhaler mishandling and improper inhalation technique are common problems in clinical practice [52▪]. Guidelines report no differences, based on RCT results, among inhaler types [1–3,46,47]; however, this may be because patients in RCTs are well trained to use their inhalers [53▪]. In real-life studies, some differences begin to emerge, indicating that inhaler device selection likely has a bearing on clinical outcomes. For patients initiating (n = 56 347) or stepping up dose (n = 9169) of ICS monotherapy, outcomes in a large cohort study [54] were better with BAIs and dry powder inhalers (DPIs) than pMDIs. Instead, for delivery of FDC fluticasone-salmeterol therapy, results of a matched cohort study [55▪] of 3134 patients 4–80 years old indicate that patients using a pMDI had better odds of asthma control over 1 year than those using a DPI. Differences in real-life effectiveness among these devices require closer evaluation in well designed prospective trials. Results of another observational study [56▪] indicate that outcomes for patients initiating ICS are better when inhaler device types are the same for both ICS and reliever therapy.

Safety of therapy

Observational studies are useful to track potential adverse effects of interventions. Two long-standing concerns about asthma therapy are whether ICS use in childhood reduces attained adult height and whether long-term use of LABAs is safe. In the observational follow-up study [57â–ª] to the Childhood Asthma Management Program, patients who had received budesonide as prepubertal children reached an adjusted mean adult height 1.2 cm lower than that in the placebo group, indicating that the decrease in attained height associated with ICS therapy was persistent but not progressive since the end of the trial. A larger daily dose during the first 2 years of therapy was associated with a lower height, suggesting that the lowest ICS dose that controls symptoms should be prescribed to children.

With regard to the safety of LABAs, the US Food and Drugs Administration (FDA) has required LABA manufacturers to conduct a total of five clinical trials [58]. These trials are intended to mimic a real-life scenario, and patient eligibility is indeed broad; however, ICS dose titrating is not allowed, and thus the future real-life applicability of the findings is uncertain.

CURRENT INITIATIVES PROMOTING AND SUPPORTING EFFECTIVENESS RESEARCH

Opinion pieces in major journals have called for incorporating effectiveness research into the evidence base [4▪▪,7▪,13,16▪], and several governmental and nongovernmental policy groups are promoting and working to improve effectiveness research. In the United States, recent healthcare legislation has resulted in a new emphasis on comparative effectiveness research and use of patient-centered outcomes, with recent publication of a draft methodology report containing 60 standards to guide patient-centered outcomes research [59–63,64▪]. A US public–private partnership called the Observational Medical Outcomes Partnership (OMOP; http://omop.fnih.org/) has been launched with the goal of identifying methods for analyzing observational data drawn from heterogeneous sources, and the Association of the British Pharmaceutical Industry has published guidance on using real-world data [65].

Initiatives specific to asthma include the Brussels Declaration on Asthma, sponsored by The Asthma, Allergy and Inflammation Research Charity, which called for funding of more ‘real world’ studies [9]. In the United States, an expert working group was convened for the Asthma Outcomes Workshop to standardize clinical research outcomes to permit comparisons across asthma interventional or observational studies [66▪]. The Workshop proposals have recently been published [21▪,66▪,67▪▪]. In a year-end summary of asthma research in 2011, Apter [68▪] noted that results of bench research, RCTs and real-world studies have an interwoven relationship in which each study type informs the others, similar to what Rawlins described in 2008 [12].

CONCLUSION

There are valid doubts about whether efficacy trial results are applicable to real-life patients in real-life clinical practice. The results of effectiveness trials provide parallel, and we would argue essential, strands of evidence that should be incorporated into the evaluation process for guideline recommendations. Payors are increasingly looking at real-life research as an important component of the evidence base to guide decision-making. Guideline writers should take into account the strengths and weaknesses of data from both efficacy and effectiveness trials when formulating evidence reviews for guideline recommendations.

Acknowledgements

None.

Conflicts of interest

D.P. has consultant arrangements with Almirral, AstraZeneca, Boehringer Ingelheim, Chiesi, GlaxoSmithKline, Merck, Mundipharma, Medapharma, Novartis, Napp, Nycomed, Pfizer, Sandoz and Teva. He or his research team have received grants and support for research in respiratory disease from the following organizations in the last 5 years: UK National Health Service, Aerocrine, AstraZeneca, Boehringer Ingelheim, Chiesi, GlaxoSmithKline, Merck, Mundipharma, Novartis, Nycomed, Orion, Pfizer and Teva. He has spoken for Almirral, AstraZeneca, Activaero, Boehringer Ingelheim, Chiesi, Cipla, GlaxoSmithKline, Kyorin, Novartis, Merck, Mundipharma, Pfizer and Teva. He has shares in AKL Ltd, which produces phytopharmaceuticals. He is the sole owner of Research in Real Life Ltd and its subsidiary social enterprise Optimum Patient Care.

E.V.H. has served as a consultant for Research in Real Life Ltd. and received payment for manuscript preparation from Teva Sante and Merck & Co.

T.vdM. has served as a consultant for GlaxoSmithKline; received support for travel to meetings from GlaxoSmithKline; served on boards for GlaxoSmithKline, MSD Pharma, AstraZeneca and Nycomed; and received grant support from AstraZeneca and MSD Pharma.

REFERENCES AND RECOMMENDED READING

Papers of particular interest, published within the annual period of review, have been highlighted as:

  • â–ª of special interest
  • ▪▪ of outstanding interest

Additional references related to this topic can also be found in the Current World Literature section in this issue (p. 121).

REFERENCES

1. British Thoracic Society, Scottish Intercollegiate Guidelines Network. British Guideline on the Management of Asthma. A national clinical guideline. May 2008, revised Jan 2012. http://www.sign.ac.uk/guidelines/fulltext/101/index.html. [Accessed 30 October 2012]
2. National Asthma Education and Prevention Program. Expert Panel Report 3: guidelines for the diagnosis and management of asthma. Full report 2007. http://www.nhlbi.nih.gov/guidelines/asthma/asthgdln.pdf. [Accessed 30 October 2012]
3. Global Initiative for Asthma (GINA). GINA report, Global Strategy for Asthma Management and Prevention. http://www.ginasthma.org/. [Accessed 30 October 2012]
4▪▪. Krishnan JA, Schatz M, Apter AJ. A call for action: comparative effectiveness research in asthma. J Allergy Clin Immunol 2011; 127:123–127.

This call for action summarizes why comparative effectiveness research is needed and the challenges and considerations for integrating it into the asthma evidence base.

5▪▪. Price D, Chisholm A, van der Molen T, et al. Reassessing the evidence hierarchy in asthma: evaluating comparative effectiveness. Curr Allergy Asthma Rep 2011; 11:526–538.

This is a detailed review of the strengths and limitations of observational studies and pragmatic trials and their place in the evidence base for asthma.

6. Rothwell PM. External validity of randomised controlled trials: ‘to whom do the results of this trial apply?’. Lancet 2005; 365:82–93.
7â–ª. Jarvinen TL, Sievanen H, Kannus P, et al. The true cost of pharmacological disease prevention. BMJ 2011; 342:d2175.

This opinion piece lays out the argument for real-life data to inform decisions about effectiveness and cost-effectiveness of preventive drugs.

8▪. Dahlen SE, Dahlen B, Drazen JM. Asthma treatment guidelines meet the real world. N Engl J Med 2011; 364:1769–1770.

This editorial places the results of the pragmatic trial of Price et al.[41▪▪] into the context of real-life practice.

9. Holgate S, Bisgaard H, Bjermer L, et al. The Brussels Declaration: the need for change in asthma management. Eur Respir J 2008; 32:1433–1442.
10▪. Pinnock H, Ostrem A, Rodriguez MR, et al. Prioritising the respiratory research needs of primary care: the International Primary Care Respiratory Group (IPCRG) e-Delphi exercise. Prim Care Respir J 2012; 21:19–27.

This paper summarizes the key current needs and research questions identified by an international panel of primary care clinicians treating patients with respiratory noncommunicable diseases.

11. Prasad V. The apples and oranges of cost-effectiveness. Cleve Clin J Med 2012; 79:377–379.
12. Rawlins MD. De Testimonio: on the evidence for decisions about the use of therapeutic interventions. Harveian Oration. London: Royal College of Physicians; 2008. http://bookshop.rcplondon.ac.uk/details.aspx?e=262. [Accessed 30 October 2012]
13. Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA 2003; 290:1624–1632.
14▪. Chalkidou K, Tunis S, Whicher D, et al. The role for pragmatic randomized controlled trials (pRCTs) in comparative effectiveness research. Clin Trials 2012; 9:436–446.

The authors describe the features of pragmatic trials, with examples and guidance on pragmatic trial design and implementation.

15. Zwarenstein M, Treweek S, Gagnier JJ, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008; 337:a2390.
16▪. Ware JH, Hamel MB. Pragmatic trials -- guides to better patient care? N Engl J Med 2011; 364:1685–1687.

Two biostatisticians provide their perspective on the advantages and limitations of pragmatic trials, with reference to the trial of Price et al.[41▪▪].

17. Thorpe KE, Zwarenstein M, Oxman AD, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. CMAJ 2009; 180:E47–E57.
18. Smith JR, Noble MJ, Musgrave S, et al. The at-risk registers in severe asthma (ARRISA) study: a cluster-randomised controlled trial examining effectiveness and costs in primary care. Thorax 2012. [Epub ahead of print]
19. Herland K, Akselsen JP, Skjonsberg OH, et al. How representative are clinical study patients with asthma or COPD for a larger ‘real life’ population of patients with obstructive lung disease? Respir Med 2005; 99:11–19.
20. Haughney J, Price D, Kaplan A, et al. Achieving asthma control in practice: understanding the reasons for poor control. Respir Med 2008; 102:1681–1693.
21▪. Rand CS, Wright RJ, Cabana MD, et al. Mediators of asthma outcomes. J Allergy Clin Immunol 2012; 129:S136–S141.

The authors summarize expert working group consensus on key mediators of asthma outcomes for use in asthma clinical research.

22. Corrigan CJ. Asthma therapy: there are guidelines, and then there is real life. Prim Care Respir J 2011; 20:13–14.
23. Lotvall J, Akdis CA, Bacharier LB, et al. Asthma endotypes: a new approach to classification of disease entities within the asthma syndrome. J Allergy Clin Immunol 2011; 127:355–360.
24. Price D, Bjermer L, Haughney J, et al. Real-life asthma strategies: the missing piece in the jigsaw. Treat Strategies (in press).
25. Konstantinou GN. Pragmatic trials: how to adjust for the ’Hawthorne effect’? Thorax 2012; 67:562.
26â–ª. Ryan D, Price D, Musgrave SD, et al. Clinical and cost effectiveness of mobile phone supported self monitoring of asthma: multicentre randomised controlled trial. BMJ 2012; 344:e1756.

Although not purely pragmatic, this trial illustrates the challenges of conducting pragmatic trials and the integration of cost-effectiveness determinations.

27. Wechsler ME, Kelley JM, Boyd IO, et al. Active albuterol or placebo, sham acupuncture, or no intervention in asthma. N Engl J Med 2011; 365:119–126.
28▪▪. Staa TP, Goldacre B, Gulliford M, et al. Pragmatic randomised trials using routine electronic health records: putting them to the test. BMJ 2012; 344:e55.

The authors describe a new initiative in the UK to capture data from EHRs as an unobtrusive way to conduct pragmatic randomized trials in general practice settings.

29. Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 2000; 342:1887–1892.
30. Tannen RL, Weiner MG, Xie D. Use of primary care electronic medical record database in drug efficacy research on cardiovascular outcomes: comparison of database and randomised controlled trial findings. BMJ 2009; 338:b81.
31. Vandenbroucke JP, von Elm E, Altman DG, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. PLoS Med 2007; 4:e297.
32. Williams RJ, Tse T, Harlan WR, et al. Registration of observational studies: is it time? CMAJ 2010; 182:1638–1642.
33▪. Barnes N, Price D, Colice G, et al. Asthma control with extrafine-particle hydrofluoroalkane-beclometasone vs. large-particle chlorofluorocarbon-beclometasone: a real-world observational study. Clin Exp Allergy 2011; 41:1521–1532.

This was a large observational study comparing the effectiveness of two ICS commonly used in UK practice.

34. Hyland ME, Whalley B, Halpin DM, et al. Frequency of nonasthma GP visits predicts asthma exacerbations: an observational study in general practice. Prim Care Respir J 2012. [Epub ahead of print]
35▪▪. Schatz M, Zeiger RS. Improving asthma outcomes in large populations. J Allergy Clin Immunol 2011; 128:273–277.

The authors describe their experiences and conclusions after many years of using administrative database and survey measures for asthma research.

36▪. Blais L, Kettani FZ, Beauchesne MF, et al. New measure of adherence adjusted for prescription patterns: the case of adults with asthma treated with inhaled corticosteroid monotherapy. Ann Pharmacother 2011; 45:335–341.

The authors describe a new measure of adherence for use with information recorded in administrative databases.

37. Ivanova JI, Bergman R, Birnbaum HG, et al. Effect of asthma exacerbations on healthcare costs among asthmatic patients with moderate and severe persistent asthma. J Allergy Clin Immunol 2012; 129:1229–1235.
38. von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 2007; 370:1453–1457.
39â–ª. Chauhan BF, Ducharme FM. Antileukotriene agents compared to inhaled corticosteroids in the management of recurrent and/or chronic asthma in adults and children. Cochrane Database Syst Rev 2012; 5:CD002314.

This is an example of a recent meta-analysis reporting efficacy results from asthma randomized trials.

40â–ª. Ducharme FM, Lasserson TJ, Cates CJ. Addition to inhaled corticosteroids of long-acting beta2-agonists versus antileukotrienes for chronic asthma. Cochrane Database Syst Rev 2011:CD003137.

This is another example of a recent meta-analysis of asthma randomized trials, again reporting results from the perspective of efficacy.

41▪▪. Price D, Musgrave SD, Shepstone L, et al. Leukotriene antagonists as first-line or add-on asthma-controller therapy. N Engl J Med 2011; 364:1695–1707.

The results of this pragmatic trial in UK primary care challenge the effectiveness of guideline-recommended controller therapies when prescribed for the diverse patients with asthma seen in everyday practice.

42▪. Ducharme FM, Noya FJ, Allen-Ramey FC, et al. Clinical effectiveness of inhaled corticosteroids versus montelukast in children with asthma: prescription patterns and patient adherence as key factors. Curr Med Res Opin 2012; 28:111–119.

This matched cohort study describes real-life prescribing practices and examines the relative effectiveness of ICS and LTRAs for children.

43▪. Blais L, Kettani FZ, Lemiere C, et al. Inhaled corticosteroids vs. leukotriene-receptor antagonists and asthma exacerbations in children. Respir Med 2011; 105:846–855.

This large observational study reports real-life effectiveness of ICS and LTRAs for children and discusses the findings as contrasted with those from efficacy trials as well as the importance of understanding real-life prescribing patterns.

44. Shepherd J, Rogers G, Anderson R, et al. Systematic review and economic analysis of the comparative effectiveness of different inhaled corticosteroids and their usage with long-acting beta2 agonists for the treatment of chronic asthma in adults and children aged 12 years and over. Health Technol Assess 2008; 12:iii–iv.
45. Lasserson TJ, Cates CJ, Lasserson EH, et al. Fluticasone versus ’extrafine’ HFA-beclomethasone dipropionate for chronic asthma in adults and children [review]. Cochrane Database Syst Rev 2010:CD005309.
46. Dolovich MB, Ahrens RC, Hess DR, et al. Device selection and outcomes of aerosol therapy: evidence-based guidelines: American College of Chest Physicians/American College of Asthma. Allergy Immunol Chest 2005; 127:335–371.
47. Brocklebank D, Ram F, Wright J, et al. Comparison of the effectiveness of inhaler devices in asthma and chronic obstructive airways disease: a systematic review of the literature. Health Technol Assess 2001; 5:1–149.
48. Leach C, Colice GL, Luskin A. Particle size of inhaled corticosteroids: does it matter? J Allergy Clin Immunol 2009; 124:S88–S93.
49. Price D, Martin RJ, Barnes N, et al. Prescribing practices and asthma control with hydrofluoroalkane-beclomethasone and fluticasone: a real-world observational study. J Allergy Clin Immunol 2010; 126:511–518.
50▪▪. Brusselle G, Peche R, Van den Brande P, et al. Real-life effectiveness of extrafine beclometasone dipropionate/formoterol in adults with persistent asthma according to smoking status. Respir Med 2012; 106:811–819.

This large prospective cohort study examined real-life effectiveness of an ICS/long-acting β2-agonist combination for smokers, an understudied population.

51â–ª. Muller V, Galffy G, Eszes N, et al. Asthma control in patients receiving inhaled corticosteroid and long-acting beta2-agonist fixed combinations: a real-life study comparing dry powder inhalers and a pressurized metered dose inhaler extrafine formulation. BMC Pulm Med 2011; 11:40.

This study compared asthma control parameters for outpatients using different inhaler types.

52▪. Melani AS, Bonavia M, Cilenti V, et al. Inhaler mishandling remains common in real life and is associated with reduced disease control. Respir Med 2011; 105:930–938.

This study evaluated inhaler technique by experienced patients and reports frequent mistakes with several different device types; inhaler mishandling was associated with poor disease control in this real-life study.

53▪. Papi A, Haughney J, Virchow JC, et al. Inhaler devices for asthma: a call for action in a neglected field. Eur Respir J 2011; 37:982–985.

The authors summarize the key research questions and needs specific to optimizing use of inhaler devices for asthma.

54. Price D, Haughney J, Sims E, et al. Effectiveness of inhaler types for real-world asthma management: retrospective observational study using the GPRD. J Asthma Allergy 2011; 4:37–47.
55▪. Price D, Roche N, Christian Virchow J, et al. Device type and real-world effectiveness of asthma combination therapy: an observational study. Respir Med 2011; 105:1457–1466.

This paper describes results of an observational study investigating asthma-related outcomes for patients using different inhaler device types; the discussion covers the role of real-life factors that can influence effectiveness of inhaled therapy.

56▪. Price D, Chrystyn H, Kaplan A, et al. Effectiveness of same versus mixed asthma inhaler devices: a retrospective observational study in primary care. Allergy Asthma Immunol Res 2012; 4:184–191.

This is one of the few studies to investigate the effects of mixing inhaler device types; the findings suggest that prescribing the same device type for controller and reliever therapy is the optimal approach, an important consideration for clinical practice.

57▪. Kelly HW, Sternberg AL, Lescher R, et al. Effect of inhaled glucocorticoids in childhood on adult height. N Engl J Med 2012; 367:904–912.

This observational cohort study demonstrates the importance of follow-up after randomized controlled trials to answer highly relevant clinical questions.

58. Chowdhury BA, Seymour SM, Levenson MS. Assessing the safety of adding LABAs to inhaled corticosteroids for treating asthma. N Engl J Med 2011; 364:2473–2475.
59. Kahn MG, Batson D, Schilling LM. Data model considerations for clinical effectiveness researchers. Med Care 2012; 50 (Suppl):S60–S67.
60. Desai JR, Wu P, Nichols GA, et al. Diabetes and asthma case identification, validation, and representativeness when using electronic health data to construct registries for comparative effectiveness and epidemiologic research. Med Care 2012; 50 (Suppl):S30–S35.
61. Methodology Committee of the Patient-Centered Outcomes Research Institute. Methodological standards and patient-centeredness in comparative effectiveness research: the PCORI perspective. JAMA 2012; 307:1636–1640.
62. Selby JV, Beal AC, Frank L. The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda. JAMA 2012; 307:1583–1584.
63. Gabriel SE, Normand SL. Getting the methods right: the foundation of patient-centered outcomes research. N Engl J Med 2012; 367:787–790.
64â–ª. Patient-Centered Outcomes Research Institute (PCORI). Draft methodology report. 23 July 2012. http://www.pcori.org/what-we-do/methodology/. [Accessed 30 October 2012]

This draft document has been published online for comment on 60 proposed standards to guide patient-centered outcomes research.

65. Association of the British Pharmaceutical Industry (APBI). Demonstrating value with real world data. May 2011. http://www.abpi.org.uk/our-work/library/guidelines/Pages/real-world-data.aspx. [Accessed 30 October 2012]
66▪. Busse WW, Morgan WJ, Taggart V, et al. Asthma outcomes workshop: overview. J Allergy Clin Immunol 2012; 129:S1–S8.

The authors describe the rationale for and objectives of an expert working group convened to standardize outcomes for clinical research in asthma.

67▪▪. Cloutier MM, Schatz M, Castro M, et al. Asthma outcomes: composite scores of asthma control. J Allergy Clin Immunol 2012; 129:S24–S33.

The authors provide a detailed summary of previously published composite score instruments for assessing asthma control, their strengths and limitations.

68▪. Apter AJ. Advances in adult asthma diagnosis and treatment and health outcomes, education, delivery, and quality in 2011: what goes around comes around. J Allergy Clin Immunol 2012; 129:69–75.

This is a summary of asthma research in 2011 and a description of future research needs, including the need for more pragmatic trials that take into account real-life conditions.

Keywords:

asthma; effectiveness; efficacy; pragmatic; real life

Copyright © 2013 Wolters Kluwer Health, Inc. All rights reserved.