The United States is facing a crisis in health care. Decades of health care inflation have accrued costs that now total $2 trillion annually, consuming approximately 16 percent of the gross domestic product, and are expected to increase.1 Concerns about the overall quality and efficiency of health care received by Americans are reflected in the statistics: 15 to 20 percent of Americans are uninsured,2 and emergency rooms are overloaded because of the lack of affordable preventive services,3 despite the United States having the largest health care expenditures in the world.4 Experts agree that the existing health care system is in a critical state and in the throes of a historic transition. Currently, experts and legislators are working in tandem to deliberate on resolutions that could potentially produce a transformation of the entire health care system. Among the various solutions being proposed to aggressively curb rising costs and help deliver rational care is the implementation of a strict standard of evidence-based medicine. This response may be akin to the “third revolution in medical care”5 proclaimed by Arnold Relman to usher in the outcomes movement (the first two revolutions being the spread of health insurance to expand health care and the backlash of payers to curb health care costs). Whereas outcomes research has provided some direction for dealing with the imbalances of the current system, the initial enthusiasm and promise of the outcomes movement have not produced tangible results in improving the health care environment of this country. Evidence-based medicine, which may be considered the fourth revolution in American medicine, differs from the outcomes movement in that it emphasizes greater accountability, calls for evidence to justify all medical treatment, and may be tied intimately to physician reimbursement.
Studies have exposed the unsettling reality that clinical care is often limited in its scientific background. This deviation has been linked to broad variations in care, including the “underuse, overuse, and misuse” of diagnostic and therapeutic services.6 According to health policy expert Haavi Morreim, “Defensive medicine, patients’ demands for the latest technologies, physicians’ own fascination with new devices and procedures, and economic pressures can quickly skew physicians’ most thoughtful, scientifically well-founded preferences...physicians are neither morally nor financially entitled to do literally whatever they ideally wish to do for their patients. Health care is costly, and the days of handing physicians a blank check to spend unlimited amounts of other people’s money are over.”7 These widely held sentiments have eroded the base of traditional practice and have precipitated a shift in the framework of American medicine. Over the past 20 years, medicine has adjusted to warrant intervention on empirical evidence from reproducible trials; these changes are cumulatively known as evidence-based medicine.
Evidence-based medicine has been characterized as the movement to evaluate the safety, effectiveness, and cost of medical practices from the approach of best scientific evidence and to establish medical practice on such knowledge.8 To some, evidence-based medicine has been welcomed as the next great “paradigm shift”9–11 in medicine, sure to deliver uniform care and to diminish the idiosyncrasies of individual treatment plans that are often ineffective and unsafe. Typically, physicians have used their understanding of pathophysiologic processes to practice medicine.12 For example, until mid 2002, hormone replacement therapy had been the standard, sensible treatment for common postmenopausal symptoms such as osteoporosis, vaginal dryness, and hot flashes.13 However, in July of 2002, the Women’s Health Initiative conducted a clinical trial that found hormone replacement therapy, in fact, increased the risk of breast cancer, stroke, blood clots, and dementia in treated patients.13 The latest research confirms that, even 3 years after discontinuing this trial, women treated with hormones suffered a higher risk for malignancies and experienced a 12 percent increase in global risk index.14 To skeptics, this underscores the unintended results of medical interventions not initially supported by good data. Understandably, physicians have come under intense pressure to standardize patient therapy under the strictest scientific measures available.
However, the changes accompanying evidence-based medicine are at this point ill-defined. Although the logic behind evidence-based medicine is clear, there is dissent among practitioners and policy makers about the best implementation of evidence-based medicine in day-to-day practice. The debates have divided health care professionals, especially surgeons, who have felt that evidence-based medicine has curtailed their autonomy and has neglected patient individuality.8,9,15–21 Many aspects of evidence-based medicine have come under scrutiny, including the way it should be implemented at the bedside. As the issue gains more and more prominence and media focus, it will be important to understand what evidence-based medicine is, why it is being hotly debated, and what evidence-based medicine will mean for physicians in the near future.
WHAT IS EVIDENCE-BASED MEDICINE?
Evidence-based medicine is the principle of integrating the powerful methods of science into the practice of medicine. The roots of evidence-based medicine lie in the practice of epistemology, the philosophical discipline that examines the foundations of current knowledge, including its limitations and validity. The goal of evidence-based medicine is to collect and use evidence as a guide for the practice of judicious medicine. Evidence-based medicine sets out to rigorously test the value and efficacy of any clinical intervention before it becomes a standard of medical practice to prevent the establishment of “rumor-based medicine.”17 This approach does not discredit or undermine physician autonomy, because it stresses the value of the surgeon’s clinical expertise and urges the integration of best evidence with clinical skill.15,22 In fact, studies have shown that the marriage of the implicit wisdom of a practicing clinician and the application of the scientific method in the form of data analysis has in many ways validated the “tried and true” practices of the experienced physician.12 Because the use of any evidence-based algorithm requires an accurate assessment of clinical findings, evidence-based medicine is complementary to rather than exclusive of clinical acumen. Thus, evidence-based medicine involves the combination of clinical expertise and professional wisdom with the best outside evidence to make important decisions about patient care.12,18,23–25
According to the Centre for Evidence-Based Medicine, “Evidence-based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients.”18 In theory, evidence-based medicine connects five basic ideas of how to practice effective medicine: gathering evidence, integrating evidence with experience to arrive at a clinical decision, implementing this decision at the bedside, assessing performance, and staying current with research. First, evidence-based medicine makes explicit the need for clinical decisions to be rooted in the best available basic science- and population-based evidence to avoid relying on “hearsay, habits, and standardized protocols.”12 Second, physicians must combine evidence from these studies with their own acumen and educational background.25 Third, physicians must translate the best reasoned medical plan derived from the integration of evidence and insight to the bedside in a manner that benefits the patient.18 Fourth, physicians should constantly assess their performance in terms of following these steps and correctly applying these ideas.12 Fifth, physicians must be proactive about learning and be engaged with up-to-date research.11,12,23,26,27
Much of the ambiguity behind evidence-based medicine is in dealing with the evidence itself. To provide clarity, the National Guideline Clearinghouse has stratified evidence for physicians based on strength of evidence28 (Fig. 1).
WHAT IS THE DEBATE SURROUNDING EVIDENCE-BASED MEDICINE?
The application of evidence-based medicine to the clinical setting has been broken down into a multistep process of creating answerable questions, tracking down the best evidence to answer these questions, evaluating the evidence for its strength, summarizing the evidence, integrating and implementing the evidence into practice, and finally evaluating performance.11,27,29 Each step of the process represents a unique challenge in practice that physicians as a whole find difficult to implement.12,23,24 For example, Sauerland et al. report that only 10 to 20 percent of decisions made in the surgical ward are based on randomized controlled trials, whereas approximately 30 to 50 percent of decisions in general medicine are based on randomized controlled trials.9 There may be several reasons why studies are underused in the clinic.
First and foremost, there seems to be a lack of consistent scientific evidence. In the case of surgery as a whole, Level I evidence is exceedingly difficult to come by.23–25,30 Even if there is sufficient evidence, searching the massive database of research available to physicians is a daunting task. Many find it difficult to filter and evaluate studies of sufficient quality that are not only appropriate for their patient but also amenable to previous research and pertinent to clinical situations.29,31 With the exponential increase in the number of articles, it is difficult to keep up with current best evidence.32 The most effective way to circumvent this rapid accumulation of medical literature is to rely on systematic reviews, which are well-planned studies that address the shortcomings of traditional reviews by adhering to strict, reproducible methods and recommended guidelines.33 When there is a shortage of adequate evidence, many physicians resort to instituting care based on the results of weaker evidence, such as cohort and case-control studies and expert committees, which can often lead to unsuitable treatment regimens because of “overconclusion” (arriving at an incorrect conclusion that is an artifact of the data).25,29,34,35 The relative deficiency of sound clinical evidence has spawned the Consolidated Standards of Reporting Trials criteria. Intended to expand the reporting of randomized controlled trials, the Consolidated Standards of Reporting Trials statement was developed by a group of health care experts in 1996 and uses organized checklists and flow charts that physicians can follow easily36,37 (Fig. 2). Although these guidelines were anticipated to dramatically increase the amount of reporting of randomized controlled trials, they are surprisingly underused. This dearth of relevant evidence accentuates the need to foster clinical research training in all surgical specialties.38
In addition to the lack of relevant evidence, there is also a criticism of the manner in which studies are conducted and presented to physicians by researchers. Because clinical trials focus on outcomes across populations and not on individuals, opponents of evidence-based medicine argue that randomized controlled trials are used improperly to arrive at conclusions.10,29 Important questions have been brought up regarding the validity of Level I evidence. Opponents argue that although randomized controlled trials can characterize the collective results of a drug or intervention, they are not useful in the context of an individual patient because of the variability in defining disease. Disease is complex and fluctuates substantially among individuals, making the findings of a randomized controlled trial limited and often inapplicable. Also, randomized controlled trials are known to suffer from low inclusion rates and recruitment biases. For example, if the inclusion criteria for a trial are excessively restrictive, a study may come out underpowered and unsuitable to use across large populations. In contrast, if the inclusion criteria are very liberal, the chance for false-negative outcomes increases, thereby undermining a trial. Consequently, randomized controlled trials are estimated to be invalid sources of evidence by some physicians because they are a “compromise between validity and generalizability.”9 Other criticisms of randomized controlled trials include the following: they are complicated to perform, time-consuming, expensive, and biased. For example, industry-funded clinical trials account for nearly half of all clinical studies, contributing to an inherent, systematic bias. With the for-profit motive at heart, the private industry focuses on the newest drugs and devices and tends to underfund older methods. In addition, for-profit groups have been shown to be more likely to report positive findings than similar trials financed by not-for-profit groups.39,40 Another important instance of bias arises when researchers fail to measure relevant endpoints with randomized controlled trials.9,35,41 Opponents of evidence-based medicine argue that many researchers base trials on irrelevant data that are relatively easy to collect and freely available instead of concentrating on patient-relevant endpoints such as quality-of-life measures.42 In addition, not all surgical interventions can be tested effectively in randomized controlled trials. Solomon and McLeod performed a search of the surgical literature and found that only 40 percent of treatment questions involving surgical procedures can be subjected to randomized controlled trials.43 They cite “patient preferences, uncommon conditions, and lack of surgical community equipoise” as the main factors precluding such analysis.43 However, because evidence-based medicine advises using the best available evidence, alternatives to randomized controlled trials are accepted as laid out by the U.S. Preventive Services Task Force, a government-affiliated expert panel that independently conducts reviews of scientific evidence, and other guiding institutions.
Despite the limitations of randomized controlled trials, the prevalent viewpoint seems to be that there is no better, pragmatic alternative. Proponents of evidence-based medicine state that the unexpected variation in results and recommendations of systematic reviews can and will be corrected when physicians push for steps to improve study methodologies and to standardize reporting.44 In addition, proponents argue, there is a misunderstanding that only randomized controlled trials and Level I evidence comprise the “evidence” in evidence-based medicine when in fact evidence-based medicine stresses finding the best available evidence.45 According to Sackett et al., “...if no randomised trial has been carried out for our patient’s predicament, we follow the trail to the next best external evidence and work from there.”18 Although randomized controlled trials are considered the standard for evaluating the effects of a particular intervention, they may not necessarily be the best resources for conducting diagnoses and prognoses or evaluating benefits and harms.9,29 In fact, proponents of evidence-based medicine generally accept the difficulties in extrapolating directly from the bench to the bedside.46 Therefore, randomized controlled trials should not be mistakenly considered a set of instructions when they are simply a collection of guidelines for patient care.
Randomized controlled trials aside, fervent critics feel that evidence-based medicine disparages clinical expertise by promoting “mindless algorithm” and hampering physician autonomy by demanding a code of conduct likened to “wearing a straightjacket.”16,47,48 Instead of modernizing care, evidence-based medicine jeopardizes medical progress by introducing a dull environment of uniformity and repetition, derisively termed “cookbook medicine.”47,48 Opponents also maintain that evidence-based medicine may compromise the skill and competence of practitioners. Instead of reasoning through cases, physicians will be given incentives to follow protocols that treat all patients as basically the same.10 Consequently, physicians will be ill prepared to cope with the differences between patients they will treat in actual clinical situations.10 Other arguments against evidence-based medicine range from characterizing evidence-based medicine exclusively as a means to cut costs17 to portraying evidence-based medicine as an “ivory-tower” concept feasible only in academic institutions.45 Guidelines that are incorporated into structured health policy may also carry the stigma of inflexibility, even though this is untrue if evidence-based medicine is properly implemented.
On the other side of the debate, we find advocates of evidence-based medicine who believe evidence-based protocols will overcome the many deficiencies of American health care, including the soaring costs and inefficiencies.10 The most cautious proponents have acknowledged the shortcomings of evidence-based medicine raised by the critics and have countered by encouraging a prudent use of guidelines and standards. According to this group of physicians, evidence-based medicine incorporates making decisions about treatment plans while keeping in mind both the benefits and harms within the context of a patient’s priorities.49 Finding the most favorable balance includes searching the evidence and discussing possible benefits and drawbacks with respect to a variety of outcomes.49 By supporting better outcomes as defined by the patient, there would be a subsequent increase in efficiency that would permit practitioners to allocate more resources toward the most effective treatments.9,10 In addition, evidence-based medicine promises to create better-informed patients and clinicians by offering jointly agreed-on and publicly available information about treatment options.9,10,23,29 Proponents argue that guidelines would empower physicians to oversee and manage medical decisions to counter the forces of managed care organizations. Because evidence-based medicine provides evidence and objective guidelines, physicians could practice medicine with their patients’ best interests in mind rather than depending on the approval of insurers and policy makers.10
In an effort to jumpstart evidence-based practice, innovative formats have recently been developed to enable clinicians to describe evidence to each other and to individual patients. National organizations such as the Agency for Healthcare Research and Quality, field-specific organizations such as the American College of Surgeons, and specialty-specific organizations such as the American Society of Plastic Surgeons have published data to help communicate up-to-date evidence and guidelines to physicians. Until strict guidelines are made explicit and enacted into policy, these organizations can provide useful information and advice for clinicians.
WHAT WILL EVIDENCE-BASED MEDICINE MEAN TO PHYSICIANS IN THE NEAR FUTURE?
A push for quality metrics and evidence-based practice will have a significant impact on physician reimbursement and patient care. Policy makers and managed care organizations will begin to rely on the sound science that evidence-based medicine publicly provides to create national policies such as pay-for-performance programs. It is crucial for physicians to pay attention to the changes taking place not only in the clinic but also in politics, where the future of health care in the United States will be decided. Perhaps these policy implications are the most overlooked consequences of evidence-based medicine.
Currently, medical decision making is heavily physician-centric. Although health information is freely available to the public, patients rarely gain access to information about treatment options and physician performance. Similarly, payers, including management care organizations and the government, have relatively little information and rely largely on physicians to exercise their best judgment.8 In the same vein, there is little in the way of measuring success and assessing treatment quality outside professional self-regulation.8 However, evidence-based medicine will distance physicians from this familiar territory. For example, implementing evidence-based medicine will allow medical information to be placed into the public arena without the involvement of physicians.50 This so-called evidence-based consumer health information will result in stripping away physicians’ exclusive knowledge of evidence.
Evidence-based guidelines have become highly credible sources of information about what forms of care are effective. These guidelines typically carry the endorsement of expert groups such as the Agency for Healthcare Research and Quality and the U.S. Preventative Task Force, which have established clear guidelines that are readily adopted as measures for quality of care.51 Whether the measures used are actually valid indicators of health care quality is up for debate. In addition, evidence may be a means for institutional control and policy disputes. For example, evidence-based guidelines have served as the basis for initiatives to guarantee certain standards of care. These quality assurance initiatives encourage adherence to evidence-based guidelines for the management of particular diseases and ensure that such adherence is monitored.49 These initiatives collect and distribute evidence having to do with a particular condition and provide guidelines for treating patients with the condition. As it stands, medical decision-making can be established on the grounds of education, experience, and insight. However, if evidence-based medicine gets established at the policy level, health care managers and patients will likely demand that physicians justify their decisions with evidence. Managed care organizations may find these guidelines helpful in assessing physician performance and quality of care and could possibly gain considerable authority in making medical decisions.8
On one hand, evidence-based medicine has the potential to find newer, more effective treatments for patients. On the other hand, there is concern that evidence-based medicine may be used as a rationale for denying expensive new procedures and curtailing the development of innovative advancements. This contradiction arises because evidence for a procedure is primarily validated by large, time-consuming studies such as randomized controlled trials. In the meantime, insurance companies in the United States may deny reimbursement for these procedures because even a temporary lack of evidence, to them, is an indication of inefficiency or ineffectiveness. In Germany, for example, reimbursement for some cancer care is denied partly because the number of treated patients for a novel therapeutic procedure is too small to reach the standard of Level I evidence, creating a hurdle for the establishment of new helpful technologies.52
In addition, new treatments and procedures may be at odds with prevailing standards of care. To deal with the medical community’s resistance to change, managed care organizations have baited physicians with financial incentives. One of the most effective levers for altering physician behavior is through changes in payment policies.53 Evidence-based guidelines carry the credibility that comes from the impartiality of scientific research, making them attractive as foundations for performance incentives. The most recent data show that health care organizations have already begun to pay physicians for meeting quality standards.53,54 In addition, the Medicare Payment Advisory Commission agreed “to recommend Congress enact a pay-for-performance for hospitals and physicians,” thus kicking off the first of many payer-induced financial encouragements for complying with evidence-based guidelines.23 It is believed that this will promptly include bonus pay for providing higher quality care, however that may be defined.23
In 2004, the Johns Hopkins and American Healthways Physicians Meeting and Outcomes Summit convened to “bring together physicians and medical managers and provide a consensus statement on how outcomes-based compensation arrangements should be developed to align health care toward evidence-based medicine, affordability, and public accountability for how resources are used.”53 Here, physicians defined the form of compensation referred to as “pay-for-performance” as “the use of incentives to encourage and reinforce the delivery of evidence-based practices and health care system transformation that promote better outcomes as efficiently as possible.”53 They reported that although currently 1 to 2 percent of physicians receive compensation in pay-for-performance programs, the number of physicians and the total sum of money implicated in pay-for-performance programs in the near future will be considerable.53,54
Pay-for-performance is presently being investigated in several situations. For example, the Centers for Medicare and Medicaid Services, the federal agency managing Medicare, Medicaid, and the State Children’s Health Insurance Program, has issued “report cards” on hospitals to determine the extent of adherence to evidence-based guidelines. The Centers for Medicare and Medicaid Services also recently started to catalog quality information reported by thousands of hospitals that is easily available to the public. These data will be used to monitor outcomes of physicians from all specialties and will eventually be condensed into a report card of individual physicians, based partially on compliance with evidence-based guidelines.23
Although evidence-based medicine has many anticipated benefits, physicians should approach this trend with a sense of guarded optimism. Many experts have warned that not only are “unintended consequences” to be expected, but that there is currently no means of spreading accountability among policy makers.55–57 Also, some have described pay-for-performance and the policy-making approach “an unproven and potentially risky intervention”55 and a form of “social experimentation”58,59 because it increases physician accountability. This is complicated by the fact that accountability is already difficult to define in clinical situations in which patients may be treated by many physicians. Some worry that policy changes in health care may be espoused on the basis of funding circumstances or political sentiment rather than evidence of benefit or harm. In addition, pay-for-performance has been called into question; according to Fisher, it could diminish patient trust and physician professionalism, and reduce access for at-risk populations.57 In other words, if physicians’ salaries are tied to their performance, they could decide that it would be more profitable to neglect the sickest patients, thereby bankrupting providers serving the disadvantaged. If the medical community is not conscious of the political entanglements that will certainty accompany evidence-based medicine–based legislation, the health care system could suffer greatly. As guidelines become the criteria for practice, it will be important to be able to challenge the power and oversight that will be handed over to managed care organizations and policy makers.
There are some very critical issues that must be addressed with regard to evidence-based medicine’s proper implementation in the wards. Issues such as medical necessity will soon be debated among policy makers and lawyers and interest groups whose significant, lasting interest is not in patients but rather in questionable principles and economic rationales. As pointed out by Anrold Rosoff, J.D., at the Wharton School of Business, “Evidence-based medicine is often used to create clinical paths, or practice guidelines. But the courts have yet to figure out what to do with these guidelines—and if the courts are unsure or confused, the benefits may be compromised.”60 In the face of rising accountability, physicians must be ready to define quality standards and to formulate agreeable policies regarding what constitutes evidence. These definitions must clearly outline and support medical decision making when physicians are brought to the courtroom. As the dialogue surrounding evidence-based medicine continues, it is important for the medical community to take a proactive role in dictating its terms.
Evidence-based medicine is the platform from which evidence is consolidated into medical management. However, although society has largely found comfort with professing evidence as truth, for individual patients, it can be far from the truth. Well-trained physicians can be misled into believing that studies are the be-all and end-all of medicine. However, although studies can confer a central logic that can help steer clinicians in many situations, evidence must be treated as just that—a pool of observations weighted toward levels of confidence. Clearly, no randomized clinical trial or evidence-based guideline can fully dictate a surgeon’s move in the operating room. Evidence-based guidelines have their limitations and must be interpreted on a case-by-case basis when dealing with patients. As it stands, guidelines based on evidence are finding their way into health policy. As this process evolves, the medical community must act in its self-interest to bring attention to the possible oversimplifications of enacting evidence-based generalizations into law. Medicine is far from an exact science. It is a blend of technical proficiency, intuition, and human interaction. It is important to acknowledge that evidence-based medicine, along with the broad changes that will follow imminent reforms in health care legislation, although relevant, can in no significant way change these core values.
This work was supported in part by grants from the National Institute of Arthritis and Musculoskeletal and Skin Diseases (R01 AR047328), a Midcareer Investigator Award in Patient-Oriented Research (K24 AR053120), and an Exploratory/Developmental Research Grant Award (R21AG030526) (K.C.C.).
1. Catlin A, Cowan C, Heffler S, et al. National health spending in 2005. Health Affairs.
2. Center on Budget and Policy Priorities. The Number of Uninsured Americans Is at an All-Time High.
Washington, DC: Center on Budget and Policy Priorities, August 2006.
3. O’Shea J. The Crisis in America’s Emergency Rooms and What Can Be Done
. Washington, DC: The Heritage Foundation, December 2007.
4. Pear R. U.S. health care spending reaches all-time high: 15% of GDP. New York Times.
January 9, 2004; sect 3.
5. Relman AS. Assessment and accountability: The third revolution in medical care. N Engl J Med.
6. Chassin MR, Galvin RW. The urgent need to improve health care quality. Institute of Medicine National Roundtable on Health Care Quality. JAMA.
7. Morreim EH. Medicine meets resource limits: Restructuring the legal standard of care. Univ Pittsbg Law J.
8. Rodwin MA. The politics of evidence-based medicine. J Health Polit Policy Law.
9. Sauerland S, Lefering R, Neugebauer EAM. The pros and cons of evidence-based surgery. Langenbecks Arch Surg.
10. Timmermans S, Mauck A. The promises and pitfalls of evidence-based medicine. Health Affairs.
11. Evidence-Based Medicine Working Group. Evidence-based medicine: A new approach to teaching the practice of medicine. JAMA.
12. Sackett DL, Rosenberg WM. The need for evidence-based medicine. J Soc Med.
13. Rossouw JE, Anderson GL, Prentice RL, et al. Risks and benefits of estrogen plus progestin in healthy postmenopausal women: Principal results from the Women’s Health Initiative randomized controlled trial. JAMA.
14. Heiss G, Wallace R, Anderson GL, et al. Health risks and benefits 3 years after stopping randomized treatment with estrogen and progestin. JAMA.
15. Kitto S, Villanueva EV, Chesters J, Petrovic A, Waxman BP, Smith JA. Surgeons’ attitudes towards and usage of evidence-based medicine in surgical practice: A pilot study. Aust N Z J Surg.
16. Cook RC, Alscher KT, Hsiang YN. A debate on the value and necessity of clinical trials in surgery. Am J Surg.
17. Loewy EH. Ethics and evidence-based medicine: Is there a conflict? Medscape Gen Med.
18. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence-based medicine: What it is and what it isn’t. BMJ.
19. Grahame-Smith D. Evidence based medicine: Socratic dissent. BMJ.
20. Evidence based medicine; in its place. Lancet.
21. Evidence based medicine. Lancet
22. Jones RS, Richards K. Office of Evidence-Based Surgery: Charts course for improved system of care. Bull Am Coll Surg.
23. Maier RV. What the surgeon of tomorrow needs to know about evidence-based surgery. Arch Surg.
24. Offer GJ, Perks GB. In search of evidence-based plastic surgery: The problems faced by the specialty. Br J Plast Surg.
25. Naylor CD. Grey zones of clinical practice: Some limits to evidence-based medicine. Lancet.
26. Bhandari M, Devereaux PJ, Montori V, Cina C, Tandan V, Guyatt GH. Users’ guide to the surgical literature: How to use a systematic literature review and meta-analysis. Can J Surg.
27. Cook DJ, Sibbald WJ, Vincent JL, Cerra FB. Evidence based critical care medicine: What is it and what can it do for us? Evidence Based Medicine in Critical Care Group. Crit Care Med.
29. Straus SE, McAlister FA. Evidence-based medicine: A commentary on common criticisms. CMAJ.
30. Smith R. Where is the wisdom …? BMJ
31. Miettinen OS. Evidence in medicine: Invited commentary. CMAJ.
32. Sears ED, Burns PB, Chung KC. The outcomes of outcome studies in plastic surgery: A systematic review of 17 years of plastic surgery research. Plast Reconstr Surg.
33. Margaliot Z, Chung KC. Systematic reviews: A primer for plastic surgery research. Plast Reconstr Surg.
34. Diehl LF, Perry DJ. A comparison of randomized concurrent control groups with matched historical control groups: Are historical controls valid? J Clin Oncol.
35. Feinstein AR, Horwitz RI. Problems in the “evidence” of “evidence-based medicine.” Am J Med.
36. Moher D, Schulz KF, Altman D. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA.
37. Altman DG, Schulz KF, Moher D, et al. The revised CONSORT statement for reporting randomized trials: Explanation and elaboration. Ann Intern Med.
38. Chung KC. Revitalizing the training of the clinical scientists in surgery. Plast Reconstr Surg.
39. Celermajer DS. Evidence-based medicine: How good is the evidence? Med J Aust.
40. Ridker PM, Torres J. Reported outcomes in major cardiovascular clinical trials funded by for-profit and not-for-profit organizations: 2000–2005. JAMA.
41. Kerridge I, Lowe M, Henry D. Ethics and evidence based medicine. BMJ.
42. Troidl H, Kusche J, Vestweber KH, Eypasch E, Koeppen L, Bouillon B. Quality of life: An important endpoint both in surgical practice and research. J Chronic Dis.
43. Solomon MJ, McLeod RS. Should we be performing more randomized controlled trials evaluating surgical operations? Surgery.
44. Guyatt GH, Sinclair J, Cook DJ, Glasziou P. The users’ guides to the medical literature: XVI. How to use a treatment recommendation. Evidence-Based Medicine Working Group and the Cochrane Applicability Methods Working Group. JAMA.
45. Hampton JR. Evidence-based medicine, practice variations and clinical freedom. J Eval Clin Pract.
46. Echt DS, Liebson PR, Mitchell LB, et al. Mortality and morbidity in patients receiving encainide, flecainide, or placebo. The Cardiac Arrhythmia Suppression Trial. N Engl J Med.
47. Charlton BG. Restoring the balance: Evidence-based medicine put in its place. J Eval Clin Pract.
48. Horwitz RI. The dark side of evidence-based medicine. Cleve Clin J Med.
49. Tinetti ME, Bogardus ST Jr, Agostini JV. Potential pitfalls of disease-specific guidelines for patients with multiple conditions. N Engl J Med.
50. Milne R, Oliver S. Evidence-based consumer health information: Developing teaching in critical appraisal skills. Int J Qual Health Care.
51. Garber AM. Evidence-based guidelines as a foundation for performance incentives. Health Affairs.
52. Biller-Andorno N, Lenk C, Leititis J. Ethics, EBM, and hospital management. J Med Ethics.
53. Outcomes Based Compensation: Pay for Performance Design Principles. The Johns Hopkins-American Healthways 4th Annual Physicians Meeting and Outcomes Summit; Rancho Mirage, California; November 11–14, 2004.
54. Casalino L, Gillies RR, Shortell MM, et al. External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. JAMA.
55. Wharam FJ, Daniels N. Toward evidence-based policy making and standardized assessment of health policy reform. JAMA.
56. Epstein AM. Pay for performance at the tipping point. N Engl J Med.
57. Fisher ES. Paying for performance: Risks and recommendations. N Engl J Med.
58. Daniels N, Sabin JE. Setting Limits Fairly: Can We Learn to Share Medical Resources?
New York: Oxford University Press; 2002.
59. Rosenthal M, Daniels N. Beyond competition: The normative implications of consumer-driven health plans. J Health Polit Policy Law.
60. Marwick C. Will evidence-based practice help span gulf between medicine and law? JAMA.
Contribute to Plastic Surgery History
The Journal seeks to publish historical photographs that pertain to plastic and reconstructive surgery. We are interested in the following subject areas:
* Departmental photographs
* Key historical people
* Meetings/gatherings of plastic surgeons
* Photographs of operations/early surgical procedures
* Early surgical instruments and devices
Please send your high-resolution photographs, along with a brief picture caption, via email to the Journal Editorial Office (firstname.lastname@example.org). Photographs will be chosen and published at the Editor-in-Chief’s discretion.