Doan, Quynh MDCM, MHSc, PhD; Hall, William; Shechter, Steven PhD; Kissoon, Niranjan MD; Sheps, Sam MD, MSc; Singer, Joel PhD; Wong, Hubert PhD; Johnson, David MD
Overcrowding in North American EDs is a growing concern and is believed to be the result of converging and competing factors.1,2 Pediatric EDs have also experienced problems with overcrowding, resulting in a decreased quality of care for patients.3–6
The most frequent cause of overcrowding in general EDs is boarding of admitted patients.7 In contrast, a 2010 survey of Canadian pediatric ED directors and nursing staff suggested that high volumes coupled with inadequate staffing levels lead to prolonged waiting times.8 Waiting time is a factor that may contribute to some patients and families (0.2% to 7.6% of all pediatric ED visits) leaving without having been seen by a physician.9–11 These patients may have conditions that can lead to serious adverse events if left untreated.12 Therefore, overcrowding not only is inconvenient for families but can also have adverse health consequences. Nevertheless, pediatric EDs treat a relatively higher proportion of nonurgent and low-complexity cases (35% to 70% of cases) and have lower patient admission rates than general EDs.13–16
Efforts in pediatric EDs to improve patient flow should focus on the efficient management of large volumes of patients with low acuity. Innovative staffing models, such as the use of physician assistants (PAs), are well accepted in the United States.17–21 However, PAs are relatively new to the healthcare system in Canada, and although their skills and scope of practice are well suited for the pediatric ED, the range of clinical presentations PAs would be involved with and their level of autonomy in a Canadian pediatric ED may be limited at first.22,23 Nonetheless, experience in the United States and a few Canadian provinces suggests that PAs (who require less training, and are less costly than physicians) may become a cost-effective solution to pediatric ED overcrowding.24
Discrete event simulation (DES) modeling is commonly used in healthcare systems to model and subsequently optimize resource allocation.25,26 Although many simulation studies have examined staffing level changes on health systems, none have evaluated the effect of PAs on patient crowding, compared with the effect of additional physicians in pediatric EDs.27–29 To address this gap, we used a DES model of our pediatric ED to compare the effect on key efficiency indicators of extending physician coverage versus adding PAs with equivalent incremental costs.
DES allows for modeling of discontinuous systems, and can emulate actual events in healthcare systems. It employs statistical calculations and theoretical distributions to deliver outcomes of a particular process.25,30–32 Once built, a model can be used to test the effect of changing one or a series of variables and to determine the effect of these changes on outcomes. In the case of ED modeling, outcomes can include patient wait times, leaving without being seen rates, and LOS. Using DES, we sought to forecast the differential effect of extending physician coverage versus introducing PAs on measures of flow in a Canadian pediatric ED.
MATERIAL AND METHODS
System description and conceptual model building A DES model was built based on the pediatric ED at British Columbia Children's Hospital (BCCH). BCCH is the only tertiary care pediatric ED in British Columbia, with about 40,000 patient visits per year. The BCCH pediatric ED functions as a two-track system using the Canadian Triage and Acuity Scale (CTAS). Patients triaged to CTAS levels 1 to 3 are seen in the high-acuity track; those triaged to CTAS levels 4 and 5 are managed in the low-acuity track, commonly called “fast track.” Separate teams, composed of an ED pediatrician and physician trainees, staff each track. The low-acuity track is open 14 hours per day (late morning to late evening); the high-acuity track is open 24 hours a day. In addition, a third ED physician (flow physician) is present in the evening 7 days a week during the busy season (October to May, winter-spring), and Friday to Sunday the rest of the year (June to September, summer-fall). The flow physician manages patients in either track depending on the longest queue, and does not have clinical teaching responsibility for trainees during his or her shift.
Data collection Information on system layout and operating procedures was collected through consultation with pediatric ED staff and direct observation of patient flow from registration to discharge. The system was reviewed with the pediatric ED chief physician and nurse manager to ensure accurate representation of patients' courses through the pediatric ED. Additional information such as distribution of patient triage levels and leaving without being seen rates was obtained from the Provincial Health Services Authority (PHSA) support services.
Research assistants carried out direct observation using stopwatches to time all the processes in a patient visit, from pretriage to discharge. Observations were conducted during a sample of days, evenings, and nights, across all days of the week and during all four seasons from July 2010 to June 2011. More than 1,000 hours of data were collected, with hundreds of observations for integral data points. For each process observed, timed durations were fitted to theoretical probability distributions using the input analysis function on ARENA 10.0 Simulation Software (Rockwell Software, Sewickley, Pa.).
The frequency and duration of other physician activities were recorded in a similar fashion to the direct patient care processes. Other physician activities included bedside teaching, discussions with nursing staff, consultations with other physicians, and breaks. These were labeled as “personal activities” (breaks and nonpediatric ED patient-related discussions or paperwork), or “pediatric ED operations and patient care-related activities.” Patient assessment, review with physician, and reassessment times for physician trainees were collected during direct observation shifts. The number of trainees present on any given shift was variable and a sample of the 2010 trainee pediatric ED schedule was used in the model.
DES model building and validation The simulation model was built using ARENA 10.0 simulation software. Theoretical time distributions based on aforementioned data for each observed process were used to populate the model. The model was verified by examination of its output for reasonableness, and by using stress tests to ensure that all modules and software functions were adequate. Stress testing consists of examining how the model design responded to extraordinary conditions. If a model is adequately designed, it will respond as anticipated even under unrealistically extreme conditions, and the simulation would terminate due to software capacity limits, rather than design malfunction.
The baseline simulation model (without additional physician coverage or PAs) was validated by comparing the average total annual visit numbers, waiting time, LOS, and leaving without being seen rates from five iterations of one simulated year to those from 2010 administrative data.
Pediatric ED visits triaged to CTAS 1 are infrequent, and the priority is to assess, resuscitate, and stabilize the child. Because of the emphasis on management, collected time stamps for administrative purposes often are entered after clinical stabilization and often are inaccurate. We therefore opted a priori to validate the model comparing outcome measure summaries of only CTAS 2 to 5.
Scenario testing and outcome measures The first scenario (additional ED pediatrician coverage) was simulated by adding 1,450 physician hours/year to the physician schedule in the baseline model. These additional hours would cost about $307,000 Canadian (about $279,000 US) and represent the additional coverage suggested by the hospital administration for volume surges. These additional hours were added into the model to provide an extra 6-hour shift each day during the busiest periods of the year (winter-spring), and busiest hours of the day (afternoon and evening).
The second scenario (adding PAs to the clinical team) simulated adding a provider who could assess low-acuity patients, but had to review cases with physicians. This conservative approach reflects the results of two previous studies involving PAs and Canadian physicians practicing in Canadian pediatric EDs. These surveys reported participants' selection of conditions thought to be appropriate for PAs to manage either with direct physician supervision or independently.22,23 More than 80% of physicians and PAs identified three clinical conditions (ear pain, upper respiratory infections, and insect bites) that accounted for 21% of all CTAS 4–5 visits (about 5,900 patients) that did not need direct physician support. Based on these data, our model required PAs to review 79% of randomly assigned cases with a physician.
The same budget ($307,000 Canadian) would pay for 5,750 hours of PA time (rate obtained through personal communications with the past president of the Canadian PA Association). These PA hours were added to the baseline model over the whole year, but favored the busiest days of the year and busiest hours of the day. In this scenario, the model allowed the physician assigned to the low-acuity track to assess patients in either the low- or high-acuity track depending on where the queue of patients was longer, and return if a patient needed to be reviewed with a trainee or a PA in the low-acuity track.
Because PAs are not licensed to work in British Columbia, their service times (assessing patients and reviewing cases with physicians) could not be observed directly. A comprehensive literature review also failed to identify service times for PAs practicing in pediatric EDs. Given this absence of quantified service times, we talked to PAs working in Manitoba and Washington state EDs, who stated that the duration of PA assessments was comparable to that of assessments performed by physicians. This assertion was supported by data from a review of an urgent care clinic.33 We therefore assumed that time distributions for PA assessments in the model were similar to physician assessment times collected during direct observation. The time required for a PA to review a case with a physician was estimated to be similar to the time required to review a junior trainee's work. Thus, the same time distribution used for case review among trainees in the baseline model was also used for case review by PAs in the second scenario.
Sensitivity analyses We ran modified versions of the scenario with PAs to explore the effect of varying five factors:
* The physician assigned to the low-acuity track remained there regardless of the length of queue.
* The proportion of PA cases requiring review by a physician varied between 10% and 100%.
* PA double coverage was simulated in the evenings (the busiest time for the pediatric ED) by overlapping shifts; in the original second scenario, a maximum of one PA was assigned to be on shift at any given time.
* The number of patients a PA could assess before having to review with a physician was increased from zero to two.
* PA initial assessment times were increased from being the same distribution as ED pediatricians to mirror that of physician trainees.
Outcome analyses Each modified scenario model was run for a simulated year, and the average output of five iterations was compared against the baseline model. Descriptive statistics were used to report absolute differences in mean waiting time, LOS, and leaving without being seen rates between each of the scenarios and the baseline model stratified by pediatric CTAS levels.
Model verification and validation The pediatric ED baseline model responded to stress testing adequately, and model integrity was maintained. The output summaries mirrored those acquired from the administrative database with the exception of outcome measures from CTAS 1 level patients, which were assumed to be inaccurate in the administrative database as outlined previously. We also stratified the baseline model outputs across the two main seasonal periods (winter-spring and summer-fall), and found that the leaving without being seen rates, waiting time, and LOS remained comparable between the model output and the administrative data (Table 1).
Strategy scenario testing Outputs from the first scenario model with extended flow physician coverage are shown in Table 2. Extending the flow physician coverage achieved significant reduction in waiting time during the winter-spring season across all five CTAS levels, with proportionate reduction in LOS during the winter-spring season. No significant changes to the outcome measures were found during the summer-fall season. However, the effect of adding physician coverage during the winter-spring was large enough to affect the annual mean waiting time and LOS in most CTAS levels, and resulted in a reduction of leaving without being seen rates (60% reduction for CTAS 3 level visits, and a 30% reduction for CTAS 4–5 levels visits).
Outputs from the second scenario model are shown in Table 3. This model simulated the introduction of a PA to the low-acuity track with physician review of 79% of the PA caseload, in accordance with the estimate given in the physician survey, and sharing of the low-acuity physician with the high-acuity track. This model resulted in meaningful waiting time reductions for patients in CTAS 1 to 3. The waiting time reduction observed for CTAS 4 and 5 was, however, clinically negligible and LOS for CTAS 4 and 5 patients increased slightly. The addition of PAs to the pediatric ED also reduced leaving without being seen rates by 84.4% for CTAS 3 patients, by 18.2% for CTAS 4 patients, and by 6.2% for CTAS 5 patients.
Sensitivity analyses By preventing the low-acuity physician from floating between the two tracks, moderate improvement was realized in waiting time outcomes for patients in the low-acuity track and none in the high-acuity track. Increasing PA autonomy resulted in consistent and appreciable reductions in mean waiting time, LOS, and leaving without being seen rates for patients in CTAS 4 and 5. When the proportion of cases to be reviewed reached 50%, the PA model would result in a reduction in waiting time for CTAS 4 and 5 comparable to the outcomes of the physician model—a 20% to 35% reduction, while maintaining superior flow improvements for patients in CTAS 1 to 3 as compared with those obtained in the extended flow physician model (Figure 1).
Other sensitivity analyses varied the PA schedules to overlap their shifts, changed the PAs' assessment times to mirror that of trainees, and allowed PAs to assess and accumulate up to two cases before having to review and reassess with a physician. These manipulations did not affect the outcome measures significantly when compared with the original PA model.
The rationale for evaluating the use of PAs in the pediatric ED is to explore models to decrease wait times where physicians are ultimately responsible for care delivered, but are unable to cope with large volumes even when used at full capacity. This study found that additional physician coverage could reduce average waiting time in our tertiary pediatric ED by 20% to 35% across all CTAS level visits. The equivalent investment in PAs could reduce waiting time in a pediatric ED by 35% to 50% for CTAS 1 to 3 but leaves CTAS 4 and 5 unchanged. These figures may underestimate the benefits because they are based on limited autonomy that requires PAs to review 79% of their cases with a physician.
If PA autonomy were to be increased, reducing the number of cases requiring review with the attending physician, patients triaged to CTAS 1 to 3 would retain the 35% to 50% reduction in waiting times, and CTAS 4 and 5 patients also would benefit from shorter waiting times. If PAs were to manage and discharge patients without directly involving a physician for half of their caseload, CTAS 4 and 5 patients would benefit from waiting time reductions comparable to those in the extended physician coverage model (that is, 20% to 35% reductions). Although PAs have worked in American EDs with higher autonomy levels, pediatric ED-specific data have yet to be published. We chose to run the simulation with very conservative conditions compared with how PAs may function in well-established roles because PAs are still relatively new to the Canadian civilian healthcare system. We were guided by the results of our two previous surveys of pediatric ED physicians about the degree of direct physician involvement with cases managed by PAs.
Other studies have been undertaken to determine PAs' effect on patient flow within EDs. In 2009, investigators in Ontario used a pre-post design to determine that the odds of achieving wait time benchmarks was 1.9 (95% CI 1.6–2.4) for patients visiting the ED after PA implementation. A similar study in the United States found that the implementation of PAs in an urgent care unit reduced LOS for patients triaged to a low-acuity level from 127 to 53 minutes and improved patient satisfaction.34 Although these studies found improvements in patient flow after PA implementation, their usefulness is limited by short pre-post study periods, failures to address confounders including patient characteristics, and a lack of controls.
Despite using comprehensive observational data to build our computer simulation model, like any DES model, it cannot account for all of the factors that may affect the efficiency of care delivered in a pediatric ED. For example, whether patients who are seen by a PA have higher return rates than patients who are seen by a physician is an important consideration. However, this could not be observed directly and was not reflected in our model.
Another limitation of our model was the lack of assessment and review times for PAs. PAs were not practicing in our pediatric ED; thus, no real service time data were collected. A literature search revealed no publications of PA service times in pediatric EDs, and we had to rely on qualitative data from discussions with practicing PAs to estimate their service times. This method of estimation and assumption is often necessary in computer simulation model construction when introducing entities that have no observable data associated with them.35
The inability to comprehensively compare costs also limited study findings. Although we explicitly kept human resource costs equal, this model did not address other costs associated with care provided in the pediatric ED. These costs can vary by patient CTAS level, LOS, frequency of visits, and ancillary testing (laboratory and radiography) ordered by care providers. Indeed, a systematic review found only two studies comparing the overall cost of care delivered by PAs and physicians in general EDs; the studies yielded conflicting results.36
Comprehensive cost comparisons between PAs and emergency pediatricians would also require broader consideration of the differential costs involved in the education of a PA versus a pediatric ED subspecialist. Finally, the absolute generalizability of these findings is limited to pediatric EDs with similar system structures and service times as our pediatric ED.
Our simulations of a pediatric ED found important reduction in waiting time, LOS, and leaving without being seen rates for both scenarios. Further studies and data collection postimplementation are needed to provide definitive recommendations, but our study strongly suggests that using PAs reduces waiting time, LOS, and patients leaving without being seen, and could do so at a reduced cost.
2. Derlet RW, Richards JR. Overcrowding in the nation's emergency departments: complex causes and disturbing effects. Ann Emerg Med
3. Timm NL, Ho ML, Luria JW. Pediatric emergency department overcrowding and impact on patient flow outcomes. Acad Emerg Med
4. Kennebeck SS, Timm NL, Kurowski EM, et al. The association of emergency department crowding and time to antibiotics in febrile neonates. Acad Emerg Med
5. Shenoi R, Ma L, Syblik D, Yusuf S. Emergency department crowding and analgesic delay in pediatric sickle cell pain crises. Pediatr Emerg Care
6. Sills MR, Fairclough D, Ranade D, Kahn MG. Emergency department crowding is associated with decreased quality of care for children. Pediatr Emerg Care
7. Ospina MB, Bond K, Schull M, et al. Key indicators of overcrowding in Canadian emergency departments: a Delphi study. CJEM
8. Stang AS, McGillivray D, Bhatt M, et al. Markers of overcrowding in a pediatric emergency department. Acad Emerg Med
9. Goldman RD, Macpherson A, Schuh S, et al. Patients who leave the pediatric emergency department without being seen: a case-control study. CMAJ
10. Ng Y, Lewena S. Leaving the paediatric emergency department without being seen: understanding the patient and the risks. J Paediatr Child Health
11. Gaucher N, Bailey B, Gravel J. Who are the children leaving the emergency department without being seen by a physician. Acad Emerg Med
12. Gravel J, Gouin S, Carrière B, et al. Unfavourable outcome for children leaving the emergency department without being seen by a physician. CJEM
13. Ehrlich NJ, Tasmin F, Safi H, et al. Pilot study of ER utilization at Tulsa hospitals. J Okla State Med Assoc
14. Pileggi C, Raffaele G, Angelillo IF. Paediatric utilization of an emergency department in Italy. Eur J Public Health
15. Simon HK, Hirsh DA, Rogers AJ, et al. Pediatric emergency department overcrowding: electronic medical record for identification of frequent, lower acuity visitors. Can we effectively identify patients for enhanced resource utilization. J Emerg Med
16. Sinclair D. Emergency department overcrowding—implications for paediatric emergency medicine. Paediatr Child Health
17. Holley JE, Kellermann AL, Andrulis DP. Physician staffing in the emergency departments of public teaching hospitals: a national survey. Ann Emerg Med
18. Isaacman DJ, Davis HW. Pediatric emergency medicine: state of the art. Pediatrics
19. Casey MM, Wholey D, Moscovice IS. Rural emergency department staffing and participation in emergency certification and training programs. J Rural Health
20. Counselman FL, Graffeo CA, Hill JT. Patient satisfaction with physician assistants (PAs) in an ED fast track. Am J Emerg Med
21. Nyberg SM, Waswick W, Wynn T, Keuter K. Midlevel providers in a Level I trauma service: experience at Wesley Medical Center. J Trauma
22. Doan Q, Sabhaney V, Kissoon N, et al. The role of physician assistants in a pediatric emergency department: a center review and survey. Pediatr Emerg Care
23. Doan Q, Piteau S, Sheps S, et al. The role of physician assistants in pediatric emergency medicine: the physician's view. CJEM
24. Ducharme J, Alder RJ, Pelletier C, et al. The impact on patient flow after the integration of nurse practitioners and physician assistants in 6 Ontario emergency departments. CJEM
25. Gunal M, Pidd M. Discrete event simulation for performance modelling in health care: a review of the literature. J Simul
26. Hung GR, Whitehouse SR, O'Neill C, et al. Computer modeling of patient flow in a pediatric emergency department using discrete event simulation. Pediatr Emerg Care
27. Coats TJ, Michalis S. Mathematical modelling of patients flow through an accident and emergency department. Emerg Med J
29. White CR, Best JB, Sage CK. Simulation of emergency medical service scheduling. Hosp Top
31. Jun J, Jacobson S, Swisher J. Application of discrete-event simulation in health care clinics: a survey. J Oper Res Soc
32. Jacobson SH, Hall SN, Swisher JR. Discrete event simulation of health care systems. In: Hall R, ed. Patient Flow: Reducing Delay in Healthcare Delivery
. 2nd ed. New York, NY: Springer; 2013:273–310.
33. Arnopolin SL, Smithline HA. Patient care by physician assistants and by physicians in an emergency department. JAAPA
34. Rodi SW, Grau MV, Orsini CM. Evaluation of a fast track unit: alignment of resources and demand results in improved satisfaction and decreased length of stay for emergency department patients. Qual Manag Health Care
35. Fishman GS. Discrete-Event Simulation: Modeling, Programming, and Analysis
. New York, NY: Springer-Verlag; 2001.
36. Doan Q, Sabhaney V, Kissoon N, et al. A systematic review: the role and impact of the physician assistant in the emergency department. Emerg Med Australas
© 2014 American Academy of Physician Assistants.