ADVANCES in modern medicine and subspecialization of clinical expertise have challenged the capabilities of services to absorb outpatient demand in a timely manner. Any obstacles for patients to access care cause disturbances throughout the health care organization impacting productivity, efficiency, health care costs, and the quality of care delivered (Huang & Verduzco, 2015). In addition, patients and families experience significant stress and anxiety during long waiting periods for specialty appointments (Harrington et al., 2014; Mulcahy et al., 2010).
The accessibility to outpatient care varies across institutions and specialty services with several contributing factors: these include the clinic's physical space, support staff, appointment policies, no-show rates, and demand uncertainty (Cayirli et al., 2006; Huang & Marcak, 2015). Various health care delivery models have been studied in the literature suggesting solutions to access challenges. Standardizing appointment slot lengths (Huang, 2016a), analyzing no-show rates with predictive overbooking (Creps & Lotfi, 2017; Huang & Hanauer, 2014,2016; Reid et al., 2015), reviewing scheduling methods including open access scheduling (Ansell et al., 2017; Cruz et al., 2018; Kopach et al., 2007; O'Connor et al., 2006; Stubbs et al., 2012), scheduling groups (Huang, 2016b), shared appointments (Edelman et al., 2015; Jhagroo et al., 2016), appointment slot times (Huang & Verduzco, 2015; Huang & Marcak, 2015; Qu et al., 2013), and appointment systems (Vissers, 1979), have all been evaluated. Most studies have utilized simulation or analytical modeling to predict access outcomes (Creps & Lotfi, 2017; Huang, 2016a,2016b; Huang & Hanauer, 2015,2016; Kopach et al., 2007; Qu et al., 2013; Reid et al., 2015; Vissers, 1979), with a paucity of case-specific reports. Our goal was to look at the impact of standardizing 4-hour sessions and optimizing appointment templates 3 days prior to a visit date for 3 high-demand pediatric subspecialty services at a large children's hospital.
A large children's hospital in Texas provided care to almost 4.3 million patients in fiscal year (FY) 2018, with more than 1 million patient encounters occurring in the outpatient setting. Patients travel from all 50 states and nearly 70 countries to obtain expert care from over 40 pediatric subspecialties. A task force was assembled when patient access was identified as the primary institutional focus for FY2018. After evaluating multiple suggestions for improvement opportunities from a multidisciplinary group of stakeholders, the leadership committee identified standardization of clinic sessions and template management as the initial interventions to improve access to care.
A “clinic session” was defined as a time block of 4 hours. All providers were required to adhere to this 4-hour template; however, the allocation of time for each visit type and the number of new patients per session varied based on provider preference. In addition, some template appointment slots were being “held” for very complex subspecialty patients. These slots, at times, went unfilled. With the endorsement of the task force, unoccupied “held” slots were “flipped” open for any patient within 72 hours of the clinic date. Outpatient clinical time or outpatient sessions per year were a by-product of total clinical effort minus procedural and inpatient responsibilities. Three high-demand medical specialties with associated long wait times were identified—service A, service B, and service C. In several instances, historical clinic session times for services A, B, and C were noted to be anywhere between 2.5 and 3 hours. Clinic session standardization and 72-hour flips were initiated for services A and B on March 1, 2018, with the go-live for service C on April 1, 2018.
New patient lag time was determined to be the gold standard metric to assess wait times and access. New patient lag time was defined as the consolidated amount of time between the appointment scheduling date and the date of service, as both of these data points were easily extractable from the scheduling data. No patient-specific information was evaluated. The following scheduling and operational metrics were retrieved and defined:
- Completed appointments—the number of scheduled clinic appointments completed
- No-shows—the number of occurrences in which a patient failed to present for his/her scheduled appointment without any advance notification
- Clinical full-time equivalent agents (cFTEs)—average portion of a provider's contracted time spent in clinical care based on a 40-hour work week
- Fill rate—the percentage of a provider's clinical capacity filled with arrived patients
- Template utilization—the percentage of a provider's clinic capacity filled with scheduled appointments based on available appointment slots
- Median lag time—the consolidated amount of time between the appointment scheduling date and the date of service
Additionally, the following values were calculated:
- Total potential appointments (completed appointments + no-shows)
- No-show rates (no-shows/total potential appointments)
- Completed appointments/cFTEs
Three different periods were evaluated—FY2017 (October 2016 through September 2017), early FY2018 (October 2017 to March 2018) annualized, and late FY2018 (April 2018 to September 2019) annualized. The data were annualized in 6-month blocks to identify and accentuate any changes in late FY2018 that may have resulted from the go-live of standardization of clinic sessions and the 72-hour flip template optimization.
Results of our study revealed variations in access outcomes and service productivity. Annualized potential and completed appointments increased after session length standardization and template optimization in the 2 intervals of FY2018 (Table). All 3 services realized a gain in annualized completed appointments (service A, 13%; service B, 5%; and service C, 6%) (Figure 1). Completed appointments per cFTE increased for service A (3%), with a decline in service B (−9%) and no discernible change in service C (−0.4%) (Figure 2). While lag times declined for service A from FY2017 through FY 2018 (9 days), lag times increased for services B (10 days) and C (16 days) (Figure 3).
Access Outcomes and Service Productivity
||Early FY2018 (October to March) Annualized
||Late FY2018 (April to September) Annualized
||Change Between FY2017 and Late FY2018
|Total potential appointments
|Median lag time, d
bbreviations: cFTEs, clinical full-time equivalent agents; FY, fiscal year; RVUs, relative value units.
Standardization has been employed throughout health care systems to improve performance metrics, efficiency, and quality of care (Adams et al., 2003; Ansari et al., 2018; Guzman et al., 2015; Huang, 2016a; O'Brien et al., 2018). After an institution-wide standardization of 4-hour clinic sessions and 72-hour flips, our study demonstrated the effects of these changes on patient access, more specifically, median lag times were inconsistent. Organizing and assessing the potential drivers of shortened lag times requires both an appreciation of the metrics, their benchmarks, as well as a full understanding of the scope of the clinical services of the specialty.
While all 3 services had an increase in their potential and completed annualized appointments in the periods examined, this increase was predominantly due to the hiring of new providers. Completed appointments per cFTE only increased slightly for service A, while services B and C were lower and flat. If the standardization of 4-hour sessions and 72-hour flips would have impacted access, there should have been a concomitant rise in appointments per cFTE as each cFTE's template utilization should have been positively affected, resulting in shorter lag times. Clearly, there are more levers to pull for improved access. On a microlevel, providers can customize visit types and attach them to time blocks to allow schedulers to fill sessions effectively. This is usually a scheduling strategy that providers prefer to customize themselves. A study by YL Huang evaluated mandated standardization of appointment-type slot length among 4 providers at a primary care clinic using simulation modeling (Huang, 2016a). The study demonstrated lower clinic productivity, service quality, and patient access to care, while increasing costs. It was concluded that appointment slots should be individualized by provider to improve service quality and patient access (Huang, 2016a). Once templates are built for each provider, all attempts must be made to accommodate new patient visits and minimize unavailable time slots that require “provider approval.” On a more macrolevel, high-demand services with prolonged wait times need to understand their true outpatient capacity—the supply of providers to meet ambulatory demand. An increase in a service's cFTE number does not necessarily correlate with an increase in outpatient clinical effort. The best example of this in our article is the increase in lag times for service C despite an increase in cFTEs. Most of the clinical time for this service went toward an elective admission program essential to the service line, not the clinic. Calculating a cFTE for outpatient work requires backing procedural and inpatient time out of a contracted total cFTE. Many times, the proposed annual sessions per outpatient cFTE remain poorly defined. This may be compounded by a disproportionate share of a provider's paid time off coming out of their outpatient commitment. High-demand services need to understand the importance of getting patients “in the door.” Achieving “timely” initial appointments requires redefining the importance of those providers who predominantly work in the outpatient setting. These providers are the foundation for successfully maintaining the balance between supply and, on many occasions, dramatic shifts in seasonal demand. There needs to be consideration in incentivizing providers to excel in the outpatient environment and removing them from the scrutiny of relative value unit (RVU) metrics many institutions utilize to assess productivity as most RVUs come from procedures and inpatient work. The use of nurse practitioners and physician assistants also becomes relevant when a service is trying to expand capacity to meet excessive demand (Klassen & Yoogalingam, 2019).
The simplest way to assess the potential strategy for a high-demand specialty to improve access is to understand the graphical depiction of Figure 4. Benchmarking the overall productivity of a service per cFTE is the first metric. While there is national benchmarking data for work RVUs per cFTE, a more accurate measure dictating outpatient productivity would be potential outpatient encounters per outpatient cFTE. While there are no national benchmarks for this, this may be an internal metric aligned to budget. Potential encounters would be preferred over actual encounters as to not penalize providers for an institutional no-show rate. The second metric is wait times, using lag times as a proxy. The targeted intersections of the x- and y-axis can also be an institutional decision. For example, the intersection of the y-axis, in Figure 4, may be the expected number of potential encounters per outpatient cFTE per year. The intersection of the x-axis may be a median targeted lag time, for example 14 to 30 calendar days. Square “A” is the ideal practice situation. Services are working efficiently with potential encounters per outpatient cFTE operating at levels above expectations combined with low lag times. In scenario “B,” providers are working with high efficiency; however, they are still not able to meet demand with patients experiencing long appointment wait times. This is a scenario where there is an obvious need for more providers. This is also a scenario where there is a high risk of provider burnout. In the final 2 scenarios in which provider potential encounter is lower than expectations, additional considerations are required. Scenario “C” is a situation where there may be an expected ramp-up of volume, there is a need for marketing, or there is an overabundance of providers. Scenario “D” is the most difficult situation to evaluate. In this scenario, there may be ambulatory infrastructure needs or electronic medical record optimization that would help improve provider activity. This is also a scenario where a deeper dive into template build and management could be helpful. Finally, based on inpatient and procedural obligations of the service, there may be a need for more dedicated outpatient providers, specifically nurse practitioners and physician assistants.
Several limitations exist in our single-institution study. As mentioned earlier, several access initiatives were implemented during the study period, and we are unable to determine which factor had a greater influence on access changes. Additionally, our study focused on only 3 medical specialty services with high demand and prolonged wait times. We did not report the impressive declines in wait times for the entire institution and its 40 different medical and surgical subspecialties. Our key outcome measure was lag time defined as the consolidated time between the appointment scheduling date and the date of service. A more accurate definition for lag time may have been the consolidated time from when the referral was received to the date of service, as typically there is a time gap between when the referral was received and when the appointment was made. We limited our study to the collection of independent and dependent variables that contribute to and define access to care. We did not measure any outcomes related to clinical quality or patient satisfaction. Our study focused on the acute changes seen from session standardization and template optimization. The session and template changes went into effect in FY2018, leading us to annualize the findings in each half of FY2018. This extrapolation of the data may not be the fairest depiction of potential access improvements, as these changes probably require a longer window of time to realize significance.
Patient access to care and long appointment wait times are major problems of outpatient health care delivery systems. Implementing clinic session standardization and template optimization has the potential for increasing aggregate potential and completed outpatient appointments for a high-demand service. This increase is not always coupled to shorter wait times. Services must focus on their true outpatient capacity and identify the outpatient providers who will serve as the pillars to meet excessive demand.
Adams W. G., Mann A. M., Bauchner H. (2003). Use of an electronic medical record improves the quality of urban pediatric primary care. Pediatrics, 111(3), 626–632.
Ansari S., Fung K., MacNeil S. D., Nichols A. C., Yoo J., Sowerby L. J. (2018). The use of standardized order sets to improve adherence to evidence-based postoperative management in major head and neck surgery. European Annals of Otorhinolaryngology, Head and Neck, 135(5S), S107–S111. doi:10.1016/j.anorl.2018.08.009
Ansell D., Crispo J. A. G., Simard B., Bjerre L. M. (2017). Interventions to reduce wait times for primary care appointments: A systematic review. BMC Health Services Research, 17(1), 295. doi:10.1186/s12913-017-2219-y
Cayirli T., Veral E., Rosen H. (2006). Designing appointment scheduling systems for ambulatory care services. BMC Health Services Research, 9(1), 47–58.
Creps J., Lotfi V. (2017). A dynamic approach for outpatient scheduling. Journal of Medical Economics, 20(8), 786–798. doi:10.1080/13696998.2017.1318755
Cruz H. E., Gawrys J., Thompson D., Mejia J., Rosul L., Lazar D. (2018). A multipronged initiative to improve productivity and patient access in a federally qualified health center network. The Journal of Ambulatory Care Management, 41(3), 225–237. doi:10.1097/jac.0000000000000230
Edelman D., Gierisch J. M., McDuffie J. R., Oddone E., Williams J. W. Jr. (2015). Shared medical appointments for patients with diabetes mellitus: A systematic review. Journal of General Internal Medicine, 30(1), 99–106. doi:10.1007/s11606-014-2978-7
Guzman M. J., Gitelis M. E., Linn J. G., Ujiki M. B., Waskerwitz M., Umanskiy K., Muldoon J. P. (2015). A model of cost reduction and standardization: Improved cost savings while maintaining the quality of care. Diseases of the Colon & Rectum, 58(11), 1104–1107. doi:10.1097/dcr.0000000000000463
Harrington D. W., Wilson K., Rosenberg M. W. (2014). Waiting for a specialist consultation for a new condition in Ontario: Impacts on patients' lives. Healthcare Policy, 9(4), 90–103.
Huang Y. L. (2016a). Appointment standardization evaluation in a primary care facility. International Journal of Health Care Quality Assurance, 29(6), 675–686. doi:10.1108/ijhcqa-01-2016-0004
Huang Y. L. (2016b). The development of patient scheduling groups for an effective appointment system. Applied Clinical Informatics, 7(1), 43–58. doi:10.4338/aci-2015-08-ra-0097
Huang Y. L., Hanauer D. A. (2016). Time dependent patient no-show predictive modelling development. International Journal of Health Care Quality Assurance, 29(4), 475–488. doi:10.1108/ijhcqa-06-2015-0077
Huang Y. L., Marcak J. (2015). Grid patient appointment template design to improve scheduling effectiveness. Journal of Healthcare Engineering, 6(2), 239–258.
Huang Y., Hanauer D. A. (2014). Patient no-show predictive model development using multiple data sources for an effective overbooking approach. Applied Clinical Informatics, 5(3), 836–860. doi:10.4338/aci-2014-04-ra-0026
Huang Y., Verduzco S. (2015). Appointment template redesign in a women's health clinic using clinical constraints to improve service quality and efficiency. Applied Clinical Informatics, 6(2), 271–287. doi:10.4338/aci-2014-10-ra-0094
Jhagroo R. A., Nakada S. Y., Penniston K. L. (2016). Patients attending shared medical appointments for metabolic stone prevention have decreased stone risk factors. Journal of Endourology, 30(11), 1262–1268. doi:10.1089/end.2016.0500
Klassen K. J., Yoogalingam R. (2019). Appointment scheduling in multi-stage outpatient clinics. Health Care Management Science, 22(2), 229–244. doi:10.1007/s10729-018-9434-x
Kopach R., DeLaurentis P. C., Lawley M., Muthuraman K., Ozsen L., Rardin R., Willis D. (2007). Effects of clinical characteristics on successful open access scheduling. Health Care Management Science, 10(2), 111–124.
Mulcahy C. M., Parry D. C., Glover T. D. (2010). The “patient patient”: The trauma of waiting and the power of resistance for people living with cancer. Qualitative Health Research, 20(8), 1062–1075. doi:10.1177/1049732310369139
O'Brien A., O'Reilly K., Dechen T., Demosthenes N., Kelly V., Mackinson L., Cocchi M. N. (2018). Redesigning rounds in the ICU: Standardizing key elements improves interdisciplinary communication. The Joint Commission Journal on Quality and Patient Safety, 44(10), 590–598. doi:10.1016/j.jcjq.2018.01.006
O'Connor M. E., Matthews B. S., Gao D. (2006). Effect of open access scheduling on missed appointments, immunizations, and continuity of care for infant well-child care visits. Archives of Pediatrics and Adolescent Medicine, 160(9), 889–893. doi:10.1001/archpedi.160.9.889
Qu X., Peng Y., Kong N., Shi J. (2013). A two-phase approach to scheduling multi-category outpatient appointments–a case study of a women's clinic. Health Care Management Science, 16(3), 197–216. doi:10.1007/s10729-013-9223-5
Reid M. W., Cohen S., Wang H., Kaung A., Patel A., Tashjian V., Spiegel B. M. (2015). Preventing patient absenteeism: Validation of a predictive overbooking model. The American Journal of Managed Care, 21(12), 902–910.
Stubbs N. D., Geraci S. A., Stephenson P. L., Jones D. B., Sanders S. (2012). Methods to reduce outpatient non-attendance. The American Journal of the Medical Sciences, 344(3), 211–219. doi:10.1097/MAJ.0b013e31824997c6
Vissers J. (1979). Selecting a suitable appointment system in an outpatient setting. Medical Care, 17(12), 1207–1220.