BRANSTETTER, M. LAURIE DNP, APRN, FNP-BC; SMITH, LYNETTE S. PhD, PMHNP-BC, FNP-BC; BROOKS, ANDREA F. MSN, APRN, FNP-BC
The use of electronic clinical tracking systems (ECTSs) in healthcare education has been cited for nearly three decades in advanced practice RN (APRN), medicine, physical therapy, and radiology technology literature.1–7 We have defined ECTS as “a technology system by which students’ clinical experiences are recorded for the purpose of reviewing and analyzing populations and healthcare management information.” Graduate nursing programs are moving toward the use of ECTSs to assist in documenting students’ clinical experiences. Intended goals of utilizing ECTSs in graduate clinical education of APRNs were to provide an accurate, searchable, reproducible, and efficient method of tracking students’ clinical documentations.7,8 Another benefit of ECTSs was to improve utilization of limited faculty resources,4,7 a critical component in meeting APRN practice core competency requirements.
Several factors have influenced the use of ECTSs in graduate nursing education. Information technology (IT) has become an integral part of healthcare education, safety, quality, and management in the US healthcare system. In 2001, the Institute of Medicine (IOM) addressed the need for the reinvention of healthcare with a focus on safety and quality.9 President George W. Bush echoed the need for safety and quality in healthcare by advocating for a national electronic health record (EHR) system.10 In 2009, the Technology Informatics Guiding Education Reform supported the prior EHR recommendations and addressed specific suggestions for IT areas of competency, literacy, and management in nursing education and practice.11 President Barack Obama continued to address healthcare concerns by advocating use of EHRs in providers’ practices to reduce healthcare costs and medical errors.12
In 2011, the IOM’s key message included the integration of IT into APRN education and practice. The National Organization of Nurse Practitioner Faculties (NONPF), in partnership with the American Association of Colleges of Nursing (AACN), has developed APRN core competencies for the national standardization of APRN practice.13 Technology and Information Literacy14(p3) is one of the NONPF core competencies, which can be addressed through the use of ECTSs. The purpose of this integrative review was to evaluate current research on APRN students’ documentation of clinical encounters utilizing ECTSs to meet APRN curriculum outcome goals in IT as defined by NONPF core competencies.
A comprehensive, computer-assisted search of the literature was conducted in the Cumulative Index of Nursing and Allied Health Literature (CINAHL), Academic Search Premier, Ovid MEDLINE, Web of Science, TopSCHOLAR, ProQuest, Virginia Henderson Global Nursing e-Repository, and Google Scholar electronic databases to identify current relevant research studies published from 1996 to 2013, in English, and limited to humans. In CINAHL, the keyword graduate nursing education resulted in 254 abstracts. The keyword graduate nursing education resulted in 381 abstracts from Academic Search Premier, 985 abstracts from Ovid MEDLINE, and 597 abstracts from Web of Science. The keyword electronic clinical tracking resulted in zero abstracts from CINAHL, Academic Search Premier, Ovid MEDLINE, and Web of Science. TopSCHOLAR, ProQuest, and Virginia Henderson Global Nursing e-Repository were queried using the keyword graduate nursing education, which resulted in 14 059, 320, and 66 abstracts, respectively. The keyword electronic clinical tracking resulted in no abstracts in TopSCHOLAR and Virginia Henderson Global Nursing e-Repository. In Google Scholar, the keyword graduate nursing education (n = 24 200) was combined with electronic clinical tracking (n = 17 500), resulting in 3200 abstracts. Abstracts of published studies were reviewed for relevance utilizing inclusion and exclusion criteria.
Studies included in this integrative review addressed the following criteria: electronic clinical tracking and graduate nursing education.
Studies that focused on electronic medical records, EHRs, telemedicine, handheld mobile learning devices, e-learning, distance education, e-books, clinical decision making tools, diagnostic screening, instrument testing, curriculum development, concept mapping, precepting, mentoring, and undergraduate education were excluded.
Abstracts were reviewed until it became evident that no additional studies were found that met inclusion criteria. This review of abstracts resulted in 10 peer-reviewed studies from the following electronic databases: CINAHL (n = 3), Academic Search Premier (n = 1), Ovid MEDLINE (n = 1), Web of Science (n = 2), and Google Scholar (n = 3). Ten studies were retrieved and further reviewed for inclusion and exclusion criteria. Four studies met initial inclusion criteria but were excluded from this integrative review as these studies did not meet the inclusion criteria of ECTSs and instead focused on electronic medical records and e-portfolios. Six of the 10 studies were found to meet this study’s inclusion criteria.8,15–19 A reference review in these six studies found two additional publications that met inclusion criteria.20,21 A total of eight studies were identified for inclusion in this integrative literature review (Table 1).
Using Melnyk and Fineout-Overholt’s criteria,22 the highest level of evidence in this integrative review was a Level VI: evidence from a single descriptive or qualitative study. No published integrative or systematic reviews were found for inclusion in this review. The following trends were identified in the studies reviewed.
Major Trends Identified
Review of the current state of the science revealed several major trends. Only one study overtly addressed NONPF core competencies as a data source for evaluation of APRN students’ competencies.16 The remainder of the studies provided trends in student and faculty attitudes, preferences, opinions, and descriptors of demographics in students’ clinical encounters. Potential applications of ECTSs in APRN education were expressed as broad statements alluding to national core competencies but not specifically stated as the basis for utilization. The study by Hallas et al16 is presented first, followed by the prevalence of major trends among the remaining studies.
The NONPF core competencies are the education standard utilized by APRN programs within the US and universities accredited by AACN.13 One study16 was identified as stating NONPF core competencies as a reference for APRN education requirements but did not specifically evaluate ECTSs’ capacity to meet these competencies. The focus of the study of Hallas et al16 was to evaluate the requirement of 500 clinical hours for APRN graduation and entry level into practice. The authors were unable to conclude that students were exposed to core competencies in their clinical experiences.16
Need for Improved Clinical Documentation
Seven of the eight studies8,15,17–21 reviewed explicitly stated a motivating factor for adoption of ECTSs. The motivating factor was to improve paper log documentation of students’ clinical experiences. Specific encounter variables, including demographic information, were collected in ECTS format. The format provided the ability to easily and objectively assess one student in an individual course or multiple courses across a program. Additionally, a cohort of students’ clinical data could be assessed. The variation in content and legibility of paper logs8,21 were cited as a secondary consideration along with storage problems associated with paper logs.8 In the study by Joy et al,8 the authors reported academic dishonesty as the most concerning issue in paper clinical logs and notes. Interpretation and quantification of free text within the ECTS remain a labor-intensive component but provide a rich description of students’ clinical encounters.19 Faculty and students cited Web-based ECTSs beneficial for ease of data entry into logs at clinical sites.15,18
Faculty members were able to review and adjust students’ clinical experiences based on encounters documented in ECTSs. Review of ECTSs was a process to provide feedback in order to improve students’ clinical encounters and widen their range of clinical experiences.19 The use of ECTSs was not felt to enhance communication between faculty and students.8 Cullen et al15 identified four advantages that enhanced informatics skills for both faculty and students. The advantages were that (1) data entry was facilitated by point-of-care access when using Web-based products, (2) enhanced informatics skills allowed knowledge management and a reduction in errors, (3) informatics-practice gap was decreased, and (4) charts and graphs were produced to trend experiences.15 All of these benefits were supported in the literature.8,18,19
Additional benefits were faculty reflections of an individual student over a single clinical course and/or an entire academic period by transforming a student’s data into reflective knowledge.15 Accurately documenting the work students performed, the acuity level of patients being evaluated, and the progress of students in clinical sites were positive for faculty, students, programs, and future employers.15,19,20 In addition, faculty were able to track a student’s experience in his/her clinical rotation according to patient complexity and student decision making.15
Faculty further reported using ECTSs for program and course evaluations as a benefit when they compared expected versus actual clinical experiences of APRN students.15 Electronic clinical tracking systems provided a means for observation of uncommon trends in students’ clinical experiences. Faculty’s use of ECTSs provided a method of evaluation of clinical site appropriateness for APRN students, allowing for early intervention and optimal students’ clinical placements aligned with their education goals.15,17,21 Electronic clinical tracking system data have provided opportunities for change in course progression, program progression, students’ clinical opportunities, and program curriculum.15,17,21
Several authors noted that ECTSs provided evidence for evaluating and revising curricula over previously utilized faculty intuition.15,17,20,21 Identification of top diagnoses codes15,20,21 allowed for faculty reflection of content presented in didactic courses. Faculty awareness of prescriptive practice patterns15,20 and patients’ social problems20 presented opportunities to prepare students for clinical encounters across the program. The electronic clinical tracking system was described as beneficial for tracking students’ prescribing patterns as reflections of APRN preceptors’ prescriptive activities, which is an area of limited data.15,20
Finally, faculty reported benefits of ECTS integration into their APRN programs. The studies described various commercial Web-based8,15–19 and in-house20,21 tracking systems. One essential ECTS component was the ability to customize a clinical tracking system to meet specific program needs.8,17 Next, authors reported the need for adequate accessible IT support for faculty and students.8,15,17–19 Walker19 noted that faculty require ongoing and comprehensive IT support. Another common feature of ECTS success in a program was that designated faculty served as IT resources to both students and faculty members.16–19
Students adapted to ECTSs more readily than did their faculty counterparts.8 Electronic clinical tracking system benefits to APRN students included progressive independence in patient encounters,15,19 achievements of increased clinical responsibilities,19 and development of clinical portfolios.15,19,20 First, faculty observed a sense of technology mastery among APRN students, especially with coding functions.15,20,21 Students reported improvements in their clinical autonomy with progressive increases in their levels of interaction in clinical settings.8,15
Next, APRN students’ evaluations of their professional roles were important to identify their clinical strengths and weaknesses. Through self-evaluations, APRN students become adult lifelong learners.23 Electronic clinical tracking systems permitted students’ self-evaluations to trend and stratify their clinical experiences.8,15,17 Advanced practice RN students’ early identification of course competency deficits provided opportunities to rectify discrepancies and evaluate learning.17 Furthermore, students reported reassurance when they compared their clinical practice experiences to their classmates.21 McNelis et al17 described midterm evaluations of ECTSs as a tool for students’ negotiations with their preceptors to gain further clinical experiences.
Lastly, ECTSs provided data sets useful in documentation of students’ clinical experiences for their portfolios. Electronic clinical tracking systems afforded a consistent framework for data collection and charting, which improved APRN students’ clinical logs and documentation.8,21 Advanced practice RN students utilized ECTSs in describing their clinical experiences, identifying diverse practice experiences, and providing descriptive clinical experiences to prospective employers.20,21
Meeting the Competency Standard
Significant learning occurred during APRN students’ clinical experiences.15 When faculty assessed students’ performances, they found that multiple evaluative methods were necessary to meet competency standards.8,15,17–20 An electronic clinical tracking system is one method for documenting these standards. In these studies, ECTS was utilized to document hours required by certifying bodies,15–17,21 hours required for competency attainment,8,21 and meeting program benchmarks.15,21
Four of the studies in this review utilized ECTSs in documenting their certifying body’s clinical hour requirements.15–17,21 Hallas et al16 studied the 500-hour APRN clinical practice requirement as the basis for determining core competency attainment utilizing ECTSs. The authors concluded that APRN clinical practice hours correlated with applicable clinical experiences, but they could not translate clinical hours to exposure to all core competencies.16 Electronic clinical tracking system use facilitated demonstration of students’ clinical hours in programs with multiple APRN specialties15,16,21 and a program transitioning from one certification specialty to another.17
There was no consensus on using ECTSs to document APRN clinical core competencies outside quantifying clinical hour requirements. In one small study,8 half of surveyed faculty (n = 3) reported that ECTSs assisted in confirming that students met core competencies, while two remaining faculty strongly disagreed. Longworth and Lesh21 decided that detailed clinical documentation was a means of identifying students’ competencies in an APRN program using electronic spreadsheets; however, the authors did not address meeting standardized competencies.
Lastly, the authors of two studies stated that ECTSs had the potential for benchmarking APRN programs among universities based on students’ clinical experiences.15,21 Cullen et al15 illustrated two ECTS benefits to meet specific program benchmarks. First, ECTSs documented areas of clinical health required within an APRN specialty. The second benefit identified was the ability to plot students’ and cohorts’ clinical experiences progression from simple to complex15 as a means of meeting core competencies. Longworth and Lesh21 concluded that sharing of collected data could be a positive influence on healthcare systems.
Bridging the Gap Between Education and Practice
Electronic clinical tracking systems allowed APRN students to obtain detailed portfolio data for marketing themselves to prospective employers.20,21 Students were able to provide potential employers with evidence of clinical experiences reflective of their new APRN role. The ability to objectively quantify the number and type of procedures performed during clinical experiences aided students in their APRN certification process as well as provided information for facilities credentialing processes.15
Students’ perceived mastery of coding was reported to be a vital skill in bridging the gap between APRN education and practice.15,20,21 McNelis et al17 concluded that APRN students using ECTSs were prepared to apply IT skills in self-evaluation and patient education. Both coding and use of electronic resources are valuable in APRN transition between education and practice.
Preparation of current and proficient APRNs to meet healthcare needs in the population foci served is the goal of every graduate education program in nursing. Graduate programs obtain this information from regular and ongoing conversations with corporate partners (clinical instructors, preceptors, and clinical agencies). Faculties produce program curricula to reflect current technology and changes within APRN practice. Electronic clinical tracking systems offer a bridge to the gap in education and practice with IT.
Research studies investigating ECTS utilization by APRN programs, although limited, have begun to raise awareness among faculty to the necessity of ECTS documentation in graduate programs. Faculty’s ability to demonstrate that APRN programs are meeting NONPF Technology and Information Literacy competencies, in part, is dependent upon utilization of ECTSs. Assessments of APRN students’ documentation of clinical encounters can be enhanced by ECTSs. These electronic systems have improved students’ clinical documentation, providing several benefits to faculty and students.
This integrative review has identified a gap in the literature. Although graduate programs have moved toward utilization of ECTSs to capture students’ clinical encounter data, the studies in this review did not evaluate APRN students’ documentation of clinical encounters utilizing ECTSs to meet APRN curriculum outcome goals in Technology and Information Literacy as defined by NONPF core competencies. Therefore, further studies addressing ECTS utilization to meet NONPF core competencies are needed.
Graduate programs need to show that students in APRN programs are able to meet NONPF core competencies. In this integrative review, research studies did not identify the ability of ECTSs to meet core competencies. Therefore, it appears that ECTSs are not being utilized to their fullest capacity. Future research is needed to evaluate the link between ECTSs and NONPF core competencies that address the areas of information competency and literacy. This linkage is important to bridge the gap between APRN education and practice. Bridging the gap between APRN education and practice benefits graduate programs, APRN students, and students’ potential employers.
One limitation of this integrative review included a small sample of eight research studies. The highest level of evidence in this integrative review was descriptive and qualitative studies. Another limitation of this integrative review was that the studies included four different ECTSs with varying degrees of functionality.
There are an increasing number of APRN programs utilizing ECTSs. Studies in this integrative review did not evaluate ECTSs to meet APRN core competencies. Therefore, more research is needed in this area to evaluate ECTS utilization to meet APRN core competencies of Technology and Information Literacy.
1. Baker AL, Dubose TJ. Electronic systems for student clinical records. J Diagn Med Sonogr. 2009; 25:(5): 277–281.
2. Hatfield AJ, Bangert MP. Implementation of the Clinical Encounters Tracking System at the Indiana University School of Medicine. Med Ref Serv Q. 2005; 24:(4): 41–58.
3. Kowlowitz V, Slatt LM, Kollisch DO, Strayhorn G. Monitoring students’ clinical experiences during a third-year family medicine clerkship. Acad Med. 1996; 71:(4): 387–389.
4. Oliveri R. Clinical recordkeeping using a personal computer. Part 1: preparation. Nurse Educ. 1984; 9:(1): 43–48.
5. Johnson JK, Michener JL. Tracking medical students’ clinical experiences with a computerized medical records system. Fam Med. 1994; 26:(7): 425–427.
6. Rowe BH, Ryan DT, Mulloy JV. Evaluation of a computer tracking program for resident-patient encounters. Can Fam Physician. 1995; 41: 2113–2120.
7. Kuehn AF, Hardin LE. Development of a computerized database for evaluation of nurse practitioner student clinical experiences in primary health care: report of three pilot studies. Comput Nurs. 1999; 17:(1): 16–26.
8. Joy L, Berner B, Tarrant D. Evaluating the implementation of an online clinical log system for family nurse practitioner students. Comput Inform Nurs. 2012; 30:(1): 1
9. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: The National Academies Press; 2001 .
13. US Department of Health and Human Services, Health Resources and Services Administration. Nurse Practitioner Primary Care Competencies in Specialty Areas: Adult, Family, Gerontological, Pediatric, and Women’s Health. 2002. http://www.aacn.nche.edu/education-resources/npcompetencies.pdf
. Accessed August 5, 2013.
15. Cullen D, Stiffler D, Settles J, Pesut DJ. A database for nurse practitioner clinical education. Comput Inform Nurs. 2010; 28:(1): 20–29;
16. Hallas D, Biesceker B, Brennan M, Newland JA, Haber J. Evaluation of the clinical hour requirement and attainment of core clinical competencies by nurse practitioner students. J Am Acad Nurse Pract. 2012; 24:(9): 544–553.
17. McNelis AM. Improving quality and safety in graduate education using an electronic student tracking system. Arch Psychiatr Nurs. 2012; 26:(5): 358
18. Olson BD, Fauchald SK. A transdisciplinary approach to developing a Web-based nursing experiential log system for advanced practice nursing clinical experiences. Comput Inform Nurs. 2011; 29:(11): 630–636.
19. Walker DS. Web-based data collection in midwifery clinical education. J Midwifery Womens Health. 2003; 48:(6): 437
20. Fontana SA, Kelber ST, Devine EC. A computerized system for tracking practice and prescriptive patterns of family nurse practitioner students. Clin Excellence Nurse Pract. 2001; 5:(2): 68–72.
21. Longworth JC, Lesh D. Development of a student nurse practitioner computerized clinical log. J Am Acad Nurse Pract. 2000; 12:(4): 117–122.
22. Melnyk BM, Fineout-Overholt E . Evidence-Based Practice in Nursing & Healthcare. Philadelphia, PA: Wolters Kluwer Health/Lippincott Williams & Wilkins; 2011 .
23. McMillan DE, Bell S, Benson EE, et al. Educational innovations. From anxiety to enthusiasm: facilitating graduate nursing students’ knowledge development in science and theory. J Nurs Educ. 2007; 46:(2): 88–91.