Secondary Logo

Journal Logo

Approaches for defining and assessing nursing informatics competencies

a scoping review protocol

Kleib, Manal1; Chauvette, Amelia1; Furlong, Karen E.2; Nagle, Lynn M.3; Slater, Linda4; McCloskey, Rose2

JBI Database of Systematic Reviews and Implementation Reports: June 2019 - Volume 17 - Issue 6 - p 1071–1078
doi: 10.11124/JBISRIR-2017-003889
SYSTEMATIC REVIEW PROTOCOLS
Free

Review question: How are nursing informatics competencies defined or assessed in the literature?

1Faculty of Nursing, University of Alberta, Edmonton, Alberta, Canada

2The University of New Brunswick (UNB) Saint John Collaboration for Evidence-Informed Healthcare: A Joanna Briggs Institute Affiliated Group, Saint John, New Brunswick, Canada

3Lawrence S. Bloomberg Faculty of Nursing, University of Toronto, Toronto, Ontario, Canada

4John W. Scott Health Sciences Library, University of Alberta, Edmonton, Alberta, Canada

Correspondence: Karen E. Furlong, Karen.Furlong@unb.ca

There is no conflict of interest in this project.

Back to Top | Article Outline

Introduction

Although information and communication technologies (ICTs), such as electronic health records and their applications, promise to improve care and patient outcomes,1-5 the full benefits of these tools cannot be realized if health professionals lack the necessary knowledge and skills needed for optimal and meaningful use of these technologies. Addressing workforce readiness in informatics has become a key priority for healthcare policy makers and educators worldwide. Informatics is viewed as one core competency of health professionals’ practice and is often essential for fulfilling other core competencies, including the ability to work in interdisciplinary teams, provide patient-centered care, employ evidence-based practice and apply quality improvement.1

In nursing, informatics refers to the “science and practice [that] integrates nursing, its information and knowledge, with management of information and communication technologies to promote the health of people, families, and communities worldwide”.6(para.4) Given the integral role of informatics in nursing practice, it is essential to identify nursing informatics (NI) competency requirements. These ongoing efforts have largely been informed by the seminal work of Staggers et al.7,8 in the United States who emphasized the need for advancing nurses’ competencies beyond computer literacy to include knowledge and attitudes needed to perform informatics-related activities. Subsequent research on defining NI competencies, primarily for entry-to-practice nurses, has emerged in other countries, such as Canada, Australia, Brazil, Taiwan and many more.9-13 While there are variations in what constitutes NI competency across countries, there are similarities in competency elements with Staggers et al.'s framework.7,8 For example, in Canada, the Canadian Association of Schools of Nursing9 has articulated three competency domains and provided a set of indicators under each domain: (i) the ability to utilize relevant information and knowledge to support the delivery of evidence-informed practice, such as performing searches and critical appraisal of online literature, and documenting nursing and patient data using standardized languages; (ii) the ability to use ICTs in accordance with professional and regulatory standards and workplace policies, such as maintaining patient safety and exercising clinical judgment in the presence of ICTs; and (iii) the ability to use ICTs in the delivery of patient/client care, such as using ICTs for point-of-care systems and electronic health records. In Australia, domains include computer literacy, information literacy and information management.10 Hence, it can be concluded that these aspects are defining features of NI competency.

As nurses’ utilization of informatics expand, more role-specific NI competencies, such as those for nurse practitioners, managers and leaders, have been proposed.14-17 Furthermore, researchers have developed structured measurement tools based on defined competency lists to enhance nurses’ readiness in informatics. These tools can be used to guide curricular integration or for practicing nurses to actively engage in self-assessment to inform continuing NI competency development requirements.18-22

Given that research on NI competency development and measurement has evolved, it is important to synthesize this literature to inform education, clinical practice, policy and future research. An initial search of the literature using PubMed, Cochrane Database of Systematic Reviews, CINAHL and JBI Database of Systematic Reviews and Implementation Reports to identify systematic or scoping reviews on defining and assessing NI competencies was conducted; however, limited literature was found. Located literature examined different aspects, including defining and assessing NI competencies, and the integration of NI in nursing education.

With regard to defining NI, in 2009, Carter-Templeton et al.23 searched the CINAHL and PubMed databases using the search terms “informatics competencies” and “nursing informatics competencies”, and identified 37 articles, only six of which met their inclusion criteria. The authors noted variations in the content, presentation and audience for these competencies, and emphasized the importance of developing a general list outlining the requirement for informatics knowledge, skills and attitudes to guide attainment and measurement of these competencies among nurses. Gonçalves et al.24 updated this review in 2012 applying the same approach, but found little empirical work; however, they reiterated how NI competencies research will continue to evolve worldwide in response to changes in healthcare environments, recommending more research in this area.

For reviews on integration in nursing education in the United States, for example, Gracie25 reviewed the literature available between 2007 and 2011 to determine baccalaureate nursing students’ exposure to computer technology and informatics knowledge prior to graduation. This review revealed inconsistencies in how NI is defined among academic settings, and also suggested inadequate preparedness in computer and informatics skills among students. Kleib et al.26 examined literature from 1990 to 2011 on the integration of NI in baccalaureate nursing education in Canada and identified variations in approaches for integration and in the content taught (i.e. primarily focusing on computer and information literacy, as opposed to comprehensively addressing all dimensions of NI competency, including the application of NI in clinical environments).

Concerning assessment of NI competencies, Hobbs27 conducted a review of published studies from 1988 to 2000 on computer knowledge, skills and attitudes of nurses and nursing students. This study reflects the focus of the literature at a time when proficiency in computers was a primary focus. As noted by Hart,28 this is not surprising because the informatics literature between 1999 and 2006 focused on assessment of attitudes and use of online resources, with a clear definition of computer and information competencies emerging in 2002. Findings from this work emphasized the need for job-specific competency development, evaluation tools for informatics competency components and the necessity for guidelines to inform the education and evaluation of these competencies in the clinical environment.

As research on defining and assessing NI competencies has evolved since these reviews were published, there is a need to examine the literature to understand development and progress in competency development and assessment. Scoping reviews are appropriate for this evolving field of research to understand the nature of emerging evidence, identify gaps in knowledge and provide direction for future research.29 Therefore, the aim of this scoping review is to map the literature on defining and assessing informatics competencies for nurses and nursing students. It is anticipated that this scoping review will serve as preliminary work to conducting a systematic review on this topic.

Back to Top | Article Outline

Inclusion criteria

To systematically examine the research question proposed for this review, we are defining inclusion and exclusion criteria to guide the process of selecting sources to be considered in this review. These criteria will be revisited as appropriate after we become familiar with the literature. This review will consider studies presenting approaches/methods for defining or assessing NI competencies. Included studies must conceptualize NI competency as a combination of several dimensions, including knowledge, skills and attitudes pertinent to informatics. Studies that only examine a dimension of competency, such as computer or information literacy, will be excluded.

Back to Top | Article Outline

Participants

The current scoping review will consider studies that include registered nurses in a variety of roles, such as nurses in direct patient care, nurse leaders, managers, administrators, executives, educators, telehealth nurses and nurses holding graduate or postgraduate education. In addition, nursing students within registered undergraduate and graduate programs are also included in this review. There will be no limitations regarding age, sex or ethnicity of participants. Licensed practical nurses, licensed vocational nurses and nursing assistants will be excluded from this scoping review. This decision is due to differences in informatics competency expectations for these categories of nursing care providers compared with registered nurses.

Back to Top | Article Outline

Concept

The concept being examined in this scoping review pertains to defining and assessing NI competencies. Although there is no internationally accepted definition for NI competencies, NI scholars have embraced the framework of knowledge, skills and attitudes in their conceptualization of informatics competency dimensions and indicators. This emphasizes that nurses’ informatics competency is no longer about proficiency in computer skills or technical skills that nurses engage in. Rather, it is a core requirement of nurses’ roles in all domains, including practice, education, research and administration.7,9 Such a comprehensive view serves to inform continuing education needs and curriculum development, with a goal that nurses have NI competencies needed by employers and consumers of health care.7

Back to Top | Article Outline

Context

Worldwide studies conducted in any health care or educational setting where registered nurses are practicing or nursing students are learning will be considered in this study.

Back to Top | Article Outline

Types of studies

The current review will consider the following studies for inclusion: quantitative studies with any experimental or quasi-experimental study design, including randomized controlled trials, non-randomized controlled trials, before and after studies and interrupted time-series studies; and observational designs, including prospective and retrospective cohort studies, case-control studies and cross-sectional studies. Qualitative studies including, but not limited to, phenomenology, grounded theory and ethnography designs, will also be considered. Descriptive reports, such as opinion pieces or editorials that discuss the importance of informatics for nurses will not be included in this review. Gray literature sources, such as conference proceedings, will be included in the review.

Back to Top | Article Outline

Methods

Joanna Briggs Institute (JBI) methodology will be used as a guide for this scoping review, as described in the JBI Reviewer's Manual.29

Back to Top | Article Outline

Search strategy

The search strategy will aim to find published and unpublished literature employing a three-step search strategy.29 An initial search limited to CINAHL and MEDLINE will be undertaken on this topic, followed by analysis of the text words contained in the title and abstract, and of the index terms used to describe the articles. Initial keywords will be nurses/nursing students, informatics and competency/assessment/literacy. We will start with the broader term “informatics,” as opposed to “nursing informatics,” because the latter term has recently been defined in the literature and may not capture all potential research available. The second search using all identified keywords and index terms will be undertaken across all included databases. Third, reference lists of identified reports and articles will be searched for additional studies not retrieved through the database search. No language, date or methodology limits will be applied to the database searches. A detailed search strategy is presented in Appendix I.

The following databases will be searched: Ovid MEDLINE, epub ahead of print, in-process and other non-indexed citations; Ovid MEDLINE Daily and Ovid MEDLINE <1946 to present>; Ovid Embase, 1974-current; Ovid PsycINFO, 1806-current; Ovid HaPI (Health and Psychosocial Instruments); CINAHL Plus with full-text, 1937-current; ProQuest ERIC, 1966-current; ProQuest Australian Education Index, 1977-current; ProQuest Education Database, 1988-current; ProQuest Dissertations and Theses Global, 1743-current; Scopus, 1960-current; Web of Science Core Collection, 1899-current; Cochrane Central Register of Controlled Trials; and OCLC PapersFirst, 1993-current.

The following sources will be searched for gray literature: ProQuest Dissertations & Theses Global, OCLC PapersFirst, MedNar and Google. In addition, the following organizations’ websites will be searched: the Canadian Nursing Informatics Association, the Ontario Nursing Informatics Group, the American Nursing Informatics Association and the Healthcare Information and Management Systems Society. Experts in the field of NI will be contacted to determine whether they are aware of any new or unpublished studies. In the event that the analysis of findings was not feasible within six months after the initial search was carried out, the literature search will be updated using the same search strategy to ensure that no recently published papers were missed in this review.

Back to Top | Article Outline

Study selection

Records identified through database searching will be uploaded into the Covidence software (Covidence, Melbourne, Australia) and duplicates removed. Two reviewers will independently screen titles and abstracts against the inclusion criteria to identify studies to be selected in this review.29 Full-text articles will be retrieved and assessed for eligibility, and reasons for excluding studies will be provided in an appendix in the final report. Disagreements that might arise between the reviewers will be resolved through discussion or with a third reviewer. Records identified through other sources, that is gray literature, will be screened applying the same approach, ensuring no duplication with database searches. Quality appraisal of included studies will not be performed in this review. The results of the search and study selection will be reported in the final scoping review report and presented in the recommended JBI-adapted flow diagram for scoping review.

Back to Top | Article Outline

Data extraction

The extracted data will be charted in a table to record the key information of the selected studies as indicated by the JBI methodology for scoping reviews.29 Data will be entered using an open access spreadsheet, Google Sheets, according to author and journal information (year and publication), aim, population (role of the nurse), concept (defining/assessment of NI competencies), context (country), definition of informatics or informatics competency if provided, categories/identified competency dimensions, assessment methods/approaches (e.g. instrument/tool, number of items), key findings and comments (Appendix II). The proposed data extraction elements may be revised and/or expanded during the review. These modifications will be detailed in the final scoping review report. Two reviewers will independently extract data from the full-text articles. Any disagreement will be noted and resolved by consensus. If disagreement cannot be resolved, a third review author will be consulted. Authors of papers will be contacted to request further information and clarification of the data where required.

Back to Top | Article Outline

Data synthesis

Findings will be synthesized in both narrative and tabular formats, as recommended by the JBI methodology for scoping reviews.29 Discussion of findings and recommendations for policy, research and practice will be provided.

Back to Top | Article Outline

Appendix I: Search strategy

Figure

Figure

Figure

Figure

Back to Top | Article Outline

Appendix II: Draft study details, characteristics and data extraction instrument

Figure

Figure

Back to Top | Article Outline

References

1. Greiner AC, Knebel E. Health professions education: a bridge to quality. Institute of Medicine (US) Committee on the Health Professions Education Summit [internet]. Washington, DC: National Academies Press; 2003.
2. Institute of Medicine. Committee on Quality of Health Care in America. Crossing the quality chasm: a new health system for the 21st century [internet]. Washington, DC: National Academies Press; 2001.
3. Romanow RJ. Building on values: the future of health care in Canada [internet]. Ottawa: Queen's Printer; 2002.
4. Page A. Keeping patients safe-transforming the work environment of nurses. Institute of Medicine (US) Committee on the Work Environment for Nurses and Patient Safety Board on Health Care Services [internet]. Washington, DC: National Academies Press; 2004.
5. Bakken S. An informatics infrastructure is essential for evidence-based practice. J Am Med Inform Assoc 2001; 8 3:199–201.
6. International Medical Informatics Association. The nursing informatics special interest group-definition [internet]. Geneva: WordPress; 2009.
7. Staggers N, Gassert CA, Curran C. Informatics competencies for nurses at four levels of practice. J Nurs Educ 2001; 40 7:303–316.
8. Staggers N, Gassert CA, Curran C. A Delphi study to determine informatics competencies for nurses at four levels of practice. Nurs Res 2002; 51 6:383–390.
9. Canadian Association of Schools of Nursing. Nursing informatics entry-to-practice competencies for registered nurses [internet]. Ottawa, ON: Canadian Association of Schools of Nursing; 2012.
10. Australian Nursing and Midwifery Federation, Federal Office. ANMF national informatics standards for nurses and midwives [internet]. Melbourne: ANMF Federal Office; 2015.
11. Honey ML, Skiba DJ, Procter P, Foster J, Kouri P, Nagle LM. Nursing informatics competencies for entry to practice: the perspective of six countries. Stud Health Technol Inform 2017; 232:51–61.
12. Goncalves LS. Informatics competencies required to nurses in the Brazilian professional practice. 2014; Curitiba: Universidade Federal do Paraná, [Unpublished dissertation].
13. Chang J, Poynton MR, Gassert CA, Staggers N. Nursing informatics competencies required of nurses in Taiwan. Int J Med Inform 2011; 80 5:332–340.
14. Curran CR. Informatics competencies for nurse practitioners. AACN Clin Issues 2003; 14 3:320–330.
15. Hart MD. A Delphi study to determine baseline informatics competencies for nurse managers. Comput Inform Nurs 2010; 28 6:364–370.
16. Collins S, Yen P, Phillips A, Kennedy MK. Nursing informatics competency assessment for the nurse leader: the Delphi Study. J Nurs Adm 2017; 47 4:212–218.
17. Collins S. Nursing informatics competencies: psychometric validation, dissemination, and maintenance of self-assessment tool for nurse leaders. Stud Health Technol Inform 2016; 225:710–712.
18. Choi J, Bakken S. Validation of the self-assessment of nursing informatics competencies scale among undergraduate and graduate nursing students. J Nurs Educ 2013; 52 5:275–282.
19. Hunter K, McGonigle D, Hebda TL. TIGER-based measurement of nursing informatics competencies: the development and implementation of an online tool for self-assessment. J Nurs Educ Pract 2013; 3 12:70–80.
20. Yoon S, Yen P, Bakken S. Psychometric properties of the self-assessment of nursing informatics competencies scale. Stud Health Technol Inform 2009; 146:546–550.
21. Kleib M, Nagle L. Development of the Canadian nurse informatics competency assessment scale and evaluation of Alberta's registered nurses’ self-perceived informatics competencies. Comput Inform Nurs 2018; 36 7:350–358.
22. Kleib M, Nagle L. Psychometric properties of the Canadian nurse informatics competency assessment scale. Comput Inform Nurs 2018; 36 7:359–365.
23. Carter-Templeton H, Patterson R, Russell C. An analysis of published nursing informatics competencies. Stud Health Technol Inform 2009; 146:540–545.
24. Gonçalves LS, Wolff LDG, Staggers N, Peres AM. Nursing informatics competencies: an analysis of the latest research [Internet]. In NI 2012: 11th International Congress on Nursing Informatics, June 23-27, 2012, Montreal, Canada. [internet]. 2012 [cited 14 January 2018]. American Medical Informatics Association. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3799152/
25. Gracie D. Nursing informatics competencies and baccalaureate nursing students. ANIA-CARING Newsl 2011; 26 2:7–10.
26. Kleib M, Zimka O, Olson K. Status of informatics integration in baccalaureate nursing education: a systematic review. Can J Nurs Res 2013; 45 1:138–154.
27. Hobbs S. Measuring nurses’ computer competency: an analysis of published instruments. Comput Inform Nurs 2002; 20 2:63–73.
28. Hart MD. Informatics competency and development within the US nursing population workforce: a systematic literature review. Comput Inform Nurs 2008; 26 6:320–329.
29. Peters MDJ, Godfrey C, McInerney P, Baldini Soares C, Kahlil H, Parker D. Aromataris E, Munn Z. Chapter 11: Scoping reviews. Joanna Briggs Institute, Joanna Briggs Institute Reviewer's Manual [internet]. Adelaide: 2017.
Keywords:

Assessment; defining; informatics competencies; nursing

© 2019 by Lippincott williams & Wilkins, Inc.