Secondary Logo

Journal Logo

ORIGINAL ARTICLES

The Revised Index for Social Engagement in Long-Term Care Facilities: A Psychometric Study

Yoon, Ju Young1; Kim, Hongsoo2*

Author Information
Journal of Nursing Research: June 2017 - Volume 25 - Issue 3 - p 216-223
doi: 10.1097/JNR.0000000000000156
  • Free

Abstract

Introduction

Social engagement in long-term care (LTC) settings refers to being actively involved in meaningful activities or interactions with others in a social context (Gerritsen et al., 2008). Examples of activities to increase residents’ social engagement include involving residents in everyday activities (e.g., washing dishes, preparing meals, or doing laundry) and encouraging residents to formalized group activities. Studies have shown that those who are cognitively intact are more likely to participate in self-initiated activities, whereas those with less cognition are more likely to participate in staff or nursing-facility-organized activities (Zimmerman & Cohen, 2010). Studies have noted that intensive contact between residents and staff as well as the environmental stimuli in nursing homes (those stimuli related to real-world tasks and activities in particular) enhance the social engagement of residents significantly (Verbeek et al., 2014).

Social engagement has been consistently identified as an important factor that influences nursing home residents’ quality of life and psychological well-being. Engagement in appropriate activities has been shown to increase happiness, decrease boredom, and improve quality of life in nursing home residents (Schreiner, Yamamoto, & Shiotani, 2005). Furthermore, engagement has been linked to a decrease in agitated behaviors in nursing home residents with dementia (Cohen-Mansfield, Libin, & Marx, 2007). Higher levels of social engagement have a long-term, protective effect on mortality in long-stay nursing home residents (Kiely & Flacker, 2003), whereas low levels of social engagement contribute to negative health outcomes, including loss of physical function and worsening depressive symptoms (Lou, Chi, Kwan, & Leung, 2013; Mor et al., 1995).

The index of social engagement (ISE) was developed in 1995 to measure the social engagement of older adults in nursing homes. The six items of the ISE resident assessment instrument/minimum data set include (a) interacting with others, (b) doing planned or structured activities, (c) doing self-initiated activities, (d) establishing own goals, (e) pursuing involvement in life of facility, and (f) accepting invitations to most group activities (Mor et al., 1995). The ISE has been applied in many studies of social engagement in nursing homes because of its satisfactory reliability and convergent validity with the time involved in activities (Phillips et al., 1997; Schroll, Jónsson, Mor, Berg, & Sherwood, 1997). However, two items (doing self-initiated activities and establishing own goals) in the ISE exhibited lower factor loadings (0.174–0.587) in comparison with other items (0.760–0.908) in the one-factor model (Mor et al., 1995).

Gerritsen and colleagues in the Netherlands conducted a validation study to improve the ISE in 2008. After conducting a comprehensive literature review and expert panel survey on social engagement, two items that did not seem to have a social orientation and had low factor loadings in the original study (“doing self-initiated activities” and “establishing own goals”) were dropped, and two new items that reflected improved social involvement were added (“initiates interactions with others” and “reacts positively to interactions initiated by others”; Gerritsen et al., 2008). Thus, the revised ISE (RISE) was developed with items that better related to the concept of social engagement. Unlike the one-factor model in the original study (Mor et al., 1995), the RISE identified a two-factor model. Two newly added items were extracted into one separate factor related to the quality of social interaction, and the other three items were loaded onto group involvement (Gerritsen et al., 2008). Moreover, the RISE showed increased reliability for residents with cognitive impairment (Gerritsen et al., 2008). The additional items that are necessary to calculate the RISE were included in the newest version of interRAI Long-term Care Facilities (interRAI LTCF) and interRAI Assisted Living. The RISE, developed in 2008, has been used in many studies on social engagement involving nursing home residents (de Rooij et al., 2012; de Rooij, Luijkx, Declercq, & Schols, 2011; te Boekhorst, Depla, de Lange, Pot, & Eefsting, 2009).

There has, however, been a dearth of research on social engagement for nursing home residents in countries whose cultural context and LTC systems differ from those in North America and Europe, where the RISE tool has been widely utilized (Lukas et al., 2013a, 2013b; Onder et al., 2012). Although South Korea has one of the most rapidly aging populations in the world, it has a short history of formal LTC provision. Thus, few studies exist on the effect of social engagement on quality of life in older adult residents of nursing homes. The current literature for LTC in Korea has focused mostly on the clinical aspects of the quality of LTC (Lee, Cho, & Jang, 2009; Yoon & Lee, 2010). Comprehensive and systematic evaluation tools to assess the essential physical, psychological, and social needs of older persons to improve the quality of life of nursing home residents are needed (Bernabei, Venturiero, Tarsitani, & Gambassi, 2000).

The Korean version of the interRAI LTCF was recently developed using a rigorous translation and back-translation process to ensure linguistic and cultural equivalence (Kim, 2013). Stakeholders and practitioners strive to meet social needs that have been ignored in nursing home care facilities. The Korean version of the interRAI LTCF allows these parties to assess diverse aspects to improve the quality of life of nursing home residents. However, although core subscales of the interRAI LTCF such as activities of daily living (ADLs), instrumental ADL (IADL), and pain have shown good psychometric properties (Kim et al., 2015), the psychometric properties of the RISE have not yet been examined. To determine whether the RISE is applicable to measure nursing home residents’ social engagement in non-Western countries, this study was designed to examine the validity and reliability of the RISE tool in the Korean context.

Methods

Study Design

A cross-sectional design was used to test the psychometric properties of the RISE.

Participants

Three hundred fourteen nursing home residents were selected randomly from rosters provided by 10 nursing homes that were located in three provinces (Seoul, Incheon, and Gyeonggi) in Korea. To evaluate interrater reliability, two regular staff members who cared for the same residents in each facility were asked to assess 200 of the 314 residents. This study was approved by the institutional review board for human subject research at Seoul National University (127-2011-0106).

Instruments and Measures

interRAI long-term care facilities

interRAI LTCF is one arm of the instrument of the interRAI suite, which is an integrated family of 19 assessment instruments that were developed for a wide range of vulnerable populations across multiple settings (Hirdes et al., 2008). The interRAI LTCF is a specialized comprehensive geriatric assessment system for people who stay in LTC settings (Gray et al., 2009). The major domains of the interRAI LTCF address residents’ health and function status such as ADL, mood, problem behaviors, communication, and psychosocial well-being as well as the services provided to LTC residents (Mor, Finne-Soveri, Hirdes, & Gilgen, 2009; OECD/European Commission, 2013). In 2013, the interRAI LTCF assessment form and manual were translated into Korean, and the interrater reliability of the items was tested. More detailed information about this study is described elsewhere (Kim, 2013; Kim et al., 2015).

Social engagement

The six items on the interRAI LTCF of the RISE that related to social engagement were (a) interacting with others, (b) doing planned or structured activities, (c) accepting invitations to most group activities, (d) pursuing involvement in life of facility, (e) initiating interactions with others, and (f) reacting positively to interactions initiated by others. Each item was scored from 0 (not present), 1 (present but not exhibited in the last 3 days), 2 (exhibited 1–2 times in the last 3 days), to 3 (exhibited daily in the last 3 days). In calculating the RISE, scores of 0 and 1 were coded as “0” (not present in the last 3 days), and scores of 2 and 3 were coded as “1” (exhibited in the last 3 days). As with the English version of the RISE, the RISE score was calculated as the sum of six dichotomous items, ranging from a possible total of 0 to 6, with higher scores indicating greater social engagement in the facility (Gerritsen et al., 2008). In the existing study, the RISE showed good psychometric properties using Dutch and Canadian data, with a Cronbach’s alpha of .73 and interrater intraclass correlation coefficient (ICC) values for the scale from the two samples of .76 and .75, respectively (Gerritsen et al., 2008).

Average time involved in activities

The average time involved in activities was selected to examine the convergent validity of the RISE. The average time involved in activities is a one-item measurement of the interRAI LTCF to identify those periods of a typical day (over the last 3 days) when the person was awake all or most of the time during normal hours and not involved in ADL care or treatment. The item was coded as 0 (none), 1 (little to less than one third of the time), 2 (some up to one third to two thirds of the time), and 3 (most to more than two thirds of the time).

Cognitive function

Cognitive function was selected to examine the discriminant validity of the RISE (Cohen-Mansfield, Marx, Regier, & Dakheel-Ali, 2009). Cognitive function was measured using the cognitive performance scale (CPS). The CPS was derived from four items: two cognitive items (short-term memory and decision making), one communication item (ability to make oneself understood), and one ADL item (eating). On the basis of the algorithm that used these four items, CPS classifies nursing home residents into seven levels of cognitive function, ranging from 0 (intact) to 6 (very severe impairment). On the basis of this continuous CPS, residents were classified into either a cognitively intact group (0 ≤ CPS ≤ 2) or a cognitively impaired group (3 < CPS ≤ 6; Morris et al., 1994). The CPS has been widely used with good psychometric properties, including high criterion validity with the Mini Mental Status Examination and Global Deterioration Scale and high reliability in terms of interrater reliability and internal consistency (Shin & Scherer, 2009).

Demographic variables

Data on age, gender, marital status, length of stay, and chronic conditions were collected from the interRAI LTCF.

Data Analysis

Validity

We used confirmatory factor analysis (CFA) for the factor structure of the RISE. Before running the CFA, an exploratory factor analysis (EFA) was conducted because one item of the RISE (i.e., at ease interacting with others) was double-loaded on two factors in the RISE development study (Gerritsen et al., 2008). The robust weighted least squares estimate and Geomin rotation were applied in the EFA. Next, the CFA was conducted to confirm the factor structure of the original RISE. Model fit indices for factor analysis included the χ2 test, root mean square error of approximation ≤ 0.08, comparative fit index ≥ 0.95, and the Tucker–Lewis index ≥ 0.95 (Kline, 2010).

In addition, convergent and discriminant validity was investigated. Correlation analysis was used to examine the convergent validity of the RISE with the average time involved in activities. Correlation values ≥ .45 were considered substantial and high for convergent validity with a similar construct (DeVon et al., 2007). Given that the average time of activity involvement is a 4-point ordinal variable, the analysis of variance and Tukey post hoc test were additionally used to examine the convergent validity of the RISE with activity involvement. For discriminant validity, we used a t test to examine the difference in the RISE scores between the cognitively impaired resident group (0 ≤ CPS ≤ 2) and the cognitively intact resident group (3 ≤ CPS ≤ 6).

Reliability

The Cronbach’s alpha was computed to obtain the internal consistency levels for the whole scale and for each subscale. The cutoff point of the Cronbach’s alpha (>.70) shows excellent reliability (DeVon et al., 2007). The interrater reliability for each item was calculated using kappa statistics, and the interrater reliability of the RISE was calculated using an ICC with a two-way random model taking into account the continuous measurement. Following 1977), the extent of agreement using kappa values was evaluated as follows: slight = 0–.20, fair = .21–.40, moderate = .41–.60, substantial = .61–.80, and almost perfect = .81–1.0. An ICC of .40 or higher was considered to indicate adequate reliability, and an ICC of .70 or higher was considered to indicate excellent reliability (Fleiss, 1986).

Cognitive function was incorporated into the reliability analyses of the RISE, stratifying the sample population into two groups to assess reliability across cognitive functions. Factor analyses for the EFAs and CFAs were conducted using Mplus Version 7. The remaining analyses were conducted using SAS Version 9.4.

Results

Sample Statistics

Table 1 shows the demographic characteristics of the participants (n = 314). Most the 191 residents in the sample were over 80 years old (61%). The sample was primarily female (76%), and 25% had a spouse or partner. About half of the sample (53%) had resided in the facility for more than 1 year, and 63% had received medical treatment or management for dementia or stroke. The scores for all demographic variables were similar for the RISE, with the exception of marital status variable, which indicated that nursing home residents who did not have a spouse or partner had higher scores for social engagement than those who did.

Validity

Construct validity

A two-factor model was identified in the EFA with a good model fit, showing that each item was clearly loaded on one factor with a factor loading > 0.4. As Figure 1 indicates, the subsequent CFA confirmed the two-factor model (group involvement and interaction with others), with moderate model fits (comparative fit index/Tucker–Lewis index = 0.996/0.993, root mean square error of approximation = 0.112).

Figure 1.
Figure 1.:
Confirmatory factor analysis of the revised index of social engagement (N = 314). Model fit: χ2/df = 39.315/8 (p-value = .0000).
TABLE 1.
TABLE 1.:
Sample Characteristics and Their Relationship With RISE (N = 314)

Criterion-related validity

A positive and statistically significant correlation was found between the RISE score and the average time involved in activities (r = .58, p < .0001), indicating that the RISE had substantial levels of convergent validity. In addition, the means of the RISE increased as the time of activity involvement increased by the category in the analysis of variance (F = 54.49, p < .001). Furthermore, Tukey post hoc analysis indicated the presence of significant mean differences across the categories. These findings further support the convergent validity of the RISE with the time of activity involvement (Table 2). A significant difference (p < .0001) in mean scores of the RISE between the cognitively impaired resident group (0 ≤ CPS ≤ 2) and cognitively intact resident group (3 ≤ CPS ≤ 6) indicate fair discriminant validity, indicating that the RISE may differentiate between the social engagement of cognitively impaired older adults and cognitively intact older adults.

TABLE 2.
TABLE 2.:
Convergent Validity (N = 311)

Reliability

The Cronbach’s alpha values of all items for internal consistency of the RISE were .80 in the cognitively intact group and .86 in the cognitively impaired group, respectively. In addition, Cronbach’s alpha values for each factor were consistently greater than .70, regardless of the cognitive function. Table 3 shows satisfactory interrater reliability, indicating that the average kappa value for the six items was 0.83 for residents without cognitive impairment and 0.66 for residents with cognitive impairment. ICC values of the RISE scale were .94 for residents without cognitive impairment and .91 for residents with cognitive impairment.

TABLE 3.
TABLE 3.:
Interrater Reliability of RISE (N = 200)

Discussion

Social engagement is a critical component for improving quality of life in people who reside in nursing homes. However, an appropriate instrument with good psychometric properties has not been developed for use in Korean LTC settings. Previously, the RISE showed good validity and reliability with 189 residents in Dutch and Canadian nursing homes. This study, using a larger sample (n = 314), found the RISE to be a valid and reliable measure of social engagement in nursing homes in Korea, where the culture and LTC systems differ from those in Western countries.

The significant correlation between the RISE and the average time involved in activities indicates substantial convergent validity. The significant finding of the known-group comparison according to the cognitive impairment showed that the RISE provided discriminant validity to differentiate the social engagement by group based on cognitive function. The RISE tool clearly identified two factors: (a) the “group involvement” factor measures how residents responded to group activities in a facility, and (b) the “interaction with others” factor focuses on the quality of interpersonal interactions at the individual level. The CFA also showed high loadings for all six items on one factor with a moderate model fit. Particularly, the RISE development study showed that the first item, “at ease interacting with others,” did not clearly load onto one single factor (Gerritsen et al., 2008). However, in this study, this item loaded precisely on the factor “interaction with others,” whereas the remaining five items showed the same factor structure as the original study. Although Gerritsen et al.’s (2008) study did not discuss the possible reasons for the double-loaded item in the RISE, the item “at ease interacting with others” seems to be theoretically closer to the dimension of social interaction, which includes two other items: “initiates interactions with others” and “reacts positively to interactions initiated by others.” A larger study sample (n = 314 in this study vs. n = 189 in Gerritsen et al.) and lower measurement errors from assessors who were highly qualified registered nurses may help extract a clearer factor structure without double-loaded items. The results of the validity tests indicate that the RISE is a valid tool for measuring level of social engagement in nursing home residents.

The reliability, including the Cronbach’s alphas for all items and for the two subscale items, indicated satisfactory internal consistency regardless of cognitive function. The Cronbach’s alphas for all of the items in this study were either .80 (no cognitive impairment) or .86 (cognitive impairment), which were higher than those identified in the RISE development study of .67 (no cognitive impairment) and .70 (cognitive impairment; Gerritsen et al., 2008). In addition, the average kappa and ICC values for the Korean-version RISE showed adequate to excellent interrater reliability regardless of cognitive function. This may be because of the high qualifications (mostly trained, registered nurses), strong general knowledge of resident assessments, and strong familiarity with the resident conditions of assessors, as assessors in Dutch nursing homes are usually licensed practical nurses with relatively low skill levels and professional training (Gerritsen et al., 2008). In particular, the interrater reliability for the cognitively impaired residents exceeded the level of significance, indicating that the RISE is a reliable instrument for assessing the social engagement abilities of cognitively impaired residents (Fleiss, 1986; Landis & Koch, 1977).

The RISE incorporates the assumption that social engagement is a fundamental aspect of living in LTC settings. Because of an increasing awareness of the importance of having a homelike care environment, enhancing social relationships, and engaging in meaningful life activities, social engagement has been increasingly emphasized in LTC programs in Korea (Koren, 2010). The psychometrically sound Korean-version RISE will be instrumental in addressing social engagement issues in older adults in Korean nursing homes. Furthermore, this instrument may be useful for assessing older Koreans who live in nursing homes outside Korea and who speak Korean. Clinically, the routine use of the RISE at an individual level will help staff monitor the status of residents over time. Monitoring the RISE scores of residents as a group may help in the development of group intervention programs that are designed to enhance social engagement at the unit or facility level. Finally, as the RISE has been found to be a valid and reliable tool for use with cognitively impaired residents, further studies using the RISE on more vulnerable populations are warranted to prevent social isolation and diminishing activities and to promote interaction with others in the care facility setting.

This study has several limitations. First, predictive validity and test–retest reliability were not evaluated because of the cross-sectional nature of the study design. Second, the sample may not be representative of all nursing home residents in Korea, as nursing homes were randomly selected from the official lists of nursing homes in only three provinces. Future studies that include nursing homes from rural areas may enhance the generalizability of findings. Third, this study examined convergent and discriminant validity using conventional methods (correlation analysis and t test) only. A more rigorous validity testing method using a multitrait–multimethod is recommended for future work.

Conclusions

This study contributes to the scholarly literature on nursing homes by providing evidence related to the psychometric properties of a useful tool for measuring social engagement in older residents. Our findings suggest that the RISE offers satisfactory reliability and validity when used in LTC settings in the non-Western country of Korea. Our findings further supported two subdomains—group involvement and interaction with others—under the main domain of social engagement. Because of the paucity of studies in Korea on social engagement, further studies using RISE are necessary to explore the extent of social engagement for nursing home residents and the factors related to social engagement at the individual and organizational levels. Moreover, cross-national studies on social engagement should be conducted for comparative evaluations of LTC quality. Culturally adapted and innovative interventions to improve social engagement should be developed, which may help improve the quality of life for older people residing in nursing homes.

Acknowledgments

This research was supported by a National Research Foundation of Korea grant that was funded by the Korean Government (MSIP; Grant number 2010-0002802) and also by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute, funded by the Ministry of Health & Welfare, Republic of Korea (Grant number HI13C2250). The funding sources had no role in the study design, data collection and analysis, interpretation of the data, manuscript writing process, or the decision to submit the manuscript for publication. The content is solely the responsibility of the authors and does not necessarily represent the official views of the funding sources. The authors thank Young-Il Jung at Seoul National University for helping with data collection and management.

References

Bernabei R., Venturiero V., Tarsitani P., Gambassi G. (2000). The comprehensive geriatric assessment: When, where, how. Critical Reviews in Oncology/Hematology, 33(1), 45–56. doi:10.1016/S1040-8428(99)00048-7
Cohen-Mansfield J., Libin A., Marx M. S. (2007). Nonpharmacological treatment of agitation: A controlled trial of systematic individualized intervention. The Journals of Gerontology: Series A, Biological Sciences and Medical Sciences, 62(8), 908–916. doi:10.1093/gerona/62.8.908
Cohen-Mansfield J., Marx M. S., Regier N. G., Dakheel-Ali M. (2009). The impact of personal characteristics on engagement in nursing home residents with dementia. International Journal of Geriatric Psychiatry, 24(7), 755–763. doi:10.1002/gps.2192
de Rooij A. H., Luijkx K. G., Declercq A. G., Schols J. M. (2011). Quality of life of residents with dementia in long-term care settings in the Netherlands and Belgium: Design of a longitudinal comparative study in traditional nursing homes and small-scale living facilities. BMC Geriatrics, 11, 20. doi:10.1186/1471-2318-11-20
de Rooij A. H., Luijkx K. G., Schaafsma J., Declercq A. G., Emmerink P. M., Schols J. M. (2012). Quality of life of residents with dementia in traditional versus small-scale long-term care settings: A quasi-experimental study. International Journal of Nursing Studies, 49(8), 931–940. doi:10.1016/j.ijnurstu.2012.02.007
DeVon H. A., Block M. E., Moyle-Wright P., Ernst D. M., Hayden S. J., Lazzara D. J., Kostas-Polston E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39(2), 155–164. doi:10.1111/j.1547-5069.2007.00161.x
Fleiss J. (1986). The design and analysis of clinical experiment. New York, NY: John Wiley & Sons.
Gerritsen D. L., Steverink N., Frijters D. H., Hirdes J. P., Ooms M. E., Ribbe M. W. (2008). A revised Index for Social Engagement for long-term care. Journal of Gerontological Nursing, 34(4), 40–48. doi:10.3928/00989134-20080401-04
Gray L. C., Berg K., Fries B. E., Henrard J. C., Hirdes J. P., Steel K., Morris J. N. (2009). Sharing clinical information across care settings: The birth of an integrated assessment system. BMC Health Services Research, 9, 71. doi:10.1186/1472-6963-9-71
Hirdes J. P., Ljunggren G., Morris J. N., Frijters D. H., Finne Soveri H., Gray L., Gilgen R. (2008). Reliability of the interRAI suite of assessment instruments: A 12-country study of an integrated health information system. BMC Health Services Research, 8, 277. doi:10.1186/1472-6963-8-277
Kiely D. K., Flacker J. M. (2003). The protective effect of social engagement on 1-year mortality in a long-stay nursing home population. Journal of Clinical Epidemiology, 56(5), 472–478. doi:10.1016/S0895-4356(03)00030-1
Kim H. (2013). interRAI long-term care facilities LTCF assessment form and user’s manual: Version 9.1. Seoul National University Press. (Original work published in Korean)
Kim H., Jung Y. I., Sung M., Lee J. Y., Yoon J. Y., Yoon J. L. (2015). Reliability of the interRAI Long-term Care Facilities (LTCF) and interRAI Home Care (HC). Geriatrics & Gerontology International, 15(2), 220–228. doi:10.1111/ggi.12330
Kline R. B. (2010). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press.
Koren M. J. (2010). Person-centered care for nursing home residents: The culture-change movement. Health Affairs, 29(2), 312–317. doi:10.1377/hlthaff.2009.0966
Landis J. R., Koch G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. doi:10.2307/2529310
Lee T. W., Cho S. Y., Jang Y. K. (2009). Predictors of nursing service need for nursing homes residents. Journal of Korean Academy of Nursing, 39(1), 95–106. doi:10.4040/jkan.2009.39.1.95 (Original work published in Korean)
Lou V. W., Chi I., Kwan C. W., Leung A. Y. (2013). Trajectories of social engagement and depressive symptoms among long-term care facility residents in Hong Kong. Age and Ageing, 42(2), 215–222. doi:10.1093/ageing/afs159
Lukas A., Mayer B., Fialová D., Topinkova E., Gindin J., Onder G., Denkinger M. D. (2013a). Pain characteristics and pain control in European nursing homes: Cross-sectional and longitudinal results from the Services and Health for Elderly in Long TERm care (SHELTER) study. Journal of the American Medical Directors Association, 14(6), 421–428. doi:10.1016/j.jamda.2012.12.010
Lukas A., Mayer B., Fialová D., Topinkova E., Gindin J., Onder G., Denkinger M. D. (2013b). Treatment of pain in European nursing homes: Results from the Services and Health for Elderly in Long TERm Care (SHELTER) study. Journal of the American Medical Directors Association, 14(11), 821–831. doi:10.1016/j.jamda.2013.04.009
Mor V., Branco K., Fleishman J., Hawes C., Phillips C., Morris J., Fries B. (1995). The structure of social engagement among nursing home residents. The Journals of Gerontology: Series B, Psychological Sciences and Social Sciences, 50(1), P1–P8. doi:10.1093/geronb/50B.1.P1
Mor V., Finne-Soveri H., Hirdes J., Gilgen R. (2009). Long term care quality monitoring using the interRAI Common Clinical Assessment Language in performance measurement for health system improvement: Experience, challenges, and prospects (1st ed.). Cambridge, England: Cambridge University Press.
Morris J. N., Fries B. E., Mehr D. R., Hawes C., Phillips C., Mor V., Lipsitz L. A. (1994). MDS cognitive performance scale. Journal of Gerontology, 49(4), M174–M182. doi:10.1093/geronj/49.4.M174
OECD/European Commission. (2013). A good life in old age? Monitoring and improving quality in long-term care, OECD Health Policy Studies. Paris, France: OECD Publishing. doi:10.1787/9789264194564-8-en
Onder G., Carpenter I., Finne-Soveri H., Gindin J., Frijters D., Henrard J. C., … SHELTER Project. (2012). Assessment of nursing home residents in Europe: The Services and Health for Elderly in Long TERm care (SHELTER) study. BMC Health Services Research, 12, 5. doi:10.1186/1472-6963-12-5
Phillips C. D., Morris J. N., Hawes C., Fries B. E., Mor V., Nennstiel M., Iannacchione V. (1997). Association of the Resident Assessment Instrument (RAI) with changes in function, cognition, and psychosocial status. Journal of the American Geriatrics Society, 45(8), 986–993. doi:10.1111/j.1532-5415.1997.tb02971.x
Schreiner A. S., Yamamoto E., Shiotani H. (2005). Positive affect among nursing home residents with Alzheimer’s dementia: The effect of recreational activity. Aging & Mental Health, 9(2), 129–134. doi:10.1080/13607860412331336841
Schroll M., Jónsson P. V., Mor V., Berg K., Sherwood S. (1997). An international study of social engagement among nursing home residents. Age and Ageing, 26(Suppl. 2), 55–59. doi:10.1093/ageing/26.suppl_2.55
Shin J. H., Scherer Y. (2009). Advantages and disadvantages of using MDS data in nursing research. Journal of Gerontological Nursing, 35(1), 7–17. doi:10.3928/00989134-20090101-09
te Boekhorst S., Depla M. F., de Lange J., Pot A. M., Eefsting J. A. (2009). The effects of group living homes on older people with dementia: A comparison with traditional nursing home care. International Journal of Geriatric Psychiatry, 24(9), 970–978. doi:10.1002/gps.2205
Verbeek H., Zwakhalen S. M., van Rossum E., Ambergen T., Kempen G. I., Hamers J. P. (2014). Effects of small-scale, home-like facilities in dementia care on residents’ behavior, and use of physical restraints and psychotropic drugs: A quasi-experimental study. International Psychogeriatrics, 26(4), 657–668. doi:10.1017/S1041610213002512
Yoon J. Y., Lee J. Y. (2010). Development of outcome indicators of urinary incontinence for quality evaluation in long term care hospitals. Journal of Korean Academy of Nursing, 40(1), 110–118. doi:10.4040/jkan.2010.40.1.110 (Original work published in Korean)
Zimmerman S., Cohen L. W. (2010). Evidence behind The Green House and similar models of nursing home care. Aging Health, 6(6), 717–737. doi:10.2217/ahe.10.66
Keywords:

social engagement; long-term care; reliability; validity

Copyright © 2017 Taiwan Nurses Association