Evaluation of brief screening tools for neurocognitive impairment in HIV/AIDS: a systematic review of the literature
Zipursky, Amy R.a,b; Gogolishvili, Davida; Rueda, Sergioa,b; Brunetta, Jasonc; Carvalhal, Adrianab,d; McCombe, Jennifer A.e; Gill, M. Johne; Rachlis, Anitab,f; Rosenes, Rona; Arbess, Gordonb,d; Marcotte, Thomasg; Rourke, Sean B.a,b,d
aOntario HIV Treatment Network
bUniversity of Toronto
cMaple Leaf Clinic, Toronto, Ontario
dSt. Michael's Hospital, Toronto, Ontario
eSouthern Alberta HIV Clinic and University of Alberta, Edmonton, Alberta
fSunnybrook Hospital, Toronto, Ontario, Canada
gUniversity of California, San Diego, La Jolla, California, USA.
Correspondence to Dr Sean B. Rourke, Centre for Research on Inner City Health, Li Ka Shing Knowledge Institute of St. Michael's Hospital, 30 Bond Street, Toronto, ON M5B 1W8, Canada. Tel: +1 416 864 6060 ext 6482; fax: +1 416 864 5135; e-mail: Sean.firstname.lastname@example.org
Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal's Website ( http://www.AIDSonline.com).
Received April 05, 2013
Revision received May 29, 2013
Accepted May 29, 2013
To systematically review literature on brief screening tools used to detect and differentiate between normal cognition and neurocognitive impairment and HIV-associated neurocognitive disorders (HANDs) in adult populations of persons with HIV.
A formal systematic review.
We searched six electronic databases in 2011 and contacted experts to identify relevant studies published through May 2012. We selected empirical studies that focused on evaluating brief screening tools (<20 min) for neurocognitive impairment in persons with HIV. Two reviewers independently reviewed retrieved literature for potential relevance and methodological quality. Meta-analyses were completed on screening tools that had sufficient data.
Fifty-one studies met inclusion criteria; we focused on 31 studies that compared brief screening tools with reference tests. Within these 31 studies, 39 tools were evaluated and 67% used a comprehensive neuropsychological battery as a reference. The majority of these studies evaluated HIV-associated dementia (HAD). Meta-analyses demonstrated that the HIV Dementia Scale (HDS) has poor pooled sensitivity (0.48) and the International HIV Dementia Scale (IHDS) has moderate pooled sensitivity (0.62) in detecting a range of cognitive impairment. Five newer screening tools had relatively good sensitivities (>0.70); however, none of the tools differentiated HAND conditions well enough to suggest broader use. There were significant methodological shortcomings noted in most studies.
HDS and IHDS perform well to screen for HAD but poorly for milder HAND conditions. Further investigation, with improved methodology, is required to understand the utility of newer screening tools for HAND; further tools may need to be developed for milder HAND conditions.
Since the introduction of combination antiretroviral therapy (cART), the incidence of severe forms of HIV-associated neurocognitive impairment has declined significantly, whereas the prevalence of the milder forms has increased [1,2]. The nomenclature originally developed by the American Academy of Neurology Task Force on AIDS in 1991 was recently updated in 2007 in response to the change in presentation and research available on the natural history of HIV-associated neurocognitive complications . There are now three different HIV-associated neurocognitive disorder (HAND) conditions. In order of increasing severity and related impact on everyday functioning, these are first, asymptomatic neurocognitive disorder (ANI) with a prevalence of 30–35% and characterized by at least mild neurocognitive impairment in two domains (at least 1.0 SD below the mean for age-education-appropriate norms) but with no evidence of difficulty with day-to-day functioning; second, mild neurocognitive disorder (MND) with a prevalence of 20–25% and characterized by at least mild neurocognitive impairment in two domains (at least 1.0 SD below the mean for age–education appropriate norms) and with mild interference with day-to-day functioning; and third, HIV-associated dementia (HAD) with a prevalence of 2–3% with generally moderate to severe impairments in neurocognitive functioning in multiple domains (2 SD or greater than demographically corrected means) and marked difficulties with everyday functioning . Overall, the prevalence of HAND based on the new criteria is approximately 50–60% [1,4].
In the early years of the HIV epidemic, 20–30% of patients presented with severe cognitive impairment that was later classified as HIV-1-associated dementia complex . The HIV Dementia Scale (HDS) was developed to screen for HAD  and later the International HDS (IHDS)  was developed for use in global settings. These instruments have had varying degrees of success in screening of those with the milder forms of HAND (i.e. ANI and MND). The clinical significance of identifying the milder forms of HAND is important, as they can have a significant impact on the lives of people living with HIV. They have been shown to interfere with medication adherence [8,9], workplace performance , driving  and ability to carry out tasks independently [12,13]. The consequences of these effects have been seen in decreased health-related quality of life  and increased mortality rates [2,15] in people with HAND.
To better assist in prevention, treatment and management of HAND, it is important that screening tools be developed and evaluated. Before widespread use for clinical treatment decision-making, these tools need to be shown to have adequate sensitivity and specificity with HAND; they need to be brief enough to be used in the clinic or health centre, and able to be administered by a trained individual with minimal equipment.
To determine which screening tools for HAND meet these criteria, we have undertaken the first systematic review of the literature with respect to the screening tools for HAND. Our objective is to systematically review the literature on brief screening tools that can detect neurocognitive impairment and are able to differentiate among the various forms of HAND in the adolescent and adult population of persons living with HIV and AIDS.
Materials and methods
We conducted literature searches in MEDLINE, EMBASE, PsycINFO, LILACS and CINAHL in May 2011 for published, full-length research articles. An experienced librarian in systematic review methods assisted us in developing a search strategy (included in Appendix A, http://links.lww.com/QAD/A370). We did not apply date or language restrictions in the search strategy because we did not want to limit the investigation to tools administered only in English. We also contacted key experts in the field for recommendations and received articles for potential inclusion until the start of May 2012.
Only studies reporting on participants who were adolescent or adult age were included (generally age >16 years). To be included in the review, individual studies needed to include participants who were HIV-positive and with some form of documented HIV-associated neurocognitive impairment, or be characterized/diagnosed with having any HAND [i.e. ANI, MND, minor cognitive motor disorder (MCMD), or HAD] [3,5]. The studies evaluated neurocognitive impairment in different ways, and this is a limitation of the current state of the literature.
We considered studies that focused on screening for ‘neurocognitive’ or ‘neuropsychological’ impairments or HAND [3,5]. The ways in which studies addressed screening tools included evaluating the utility of a specific screening tool, comparing different screening tools and validating screening tools. The focus of the review was then restricted to include only those articles that evaluated the utility of screening tool(s) against a separate reference or criterion. We defined screening tools to include pen and paper tests, algorithms and computerized tests and excluded biological tests (i.e. studies looking at biomarkers). In addition, we focused on ‘brief’ screening tools, and we defined this as those that took approximately 20 min or less to perform. This was done because the focus was screening tests that might be potentially useful in a clinic or healthcare setting to detect HAND.
All studies needed to report findings from empirical research. We included primary studies and considered both cross-sectional and longitudinal investigations. We excluded primary studies that used qualitative methods or case study methods. We also considered systematic review articles.
Search and data extraction
Two reviewers independently assessed the titles and abstracts of the citations from the search according to the selection criteria. For the citations that met the criteria, data from full texts were extracted by one reviewer and checked independently for accuracy by a second reviewer. We contacted study authors to obtain any information that was missing. Any disagreements between reviewers on data extracted were resolved by consensus or by a third reviewer.
Two reviewers independently appraised the quality of the selected articles from the search using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool . This 14-item tool was specifically designed to assess the quality of primary studies addressing diagnostic accuracy. Disagreements between the reviewers on the different QUADAS items were resolved by consensus.
There were 2030 citations in the database searches and 334 of these were duplicates between databases. The review of titles and abstracts resulted in the identification of 316 articles for full assessment, with 1380 articles being excluded because they did not meet our inclusion criteria. We completed a full appraisal of 304 articles (we were unable to locate 12 full articles despite contacting the authors), and at this stage found that 253 of the 304 did not meet inclusion criteria resulting in 51 studies for inclusion. Articles that did not meet inclusion criteria were for the following reasons: six did not focus on people living with HIV; 185 did not evaluate screening tools; 28 did not include screening tools that are brief; eight did not report on empirical studies; and 26 articles did not include participants with HAND or impairment. [See Fig. 1 for Search strategy].
Of the 51 studies that met criteria [6,7,17–65], we identified two main categories into which these studies could be divided: first, studies that evaluated screening tools by comparing them with a reference standard or criterion (n = 31 of 51 or 61% of studies evaluated) [6,7,17–44,64], and second, studies that evaluated screening tools by other methods (n = 20 of 51 or 39% of studies) [45–63,65]. For the purposes of the current article, we decided to focus our systematic review analyses on the first category of studies (n = 31), [see Table 1 for Characteristics of studies on brief screening tools for HIV-associated neurocognitive disorders] as this is the most accepted method of evaluating a diagnostic tool (Results from the second category of studies can be found in Appendix B).
Study characteristics (N = 31 studies)
Thirty-one studies are the focus of this subsequent analysis. Thirty of the 31 used a cross-sectional design [6,7,17–36,38–44,64] and one used a longitudinal design . Eighteen of these studies (60% of all studies examined) were conducted in the USA [6,7,17–19,22,23,26,27,31,33–38,42,44]; three in Australia [20,21,32]; three in South Africa [24,28,41]; one each in the UK ; Germany ; Belgium and the Netherlands ; Switzerland ; Uganda ; Kenya ; India ; and one at sites across the world . The participants in all of the studies combined totalled a sample of 5837 participants, and the individual study samples ranged from 20  to 1549  participants. Twenty-five studies used convenience sampling [6,7,17–19,22,24,25,27–33,35–41,43,44,64], and two used random sampling [20,34].
Neurocognitive screening tool evaluations
Types of screening tools evaluated
Within these 31 studies, 39 screening tool evaluations were conducted with 21 unique screening tools. Eleven studies evaluated the HDS (35%) [6,18,19,24,31,34,38,40,42–44]; four the IHDS (13%) [7,28,41,64]; three the CogState Computerized Battery (10%) [20,32,35]; three the Mini-Mental State Examination (MMSE) (10%) [6,31,64]; and other tools were evaluated in the remaining 16 studies [6,17,19,21–23,25–27,29,30,33,36,37,39,64]. Twenty-one (68%) [6,7,17–23,26,27,30,32,33,35–39,41,42] studies reported evaluating screening tools in English and eight (26% of studies overall) [7,24,28–30,41,43,44] in another language.
Presence and severity of neurocognitive impairment assessed
Of the 31 studies, 11 (35%) focused on detecting HAD [6,7,18,22,28,30,31,34,40,44,64], four also screened for MND [28,30,40,64] or MCMD [18,22,34,44], and five screened for ANI [28,30,34,40,64]. Seventeen studies (55%) focused on detecting neurocognitive impairments and/or deficits [17,18,20–23,25–27,29,33,35,36,38,41,42,66]. Eight studies (26%) [6,7,18,19,22,31,34,44] used 1991 criteria  and five studies (16%) [21,28,30,40,64] used the revised 2007 criteria  for diagnosing HAND. It is important to note that many of the studies were published prior to the establishment of the 2007 HAND criteria.
Assessment of functional status
Functional status was measured objectively in nine studies (29%) [20–22,30,34,38,39,44,64] (29%) and subjectively in seven studies (23%) [23,26,28,29,37,40,42]. It is worth noting that functional status was assessed differently across studies, and only three of the studies that objectively assessed functional status [20,29,63] used the recent 2007 Frascati criteria to classify participants.
Length of time of reference test/criterion
We were interested in determining whether the quality and rigour of the criterion or reference test used was related to the outcome of the screening tests. We examined and coded the length and comprehensiveness of the neuropsychological test battery into ‘short’, ‘medium’ and ‘long and comprehensive’ battery (See Table 2 for ‘short’, ‘medium’ and ‘long’ battery criteria). Nine studies (29%) used a ‘short’ [6,23–25,27,33,37,41,43], 11 (35%) used a ‘medium’ [7,22,28–30,32,35,38,40,42,44] and seven (23%) used a ‘long’ [17–21,26,36] battery. For the HDS and IHDS, there were sufficient data to evaluate the associations between sensitivity and specificity and battery size. There was a significant association for the HDS between sensitivity and size of battery (P < 0.05), with sensitivity decreasing with increasing battery size. There was a trend for increasing specificity with increasing battery size, but this association was not significant.
Type of reference test / criterion and sensitivity performance
Twenty-six of the 39 tool evaluations (67%) used a detailed neuropsychological battery as the reference standard [18–22,26,28–30,32,35,36,38,40–44,64]. Fifteen tool evaluations (38%) reported adequate sensitivities (≥0.75). Adequate sensitivities (≥0.75) were reported for the HDS [6,24,31,40,44], IHDS [7,41], CogState , Grooved Pegboard , Hopkins Verbal Learning Test-Revised/Grooved Pegboard Test Non-Dominant Hand , Hopkins Verbal Learning Test/WAIS-III Digit Symbol , Mental Alternation Test , Motor Battery , the Screening Algorithm  and the Timed Gait Test .
The HDS and IHDS have been sufficiently studied to perform a meta-analysis for each tool. For inclusion in the meta-analysis, the articles we reviewed were required to use a neuropsychological battery as the reference test; use the neuropsychological battery to classify the participants as ‘impaired’; and report the incidence of impairment, sensitivity and specificity of the tools. Seven studies on the HDS [6,19,34,38,40,42,44] and three studies on the IHDS met these criteria [7,28,41]. One study on the IHDS looked at this tool in two different participant pools , and as such, the results from each of the participant pools were included in the meta-analysis.
Meta-analysis and qualitative results with the HIV Dementia Scale
The Forest Plot of the meta-analysis of the HDS (Fig. 2a) shows a large range in the sensitivities for the HDS across studies; four studies [19,34,38,42] reported poor sensitivity (i.e. ≤0.55) and three studies [6,40,44] reported good sensitivity (i.e. >0.80). Overall, the pooled sensitivity of these studies (i.e. 0.48) would suggest that the HDS (without any corrections for demographics) is not useful for detecting a range of HAND conditions.
The studies that report adequate sensitivities for the HDS fall into three main groups. The first group, the study by Power et al. (sensitivity 0.81), utilized the HDS to detect frank dementia. The second group, studies by Simioni et al. and Wojna et al. (sensitivity 0.82 and 0.87), used a high cut-off score (13 or 14). We meta-analysed these two studies together (Fig. 2b) and determined that the pooled sensitivity increased greatly when only evaluations with higher cut-offs were used (0.84). Finally, Morgan et al. used demographic corrections for age and education (T-scores) and increased the sensitivity from 0.17 with a cut-off of 10 or less to 0.71. These results suggest that the utility of the HDS can be improved by increasing the cut-off score, or by using demographically adjusted T-scores, but only for the detection of dementia.
The two studies with the lowest and comparable sensitivities [i.e. 0.09 and 0.17; Preliminary results from our CIHR Screening study (n = 20) also produced similar results with a sensitivity of 0.12 using a ‘long and comprehensive’ battery (personal communication, S.B.R., 13 March 2013)] both used a ‘long and comprehensive’ reference battery [19,34], whereas those that used a ‘medium’ reference battery [38,40,42,44] had not only higher sensitivities but also a larger range of sensitivities (0.39–0.87). These discrepancies in results using ‘medium’ versus ‘long’ reference batteries suggest that the rigour and comprehensiveness of the battery may be important determinants to consider when evaluting the overall test performance of screening tests for HAND.
Meta-analysis with the International HIV Dementia Scale
The meta-analysis of the IHDS (Fig. 2c) demonstrated more consistency than the HDS, although these studies employed only ‘small’ and ‘medium’ length reference batteries. One  study reported a poor sensitivity for the IHDS (0.45) and the other three [7,41] studies reported good sensitivities (≥0.80). Overall, the pooled sensitivity of these studies (0.62) demonstrates that the IHDS may be moderately useful in detecting HAND.
The quality assessment demonstrated that there are specific areas in which the studies tend to have methodological shortcomings (Fig. 3). Very few studies fulfilled criteria 10 and 11: 10, ‘Were the index test results interpreted without knowledge of the results of the reference standard?’ (6/31, 19%) [19,22,30,31,41,44] and 11, ‘Were the reference standard results interpreted without knowledge of the results of the index test?’ (7/31, 23%) [19,22,30,31,39,41,44]. This low level suggests that there may be some introduction of bias in the data interpretation, which may result in an overestimation of sensitivity.
Only about half the studies fulfilled criterion 1, ‘Was the spectrum of patients representative of the patients who will receive the test in practice?’ (17/31, 54%) [6,7,17,19,21,22,24,25,27,28,31,32,34,36,37,39,41]. This suggests that there are a good number of studies that may have limited applicability to real-life clinical settings.
The quality assessment did highlight some successful methodologies that should be continued in further evaluations. First, the majority of studies administered the same reference test and screening test to all study participants [criterion 5, ‘Did the whole sample or a random selection of the sample receive verification using a reference standard of diagnosis?’ (30/31, 97%) [6,7,17–28,30–44,64] and criterion 6, ‘Did patients receive the same reference standard regardless of the index test result?’ (30/31, 97%) [6,7,17–33,35–44,64]]. This allowed for proper and comprehensive calculation of sensitivity and specificity. Second, the majority of studies described their procedures with sufficient detail for replication of criterion 8 - ‘Was the executive of the index test described in sufficient detail to permit replication of the test?’ (30/31, 97%) [6,7,17–22,24–44,64], enabling future comparison of newer screening tools to already evaluated tools.
With the prevalence of milder forms of HAND increasing, and limited resources available for formal neuropsychological examinations, there is a critical need to be able to screen and identity people with HAND. Our current systematic review identified 51 peer-reviewed articles that focused on screening for neurocognitive impairments associated with HIV/AIDS. Of these, about two-thirds (31/51) used a criterion or reference to characterize the performance of 21 unique screening instruments. About half of the 31 studies examined the performance of the HDS or the IHDS as screening tests. Fifty-five percent of studies focused on detecting neurocognitive impairments, 35% on HAD and 15% in identifying MND or ANI. Only 16% of studies employed the latest 2007 HAND criteria .
The results of this systematic review suggest that the HDS and IHDS are not ideal tools for identifying a range of neurocognitive impairment. From the meta-analysis on the HDS and IHDS, we were able to determine that these tools have generally poor (0.48) and moderate (0.62) pooled sensitivities, respectively, in identifying a range of neurocognitive impairment. We also identified a potential relationship between the reference test and criterion with the range of sensitivities on the HDS and the IHDS, that is those studies using the most comprehensive neuropsychological test battery as the ‘gold standard’ criterion had the lowest (and similar) sensitivity values, whereas those that were considered ‘short’ or ‘medium’ in time (and comprehensiveness) resulted in much larger ranges of sensitivities. The association between lower sensitivity (ability to identify true positives) and large reference battery was significant for the HDS (P < 0.05). These findings suggest that a longer, more comprehensive neuropsychological battery may be a more stringent and appropriate reference test. Future studies evaluating sensitivity may want to consider using a large neuropsychological battery as a reference test to classify participants in a more discerning way. Studies using the HDS to identify a range of neurocognitive impairment reported higher sensitivities when higher cut-offs were used [40,44] or demographically adjusted T-scores were used .
The review identified 10 other screening tools with adequate sensitivities (≥0.75). Of these, four tools or combinations of tests were used to detect HAND conditions and overall neurocognitive impairment (as opposed to impairment in specific domains) and they used a ‘gold-standard’ neuropsychological battery as the reference test or criterion. These four tools include the CogState , the Screening Algorithm , the paired Hopkins Verbal Learning Test and WAIS-III Digit Symbol combination and the paired Hopkins Verbal Learning Test and Grooved Pegboard Non-Dominant Hand combination . It is important to note that the other studies defined neurocognitive impairment in different ways and evaluated these conditions using different criteria; thus, the comparison of efficacy across all studies needs to be carried out with caution given these limitations. In addition to these four tests, Becker et al.  reported a slightly lower sensitivity (0.72) for the Computer Assessment of Mild Cognitive Impairment (CAMCI) against a comprehensive neuropsychological battery. These are the five tools identified by our review that show some promise to be used to identify HAND in a clinical setting, although they warrant further study and validation.
In the 20 studies that met review criteria and are reported in Appendix B, http://links.lww.com/QAD/A370, one other potentially useful tool, The Montreal Cognitive Assessment (MoCA) , was highlighted. This tool is worth note because of its rising popularity in clinical settings, although the reliability and validity to detect HAND remains to be determined.
The review also highlighted key methodological issues in this body of literature. First, in order to properly determine whether a screening tool can detect the target condition, it is imperative that the reference test properly classifies the condition . Only 19 studies of the 31 (61%) [18–22,26,28–30,32,35,36,38,40–44,64] used the ‘gold-standard’ neuropsychological battery as the reference test. Furthermore, only seven (23%) studies [17–21,26,36] used more comprehensive reference tests (>90 min) and functional status was measured objectively in only nine studies [20–22,30,34,38,39,44,64] (29%). In addition, only five studies [21,28,30,40,64] used the most recent 2007 criteria to classify HAND . The QUADAS assessment reported that only 17 of the 31 (54%) [6,7,17,21,22,24,25,27,28,31,32,34,36,37,39,41] were using representative samples, noting a severe limitation in the applicability of the studies. For cognitive screening tools to be properly evaluated, and for these evaluations to inform clinical practice, more stringent methodological procedures are needed.
The results of this systematic review provide insights into the performance of the current screening instruments available for HAND and identify key methodological issues that need to be addressed in future studies. In this current context of mild cognitive impairment associated with HIV, it is clear that improved screening tools could go a long way in improving the care, quality of life and study of treatment interventions for individuals living with HIV and AIDS.
A.R.Z. contributed to development of systematic review project; reviewed articles for inclusion; extracted data; appraised quality of articles; created figures/tables; analysed data; and wrote the manuscript.
D.G. reviewed articles for inclusion; extracted data; appraised quality of articles; and edited the manuscript.
S.R. contributed to development of systematic review project; edited manuscript; and reviewed articles that were in Spanish.
J.B. contributed to development of systematic review project; and edited the manuscript. A.C. edited the manuscript. J.A.M. contributed to development of systematic review project; and edited the manuscript. M.J.G. contributed to development of systematic review project; and edited the manuscript. A.R. edited the manuscript. R.R. edited the manuscript. G.A. edited the manuscript. T.M. contributed to development of systematic review project; and edited the manuscript. S.B.R. developed systematic review project; organized systematic review team; lead systematic review project; and edited the manuscript.
Funding for this study was provided by the Canadian Institutes of Health Research (CIHR) and the Ontario Ministry of Health and Long-Term Care (MOHLTC) AIDS Bureau. The findings, opinions and conclusions are those of the authors and no endorsement of these by CIHR or MOHLTC is intended or should be inferred.
Conflicts of interest
There are no conflicts of interest.
1. Heaton RK, Clifford DB, Franklin DR Jr, Woods SP, Ake C, Vaida F, et al. HIV-associated neurocognitive disorders persist in the era of potent antiretroviral therapy: CHARTER Study. Neurology. 2010; 75:2087–2096.
2. Vivithanaporn P, Heo G, Gamble J, Krentz HB, Hoke A, Gill MJ, et al. Neurologic disease burden in treated HIV/AIDS predicts survival: a population-based study. Neurology. 2010; 75:1150–1158.
3. Antinori A, Arendt G, Becker JT, Brew BJ, Byrd DA, Cherner M, et al. Updated research nosology for HIV-associated neurocognitive disorders. Neurology. 2007; 69:1789–1799.
4. Rourke SB, Gill J, Rachlis A, Carvalhal A, Collins E, Arbess G, et al. The Centre for Brain Health in HIV/AIDS HIV-associated neurocognitive disorders (HAND) in men and women on cART and suppressed plasma viral load: prospective results from the OHTN cohort study. Can J Infect Dis Med Microbiol. 2013; 24:12A
Canadian Association for HIV Research (CAHR) Conference; 2013; Vancouver, BC. 11–14 April 2013
5. Janssen RS, Cornblath DR, Epstein LG, Foa RP. Nomenclature and research case definitions for neurologic manifestations of human immunodeficiency virus-type 1 (HIV-1) infection. Report of a Working Group of the American Academy of Neurology AIDS Task Force. Neurology. 1991; 41:773–785.
6. Power C, Selnes OA, Grim JA, McArthur JC. HIV Dementia Scale: a rapid screening test. J Acquir Immune Defic Syndr Hum Retrovirol. 1995; 8:273–278.
7. Sacktor NC, Wong M, Nakasujja N, Skolasky RL, Selnes OA, Musisi S, et al. The International HIV Dementia Scale: a new rapid screening test for HIV dementia. AIDS. 2005; 19:1367–1374.
8. Albert SM, Weber CM, Todak G, Polanco C, Coulse R, McElhiney M, et al. An observed performance test of medication management ability in HIV: relation to neuropsychological status and medication adherence outcomes. AIDS Behav. 1999; 3:121–128.
9. Hinkin CH, Castellon SA, Durvasula RS, Hardy DJ, Lam MN, Mason KI, et al. Medication adherence among HIV+ adults: effects of cognitive dysfunction and regimen complexity. Neurology. 2002; 59:1944–1950.
10. Heaton RK, Velin RA, McCutchan JA, Gulevich SJ, Atkinson JH, Wallace MR, et al. Neuropsychological impairment in human immunodeficiency virus-infection: implications for employment. HNRC Group. HIV Neurobehavioral Research Center. Psychosom Med. 1994; 56:8–17.
11. Marcotte TD, Wolfson T, Rosenthal TJ, Heaton RK, Gonzalez R, Ellis RJ, et al. A multimodal assessment of driving performance in HIV infection. Neurology. 2004; 63:1417–1422.
12. Woods SP, Iudicello JE, Moran LM, Carey CL, Dawson MS, Grant I. HIV-associated prospective memory impairment increases risk of dependence in everyday functioning. Neuropsychology. 2008; 22:110–117.
13. Heaton RK, Marcotte TD, Mindt MR, Sadek J, Moore DJ, Bentley H, et al. The impact of HIV-associated neuropsychological impairment on everyday functioning. J Int Neuropsychol Soc. 2004; 10:317–331.
14. Trepanier LL, Rourke SB, Bayoumi AM, Halman MH, Krzyzanowski S, Power C. The impact of neuropsychological impairment and depression on health-related quality of life in HIV-infection. J Clin Exp Neuropsychol. 2005; 27:1–15.
15. Marder K, Albert SM, McDermott M. Prospective study of neurocognitive impairment in HIV (DANA cohort): dementia and mortality outcomes. J Neurovirol. 1998; 4:(Suppl):358
16. Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003; 3:25
17. Becker JT, Dew MA, Aizenstein HJ, Lopez OL, Morrow L, Saxton J. Concurrent validity of a computer-based cognitive screening tool for use in adults with HIV disease. AIDS Patient Care STDS. 2011; 25:351–357.
18. Bottiggi KA, Chang JJ, Schmitt FA, Avison MJ, Mootoor Y, Nath A, et al. The HIV Dementia Scale: predictive power in mild dementia and HAART. J Neurol Sci. 2007; 260:11–15.
19. Carey CL, Woods SP, Rippeth JD, Gonzalez R, Moore DJ, Marcotte TD, et al. Initial validation of a screening battery for the detection of HIV-associated cognitive impairment. Clin Neuropsychol. 2004; 18:234–248.
20. Cysique LA, Maruff P, Darby D, Brew BJ. The assessment of cognitive function in advanced HIV-1 infection and AIDS dementia complex using a new computerised cognitive test battery. Arch Clin Neuropsychol. 2006; 21:185–194.
21. Cysique LA, Murray JM, Dunbar M, Jeyakumar V, Brew BJ. A screening algorithm for HIV-associated neurocognitive disorders. HIV Med. 2010; 11:642–649.
22. Ellis RJ, Evans SR, Clifford DB, Moo LR, McArthur JC, Collier AC, et al. Clinical validation of the NeuroScreen. J Neurovirol. 2005; 11:503–511.
23. Fogel BS. The high sensitivity cognitive screen. Int Psychogeriatr. 1991; 3:273–288.
24. Ganasen KA, Fincham D, Smit J, Seedat S, Stein D. Utility of the HIV Dementia Scale (HDS) in identifying HIV dementia in a South African sample. J Neurol Sci. 2008; 269:62–64.
25. Garvey LJ, Yerrakalva D, Winston A. Correlations between computerized battery testing and a memory questionnaire for identification of neurocognitive impairment in HIV type 1-infected subjects on stable antiretroviral therapy. AIDS Res Hum Retroviruses. 2009; 25:765–769.
26. Gonzalez R, Heaton RK, Moore DJ, Letendre S, Ellis RJ, Wolfson T, et al. Computerized reaction time battery versus a traditional neuropsychological battery: detecting HIV-related impairments. J Int Neuropsychol Soc. 2003; 9:64–71.
27. Jones BN, Teng EL, Folstein MF, Harrison KS. A new bedside test of cognition for patients with HIV infection. Ann Intern Med. 1993; 119:1001–1004.
28. Joska JA, Westgarth-Taylor J, Hoare J, Thomas KGF, Paul R, Myer L, et al. Validity of the International HIV Dementia Scale in South Africa. AIDS Patient Care STDS. 2011; 25:95–101.
29. Knippels HMA, Goodkin K, Weiss JJ, Wilkie FL, Antoni MH. The importance of cognitive self-report in early HIV-1 infection: validation of a cognitive functional status subscale. AIDS. 2002; 16:259–267.
30. Kwasa J, Cettomai D, Lwanya E, Osiemo D, Oyaro P, Birbeck GL, et al. Lessons learned developing a diagnostic tool for HIV-associated dementia feasible to implement in resource-limited settings: pilot testing in Kenya. PLoS One. 2012; 7:e32898
31. Lyon ME, McCarter R, D’Angelo LJ. Detecting HIV associated neurocognitive disorders in adolescents: what is the best screening tool?. J Adolesc Health. 2009; 44:133–135.
32. Maruff P, Thomas E, Cysique L, Brew B, Collie A, Snyder P, et al. Validity of the CogState brief battery: relationship to standardized tests and sensitivity to cognitive impairment in mild traumatic brain injury, schizophrenia, and AIDS dementia complex. Arch Clin Neuropsychol. 2009; 24:165–178.
33. Minor KS, Jones GN, Stewart DW, Hill BD, Kulesza M. Comparing two measures of psychomotor performance in patients with HIV: the Coin Rotation Test and the Modified HIV Dementia Screen. J Acquir Immune Defic Syndr. 2010; 55:225–227.
34. Morgan EE, Woods SP, Scott JC, Childers M, Beck JM, Ellis RJ, et al. Predictive validity of demographically adjusted normative standards for the HIV Dementia Scale. J Clin Exp Neuropsychol. 2008; 30:83–90.
35. Overton E, Kauwe J, Paul R, Tashima K, Tate D, Patel P, et al. Performances on the CogState and standard neuropsychological batteries among HIV patients without dementia. AIDS Behav. 2011; 15:1902–1909.
36. Parsons TD, Rogers S, Hall C, Robertson K. Motor based assessment of neurocognitive functioning in resource-limited international settings. J Clin Exp Neuropsychol. 2007; 29:59–66.
37. Revicki DA, Chan K, Gevirtz F. Discriminant validity of the Medical Outcomes Study cognitive function scale in HIV disease patients. Qual Life Res. 1998; 7:551–559.
38. Richardson MA, Morgan EE, Vielhauer MJ, Cuevas CA, Buondonno LM, Keane TM. Utility of the HIV dementia scale in assessing risk for significant HIV-related cognitive-motor deficits in a high-risk urban adult sample. AIDS Care. 2005; 17:1013–1021.
39. Robertson K, Wong M, Musisi S, Ronald A, Katabira E, Robertson KR, et al. Timed Gait test: normative data for the assessment of the AIDS dementia complex. J Clin Exp Neuropsychol. 2006; 28:1053–1064.
40. Simioni S, Cavassini M, Annoni JM, Rimbault Abraham A, Bourquin I, Schiffer V, et al. Cognitive dysfunction in HIV patients despite long-standing suppression of viremia. AIDS. 2010; 24:1243–1250.
41. Singh D, Sunpath H, John S, Eastham L, Gouden R. The utility of a rapid screening tool for depression and HIV dementia amongst patients with low CD4 counts: a preliminary report. Afr J Psychiatry (Johannesbg). 2008; 11:282–286.
42. Smith CA, van Gorp WG, Ryan ER, Ferrando SJ, Rabkin J. Screening subtle HIV-related cognitive dysfunction: the clinical utility of the HIV dementia scale. J Acquir Immune Defic Syndr. 2003; 33:116–118.
43. Von Giesen HJ, Haslinger BA, Rohe S, Koller H, Arendt G. HIV dementia scale and psychomotor slowing: the best methods in screening for neuro-AIDS. J Neuropsychiatry Clin Neurosci. 2005; 17:185–191.
44. Wojna V, Skolasky RL, McArthur JC, Maldonado E, Hechavarria R, Mayo R, et al. Spanish validation of the HIV Dementia Scale in women. AIDS Patient Care STDS. 2007; 21:930–941.
45. Diehr MC, Cherner M, Wolfson TJ, Miller SW, Grant I, Heaton RK. The 50 and 100-item short forms of the paced auditory serial addition task (PASAT): demographically corrected norms and comparisons with the full PASAT in normal and clinical samples. J Clin Exp Neuropsychol. 2003; 25:571–585.
46. Dunlop O, Bjoklund R, Abdelnoor M, Myrvang B. Total reaction time: a new approach in early HIV encephalopathy?. Acta Neurol Scand. 1993; 88:344–348.
47. Dunlop O, Bjorklund RA, Abdelnoor M, Myrvang B. Five different tests of reaction time evaluated in HIV seropositive men. Acta Neurol Scand. 1992; 86:260–266.
48. Koski L, Brouillette MJ, Lalonde R, Hello B, Wong E, Tsuchida A, et al. Computerized testing augments pencil-and-paper tasks in measuring HIV-associated mild cognitive impairment. HIV Med. 2011; 12:472–480.
49. Kovner R, Lazar JW, Lesser M, Perecman E. Use of the Dementia Rating Scale as a test for neuropsychological dysfunction in HIV-positive iv drug abusers. J Subst Abuse Treat. 1992; 9:133–137.
50. Kvalsund MP, Haworth A, Murman DL, Velie E, Birbeck GL. Closing gaps in antiretroviral therapy access: human immunodeficiency virus-associated dementia screening instruments for nonphysician healthcare workers. Am J Trop Med Hyg. 2009; 80:1054–1059.
51. Maj M, D’Elia L, Satz P, Janssen RS, Zaudig M, Uchiyama C, et al. Evaluation of two new neuropsychological tests designed to minimize cultural bias in the assessment of HIV-1 seropositive persons: a WHO study. Arch Clin Neuropsychol. 1993; 8:123–135.
52. Martin EM, Pitrak DL, Pursell KJ, Mullane KM, Novak RM. Delayed recognition memory span in HIV-1 infection. J Int Neuropsychol Soc. 1995; 1:575–580.
53. McManis SE, Brown GR, Zachary R, Rundell JR. A screening test for subtle cognitive impairment early in the course of HIV infection. Psychosomatics. 1993; 34:424–431.
54. Messinis L, Kosmidis MH, Tsakona I, Georgiou V, Aretouli E, Papathanasopoulos P. Ruff 2 and 7 Selective Attention Test: normative data, discriminant validity and test-retest reliability in Greek adults. Arch Clin Neuropsychol. 2007; 22:773–785.
55. Njamnshi AK, de Paul Djientcheu V, Fonsah JY, Yepnjio FN, Njamnshi DM, Muna WF. The International HIV Dementia Scale is a useful screening tool for HIV-associated dementia/cognitive impairment in HIV-infected adults in Yaounde-Cameroon. J Acquir Immune Defic Syndr. 2008; 49:393–397.
56. Nokes KM, Nwakeze PC. Assessing cognitive capacity for participation in a research study. Clin Nurs Res. 2007; 16:336–349.
57. Ogunrin OA, Eze EU, Alika F. Usefulness of the HIV Dementia Scale in Nigerian patients with HIV/AIDS. South Afr J HIV Med. 2009; 10:38–43.
58. Parker ES, Eaton EM, Whipple SC, Heseltine PNR, Bridge TP. University of Southern California repeatable episodic memory test. J Clin Exp Neuropsychol. 1995; 17:926–936.
59. Riedel D, Ghate M, Nene M, Paranjape R, Mehendale S, Bollinger R, et al. Screening for human immunodeficiency virus (HIV) dementia in an HIV clade C-infected population in India. J Neurovirol. 2006; 12:34–38.
60. Skinner S, Adewale AJ, Deblock L, Gill MJ, Power C. Neurocognitive screening tools in HIV/AIDS: comparative performance among patients exposed to antiretroviral therapy. HIV Med. 2009; 10:246–252.
61. Waldrop-Valverde D, Nehra R, Sharma S, Malik A, Jones D, Kumar AM, et al. Education effects on the international HIV dementia scale. J Neurovirol. 2010; 16:265–268.
62. Woods SP, Scott JC, Dawson MS, Morgan EE, Carey CL, Heaton RK, et al. Construct validity of Hopkins Verbal Learning Test: revised component process measures in an HIV-1 sample. Arch Clin Neuropsychol. 2005; 20:1061–1071.
63. Worth JL, Savage CR, Baer L, Esty EK. Computer-based neuropsychological screening for AIDS dementia complex. AIDS. 1993; 7:677–681.
64. Muniyandi K, Venkatesan J, Arutselvi T, Jayaseelan V. Study to assess the prevalence, nature and extent of cognitive impairment in people living with AIDS. Indian J Psychiatry. 2012; 54:149–153.
65. Berghuis JP, Uldall KK, Lalonde B. Validity of two scales in identifying HIV-associated dementia. J Acquir Immune Defic Syndr. 1999; 21:134–140.
66. Carey CL, Woods SP, Gonzalez R, Conover E, Marcotte TD, Grant I, et al. Predictive validity of global deficit scores in detecting neuropsychological impairment in HIV infection. J Clin Exp Neuropsychol. 2004; 26:307–319.
This article has been cited 1 time(s).
Journal of Neuroimmune PharmacologyIdentifying Risk Factors for HIV-Associated Neurocognitive Disorders Using the International HIV Dementia ScaleJournal of Neuroimmune Pharmacology
diagnosis; HIV/AIDS; HIV-associated neurocognitive disorder; neurocognitive impairment; screening tool
Supplemental Digital Content
This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivitives 3.0 License, where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially. http://creativecommons.org/licenses/by-nc-nd/3.0.
© 2013 Wolters Kluwer Health | Lippincott Williams & Wilkins
Highlight selected keywords in the article text.