INTRODUCTION
Negative expectations regarding the effects of a treatment can result in the aggravation of cutaneous sensations such as pain and itch (1–3 ). Such learned responses can be induced experimentally, allowing for the study of processes by which nocebo effects lead to symptom aggravation (4–10 ). In experimental studies, nocebo responses are defined as a significant increase in a sensation after a nocebo treatment, relative to no-treatment or a control treatment. To date, studies show that nocebo responses are able to aggravate sensations such as pain or itch , but may not necessarily elicit sensations in the absence of a baseline stimulus (11,12 ). Research on conditioned allodynia (pain or itch that persists in the absence on a sensory stimulus) has produced mixed results (13–16 ), but research has indicated that conditioned effects could transfer from one cutaneous sensation to another (17 ) and itch sensations can arise from social observation (18 ). Negative expectations leading to aggravated sensations of pain or itch are typically induced through classical conditioning , verbal suggestions, or their combination (4,5,10,19–21 ). Classical conditioning induces nocebo effects by building implicit associations between an (inert) treatment and the aggravation of sensations such as pain or itch (22–24 ). Verbal suggestions explicitly provide negative information regarding the pain - or itch -aggravating effects of a treatment (7 ). Because nocebo studies use diverse methods, to better understand their potential impact on nocebo outcomes, these methodological features warrant a systematic investigation.
Learning has consistently been shown to underlie induced nocebo effects (5–7,9,25 ), and verbal suggestions seem to induce stronger nocebo responses when combined with conditioning (26 ). The positive counterpart to nocebo , placebo effects, also seem to be stronger when induced through a combination of conditioning with verbal suggestions, compared with conditioning alone, both on pain (27 ) and itch (4,12 ). One meta-analysis included results from 10 nocebo experiments published up to 2013 and reports that the overall magnitude of the nocebo effect was moderate to large, and effects were generally larger when verbal suggestions were used in combination with conditioning (26 ). That early meta-analysis had a limited sample of studies available, and an up-to-date review is needed to examine how different types of learning may induce nocebo effects of different magnitudes. Other recent relevant reviews of the nocebo literature found that nocebo effects can be induced across many different sensations, including pain and itch , as a result of instructional learning , such as verbal suggestions, and associative learning , through conditioning mechanisms (28,29 ). Importantly, such mechanisms of induction of negative associations may be especially potent in settings with poor patient-clinician communication (30 ).
At the same time, other variables, such as the type of sensation (i.e., pain or itch ), stimulus modality (e.g., thermal, electrical), the intensity of pain or itch stimulations, and the length of conditioning (learning ) phases in different behavioral paradigms, also require a systematic examination across studies. For example, in experimental nocebo research, some nocebo conditioning paradigms include as few as four associative learning trials (5 ), whereas others use much longer paradigms (6,8,31 ). A diverse set of cutaneous (pain /itch ) sensory induction methods are also used, such as thermal (25 ), electrical (6,12 ), or laser pain stimulations (32 ). Such methodological choices, often meant to target specific underlying processes in nocebo experiments, can potentially influence nocebo responding and thus merit further investigation.
Given the recent growth of nocebo research, we conducted a systematic review and meta-analysis of experimental nocebo studies in healthy participants to provide novel insights into distinct contributions of methodological factors in the induction of nocebo responses. We focused on the cutaneous sensations of pain and itch , aiming to examine nocebo responses induced with comparable sensory inductions externally on the skin. We also focused on methodological and design choices for experimental models, as well as on the types of learning mechanisms involved. This meta-analysis did not delve into potential effects of demographic characteristics on nocebo responses, as demographic variables have not systematically been studied in the nocebo literature and are often reported as secondary, if at all, and we did not have a meaningful rationale for why, for example, small variations in age would impact nocebo responding. First, we examined nocebo magnitudes between pain and itch and based on the learning method used. Then, we conducted subset analyses and meta-regression to assess how the type and intensity of stimulations, the length of conditioning , the timing of measurement of nocebo magnitudes, and risk of bias (RoB) in studies may impact nocebo magnitudes.
METHODS
Protocol and Registration
The protocol for this study was preregistered on ClinicalTrials.gov (ID: NCT04387851) and conducted based on the PRISMA statement 2009 (see checklist, Supplemental Digital Content 1, https://links.lww.com/PSYMED/A917 ) and Cochrane recommendations (2020). The protocol was registered based on a single search strategy for both nocebo and placebo studies, which, because of the volume of the studies returned, is now divided into two separate articles. Here, we report only the nocebo (arms of) experimental studies.
Databases and Selection Criteria
PubMed, PsycINFO, EMBASE, and the Cochrane CENTRAL Methodology Library were searched to identify studies. Languages were a priori restricted to English, Dutch, and German, and the publication period was not restricted. Searches were initially conducted on March 18, 2019. Repeated searches for studies published after this time were conducted in June 2020 and July 2021. See Supplemental Digital Content 2, https://links.lww.com/PSYMED/A918 , for a detailed keyword strategy.
We searched for original, peer-reviewed, controlled experimental studies (or study arms) on healthy human participants that aimed to experimentally induce placebo and/or nocebo effects. Patient samples were not included to improve the homogeneity of the results, and for the same reason, we focused on cutaneous sensations (i.e., pain and/or itch stimulations that were administered on the skin), excluding, for example, visceral pain studies. We considered as nocebo studies in our inclusion process only those studies that used a verbal suggestion that specifically informed participants that their pain /itch would be worsened as a result of a (sham) treatment. We therefore did not include studies that, for example, simply instructed participants that they will experience increased pain when viewing a particular cue on a screen, or studies that did not instruct participants on why in some trials they experience increased pain , as these studies were considered to be pain conditioning (but not nocebo conditioning studies explicitly inducing expectations regarding a treatment). For the purposes of inclusion and exclusion, studies were considered to have induced a placebo or nocebo effect if a learning paradigm was used to induce positive or negative outcome expectations about an inert treatment. We considered as nocebo learning paradigms only those that aimed to induce negative expectations regarding an intervention, such as sham electrical stimulation or an inert cream. This meant that most conditioning without verbal suggestion studies were excluded from this review because they did not include treatment associations and were considered to be pain -conditioning , not nocebo -conditioning studies (albeit explicit mention of the terms nocebo and placebo was not a specific inclusion criterion). In addition, we only included studies that had a control group or a control condition within-subjects, so that nocebo effects could be calculated as the difference between nocebo and control/no treatment on self-reported scores. We excluded studies that excluded or did not report data from nocebo nonresponders. Post hoc, we excluded observational learning studies because they were too few for a meaningful analysis. Studies that did not fulfill one or more of the criteria mentioned previously were excluded from the meta-analysis (Figure 1 ).
FIGURE 1: Flow diagram detailing the inclusion and exclusion of studies. The final sample included 127 articles, of which 106 investigated placebo effects, and 37 investigated nocebo effects (i.e., 16 studies overlapped because they investigated both placebo and nocebo ). Color image is available online only at the Psychosomatic Medicine Web site.
Study Selection
Eligibility assessment for the inclusion of studies was performed independently by two authors in each of the following steps. Titles and abstracts of articles retrieved using the search strategy were screened by two authors independently (M.M.E.V.S. and J.S.B.). The full text of articles to be included and articles about which doubts existed were then retrieved and assessed for eligibility by two authors independently (M.A.T. and J.S.B.). The reference lists of all included articles were also screened for study inclusion by two authors (M.A.T. and J.S.B.), and included articles were also entered in Web of Science to identify articles that have cited them and should potentially be included in the meta-analysis. When necessary, authors of studies were contacted to provide full-text articles that were not accessible online. Any disagreements regarding study inclusion were resolved by consultation with a third author (K.J.P.).
Data Extraction
One author (J.S.B.) used a standardized form to independently extract data from the included studies to derive data for analyses. Another author (M.A.T.) checked 25% of extracted values for accuracy. Extracted information included details of the intervention such as the learning method used, the control condition, study population, sensation type, pain /itch rating data, type of cutaneous stimulation (e.g., heat pain , pressure pain ), type of outcome expected (i.e., placebo or nocebo ), information for quality assessment, and outcome data for meta-analysis (e.g., sample size, pain /itch rating means and standard deviations). Doubts regarding data extraction were resolved through discussion with a third review author (K.J.P.). Missing data were requested directly from the study authors. When there was no response from authors, but data could be extracted from published figures, this was done using WebPlotDigitizer version 4.4 (Rohatgi, 2020).
Risk of Bias
RoB was assessed and checked by two authors (M.A.T. and J.S.B.) using the method developed by Marcuzzi and colleagues (33 ) specifically for quantitative sensory testing studies. This method assesses whether the sample was clearly described and was representative of the population, whether the somatosensory assessment methods are standardized, validated, and well described, if potential confounders were considered, and adequate blinding. Each category was scored as being satisfied (0 points), not satisfied (2 points), partially satisfied (unclear; 1 point), or not applicable. Scores were selected based on criteria described in Marcuzzi and colleagues (33 ). We additionally concocted numerical scores (0–34) for each study, by summing each item score, with higher scores indicating higher RoB (see Supplemental Digital Content 3, https://links.lww.com/PSYMED/A919 , for an example of the RoB scoring).
Statistical Analyses and Results Synthesis
All analyses were conducted and checked by two reviewers (J.S.B. and M.A.T.), using the Comprehensive Meta-Analysis software (version 3.3.070; Biostat, Englewood, New Jersey) and R programming software for visualizations (34 ). Funnel plots were inspected for outliers (i.e., studies falling outside the funnel of expected results), and to assess publication bias across studies, we checked for number of imputed missing studies with Duval and Tweedie’s trim-and-fill method (35 ). Heterogeneity between studies was assessed with the I 2 statistic and visual inspection of the forest plot. I 2 is a measure of the proportion of observed variance reflecting real differences in effect sizes (36 ), with values of 25%, 50%, and 75% considered as low, moderate, and high degrees of heterogeneity, respectively (37 ). For forests plots, we calculated study weights in R by inversing the variance of each effect size.
Given the heterogeneity of study designs, random-effects models were used for all meta-analyses. Effect sizes were calculated using means and standard deviations for each group (between subjects) or trial type (within subjects). (36 ). Magnitude of nocebo responses was the main outcome variable, with nocebo magnitude commonly defined in the nocebo literature as the size of nocebo responses on a standardized pain /itch scale as a function of difference scores (26 ). Nocebo magnitudes thus represent the size of the difference in participants’ pain /itch ratings during nocebo evocation trials as compared with control trials. When standardized pain /itch scales were not ranging from 0 to 10, we transformed the difference scores for evocation versus control trials by dividing the difference rating by the highest possible value on the scale used and multiplying by 10 to convert to a rating on a 0–10 scale. We selected nocebo and control conditions based on what was reported in studies: some reported nocebo magnitudes between groups, other within groups in the first pair of evocation trials, and others reported nocebo magnitudes as the mean difference of all control and evocation trials. When only nocebo /control difference scores were reported, these were used instead. When only standard errors were reported, they were converted to standard deviations by multiplying the standard error by the square root of the group size (n ). For each study, an effect size Hedges g , weighted to the sample size (N ), was computed as the mean pain or itch response in the nocebo condition minus the mean response for the control condition of the evocation phase of experiments. Positive g values indicate a nocebo response, with values around 0.2 considered small, 0.5 medium, and 0.8 large.
For studies that used within-subject comparisons, the nocebo -control condition correlation coefficient could not be derived; therefore, an average r of 0.5 was imputed (38 ). Meta-analysis was only conducted when the data of at least four studies were available in total. Specifically for subset analyses, we ran statistical tests when two or more studies were available per subgroup. Studies with multiple eligible conditions were treated as separate subgroups and averaged across during the statistical analysis (e.g., when cheap versus expensive inert treatments were used as nocebo , we averaged the results and treated this as one group; see Table 1 for results synthesis per study).
TABLE 1 -
Study Characteristics for All Included Articles
Authors
Year
Sample Size Nocebo Group
Sample Size Control Group
Total Sample Size (Male/Female)
Mean Age (SD), y
Stimulation Type
Learning Method
Results Synthesis Where Applicable
No. Conditioning Trials (N/C)
(Length of Conditioning )
Outcome Measure: Evocation First Trials or Mean of Trials by Trial Type
Control Condition for Nocebo Outcome (for VS Only Studies: Between Subjects Always)
Language of Assessment
Risk of Bias Score (0–34)
Pain
1
Colagiuri et al. (6 )
2015
37
42
46 (22 M/24F)
20.3 (4.0)
Electrical
CC + VS
32 (16/16)
First
Within subjects
English (native)
3
2
Colagiuri and Quinn (39 )
2018
20
20
135 (62 M/73F)
20.2 (4.0)
Electrical
CC + VS
32 (16/16)
Mean
Within subjects
English (native)
5
3
Colagiuri et al.
2021
20 + 20
21 + 20
65 (19 M/46F)
20.7 (3.6)
Electrical
CC + VS
Lengthier learning condition treated and analyzed as a separate study arm
32 (16/16)
Mean
Within subjects
English (native)
3
4
Colloca et al. (8 )
2010
23 + 23
n/a
61 (26 M/35F) + 80 (17 M/63F)
22.8 (3.4)
Electrical
CC + VS
Four versus of one learning sessions averaged together
20 (10/10) or 80 (40/40)
Mean
Within subjects
Not reported
3
5
Colloca et al (7 )
2008
42 VS and
45 CC + VS
n/a
46 (16 M/30F)
22.3 (2.4)
Electrical
CC + VS and VS
Three pain intensities averaged across VS and CC + VS conditions and analyzed as two separate study arms
24 (12/12)
Mean
Within subjects
Not reported
3
6
Corsi and Colloca (40 )
2017
46
n/a
116 (0 M/116F)
27.4 (1.1)
Thermal
CC + VS
12 (6/6)
Mean
Within subjects
English (native)
3
7
Egorova et al.
2020
24
n/a
24 (12 M/12F)
n/a
Thermal
CC + VS
48 (24/24)
Mean
Within subjects
English (native)
5
8
Feldhaus et al. (41 )
2021
624
n/a
624 (251 M/373F)
24.6 (3.6)
Thermal
CC + VS
16 (8/8)
Mean
Within subjects
German (native)
3
9
Freeman et al. (42 )
2015
24
n/a
24 (12 M/12F)
21 to 49
Thermal
CC + VS
18 (9/9)
First
Within subjects
English (native)
5
10
Geuter and Büchel (43 )
2013
20
n/a
20 (12 M/8F)
26.4
Thermal
CC + VS
24 (12/12)
Mean
Within subjects
Not reported
3
11
Kong et al. (31 )
2008
13
n/a
13 (5 M/8F)
26.3 (3.6)
Thermal
CC + VS
48 (24/24)
First
Within subjects
English (native)
5
12
Pazzaglia et al. (32 )
2016
9 + 9
n/a
18 (10 M/8F)
29 (5.0)
Laser
CC + VS andVS
VS condition treated and analyzed as a separate study arm
60 (30/30)
Mean
Within subjects
Not reported
5
13
Skvortsova et al. (44 )
2019
37
n/a
37 (37 M/0F)
23.1 (2.9)
Thermal
CC + VS
24 (12/12)
Mean
Within subjects
Dutch (native)
0
14
Thomaidou, Blythe, et al.
2021b
36
n/a
36 (11 M/25F)
22.9 (2.2)
Thermal
CC + VS
32 (16/16)
First
Within subjects
English (mixed)
5
15
Thomaidou et al. (9 )
2020
48
25
122 (20 M/102F)
21.8 (2.1)
Thermal
CC + VS
30 (15/15)
First
Within subjects
Dutch (native)
5
16
Thomaidou et al. (21 )
2021
24
n/a
72 (18 M/54F)
22.2 (1.9)
Thermal
CC + VS
24 (12/12)
First
Within subjects
English (mixed)
5
17
Tinnermann et al. (45 )
2017
25 + 24
n/a
49 (27 M/22F)
25.4 (3.8)
Thermal
CC + VS
Cheap versus expensive conditions were averaged together
16 (8/8)
Mean
Within subjects
Not reported
6
18
Tu, Wilson, et al.
2021
27
n/a
81 (44 M/37F)
27.4 (6.4)
Thermal
CC + VS
48 (24/24)
Mean
Within subjects
English (native)
3
19
Wei, Zhou, et al.
2018
18
n/a
76 (0 M/76F)
20.9 (1.4)
Electrical
CC + VS
40 (20/20)
Mean
Within subjects
Chinese (native)
3
20
Weng et al. (46 )
2021
33
n/a
33 (8 M/25F)
21.6 (3.0)
Thermal
CC + VS
30 (15/15)
Mean
Within subjects
English (mixed)
1
21
Albu and Meagher (47 )
2016
15
15
30 (11 M/19F)
19.1 (1.2)
Thermal
VS
n/a
Mean
Within subjects
English (native)
3
22
Aslaksen and Lyby (25 )
2015
57
54
111 (35 M/76F)
22.2 (3.1)
Thermal
VS
n/a
First
Between subjects
Norwegian (native)
3
23
Aslaksen et al. (48 )
2016
15
16
61 (28 M/33F)
21.6 (3.3)
Thermal
VS
n/a
First
Between subjects
Norwegian (native)
0
24
Aslaksen, Zwarg, et al.
2015
25
25
142 (69 M/73F)
23.4 (4.1)
Thermal
VS
n/a
First
Between subjects
Norwegian (native)
0
25
Camerone et al. (49 )
2021
19
21
157 (73 M/84F)
23.1 (2.1)
Electrical
VS
We analyzed the 5-min condition
n/a
Mean
Within subjects
Not reported
1
26
Geers, Close, et al.
2019
36
36
146 (92F/54M)
19.7 (3.2)
Cold pressor
VS
n/a
Mean
Between subjects
English (native)
3
27
Nir, Yarnitsky, et al.
2012
12
12
48 (48 M/0F)
25.8 (3.2)
Hot water bath
VS
n/a
Mean
Between subjects
Not reported
3
28
van den Broeke, Geene, et al.
2014
15
15
30 (11 M/19F)
23.5 (2.2)
Mechanical stimulation
VS
n/a
First
Within subjects
Dutch (native)
4
29
Vögtle, Barke, et al.
2013
26
26
80 (0 M/80F)
22.5 (4.4)
Pressure
VS
n/a
Mean
Within subjects
German (native)
2
30–31
van Laarhoven et al. (50 )
2011
33pain and 36itch
16pain and 20itch
105 (0 M/105F)
21.8 (2.2)
Electrical, Mechanical, Histamine
VS
Three types of stimulations averaged together across pain and across itch
n/a
Mean
Between subjects
Dutch (native)
1
Itch
32
Bartels et al. (4 )
2014
23 + 23
25
95 (22 M/73F)
22.7 (3.2)
Electrical
CC + VS and VS
VS condition treated and analyzed as a separate arm
12 (6/6)
Mean
Between
Dutch (native)
4
33
Bartels, van Laarhoven, et al.
2017
99
n/a
99 (21 M/78F)
20.3 (2.5)
Electrical
CC + VS
16 (10/6)
Mean
Within
Dutch (native)
4
34
Blythe et al. (5 )
2021
19
19
39 (0 M/39F)
21.9 (2.4)
Cowhage
CC + VS
4 (2/2)
Mean
Within
English (mixed)
2
35
van de Sand, Menz, et al.
2018
30
30
30 (12 M/18F)
25.5
Histamine skin scrub
CC + VS
40 (20/20)
Mean
Within
Not reported
5
36
Meeuwis, van Middendorp, et al.
2019
24
n/a
92 (16 M/76F)
21.8 (2.7)
Histamine iontophoresis
VS
n/a
Mean
Within
Dutch (native)
4
37
Meeuwis et al. (51 )
2021
28
n/a
111 (18 M/93F)
21.9 (2.8)
Histamine iontophoresis
VS
n/a
Mean
Within
Dutch (native)
4
SD = standard deviation; N, nocebo ; C, control; VS, verbal suggestions; M; male; F, female; CC + VS, combination of classical conditioning and verbal suggestions.
The study by van Laarhoven et al. (
50 ) included both
itch and
pain manipulations and is listed under
pain . When the sample size of a control group is listed as n/a, this suggests that the study used a within-subject controlled design. In language of assessment, the note “native” indicates that the local native language of participants was used; when known, the note “mixed” indicates that the sample was of mixed nationalities and the language of assessments was native for some but not for others. Studies are listed separately for
pain and
itch and first based on the
learning manipulation and then alphabetically. The references for the included studies are available in Supplemental Digital Content 4. (
https://links.lww.com/PSYMED/A930 ).
Primary Outcome Measures and Subset Analyses
Our primary outcomes were the overall magnitude of nocebo responses (i.e., the difference in self-reported pain /itch between a nocebo and a control trial in the evocation phase) separately for pain and itch studies using verbal suggestions with or without classical conditioning . We thus computed four pooled effect sizes: verbal suggestions in pain , conditioning with verbal suggestions in pain , verbal suggestions in itch , and conditioning with verbal suggestions in itch . Whenever possible, the mean of pain or itch ratings across the entire evocation phase was used. If only values from the first trial(s) were reported, these were used instead, and sensitivity analyses were tested for differences in magnitudes between studies reporting the mean versus the first trials.
We also did subset analyses to compare Hedges g between nocebo responses based on the type of learning (verbal suggestion or combination with conditioning ) and type of sensory stimulation (e.g., thermal, electric) and the timing of nocebo measurement (as the mean of evocation or only the first evocation trials, by trial type). Meta-regression assessed the impact of the length of conditioning (quantified as the number of learning trials during induction, whereas we also separately examined number of trials evocation), the timing of the measurement of nocebo hyperalgesia in the evocation phase (first trials versus mean of evocation trials), the stimulus intensity (calculated as the calibrated difference in pain intensity for control versus nocebo trials), and the RoB score on nocebo magnitudes for the included studies.
RESULTS
Study Selection
Figure 1 shows the flow of the study selection process including the reasons for exclusion at each stage. A total of 17,546 nocebo and placebo articles were initially identified through the database searches. We searched for more eligible studies through reviewing the reference lists and Web of Science for each included study, as well as conducting repeat database searches in June 2020 and July 2021. At each stage of study inclusion, duplicates were removed, and remaining articles were considered based on title and abstract, or full text. In total, we identified 24,814 articles through our searches, of which 24,687 were excluded.
We did not follow a strict hierarchical approach in marking exclusion criteria but selected criteria based on what was deemed to be the major exclusion reason, for example, when screening abstracts where limited information is available; therefore, the following exclusion numbers provide less than precise estimates of exclusion reasons. We excluded articles for the following reasons: 8302 articles for not aiming to study nocebo or placebo effects or not using a learning paradigm to induce placebo or nocebo effects (explicit use of the terms nocebo or placebo was not an inclusion criterion); 4328 for not reporting original data or (full length, peer reviewed) experimental studies; 1229 for not being conducted in humans; 10,440 because they were duplicates or already screened during a previous round; 101 for not studying (placebo/nocebo on) cutaneous sensations; 242 for not studying (placebo/nocebo in) healthy human participants; 20 because they did not report self-reported pain /itch intensity ratings; 13 for not being in English, Dutch, or German; 2 studies for not using a within- or between-subject controlled design; 5 studies for not responding to requests for data; and 5 for excluding data from participants who were considered placebo/nocebo nonresponders. A total of 127 articles were selected, of which 108 included placebo conditions and 39 nocebo conditions. Of these articles, we excluded two observational learning studies because they were too few for a meaningful analysis. Thus, in total, 37 studies were included in this meta-analysis on nocebo effects. The references for the included studies are available in Supplemental Digital Content 4, https://links.lww.com/PSYMED/A930 .
Study Characteristics
Table 1 displays study characteristics. We included 37 distinct nocebo studies, published between 2008 and 2021. Including additional experimental conditions in a number of studies (Table 1 ) in total, we analyzed 40 study arms (30 pain and 10 itch ). Thermal pain inductions were used in 19 arms, electrical pain was used in 6, pressure pain was used in 1, and mechanical, cold pressor, hot water bath, and histamine methods were each used in 1 study arm. Only 7 studies (10 arms) induced nocebo effects on itch , 1 of which also included pain (this study, van Laarhoven et al. (50 ), is listed under Pain in Table 1 ). Electrical itch was used in three studies, one of which (van Laarhoven et al. (50 )) used additional mechanical and histamine inductions in both the pain and itch groups (Table 1 ). Histamine was used in three more itch studies, and cowhage was used in one study.
For nocebo induction, most studies (18 pain and 4 itch studies) used a combination of classical conditioning and negative verbal suggestions, and for 3, we included additional study arms that used verbal suggestions alone (Table 1 ). Verbal suggestions alone were used as the main manipulation in 10 pain studies (in a total of 12 arms) and 3 itch studies (in a total of 6 arms). RoB was low within all studies, with most studies showing low RoB (maximum of 5/34), and only one study scoring in the low-moderate range with a score of 6/34 (Table 1 ). The funnel plots as well as a trim-and-fill method that suggested a small number of imputed studies (Figure 2 ) indicated that, overall, there was a low degree of potential publication bias across all studies, with a total estimate of seven studies missing.
FIGURE 2: Forest plot of the meta-analysis indicating the magnitudes of nocebo responses after a combination of classical conditioning and verbal suggestions (CC + VS) or verbal suggestions alone (VS) on pain (A, B) and itch (C, D). Sample sizes marked with (c) indicate the combined sample from different study arms.
Magnitude of Nocebo Responses
See Figures 2 and 3 for forest and funnel plots, respectively, that display effect sizes per study and pooled effects. For pain (Figures 2 A, B), the magnitude of nocebo responses on a standardized scale of 0–10 (with higher scores indicating larger nocebo magnitudes) across studies using classical conditioning with verbal suggestions ranged from 0.28 to 1.42, with the mean standardized response being M = 0.79 (SE = 0.24). Verbal suggestions alone induced effects on pain ranging from 0.00 to 1.27 (M = 0.70, SE = 0.30). For itch , the magnitude of nocebo responses in studies that used conditioning with verbal suggestions ranged from 0.21 to 0.47 (M = 0.35, SE = 0.24). Verbal suggestions alone induced effects on itch ranging from 0.41 to 0.75 (M = 0.58, SE = 0.26). Based on these results, on average, our meta-analysis indicated medium effects of the nocebo manipulations (Hedges g between 0.26 and 0.71 for each of the four pooled effects), a moderate degree of heterogeneity (I 2 average 41% across the four pooled effects), with the study effect sizes ranging between g = 0.00 and g = 1.34.
FIGURE 3: Funnel plots displaying studies within and outside of 95% (dotted line) and 99% (dashed line) confidence interval, for pain verbal suggestions with (A) and without (B) conditioning , and for itch verbal suggestions with (A) and without (B) conditioning .
Classical Conditioning and Verbal Suggestions in Pain and Itch
A range of different verbal suggestions were used to induce nocebo responses on pain and itch . Most studies used either an inert cream or inactive electrodes as the nocebo stimulus that would supposedly increase pain /itch sensitivity. For example, studies suggested to participants that their pain will be increased upon the activation of electrodes on their skin because these electrodes “enhance the conductivity of the pain signal being sent to the brain” (39 ) or “the cream that will be applied to your arm increases the effect of the heat pain and you will feel more pain after the application” (25 ). Most such suggestions were delivered orally by a researcher, with few studies providing such information in writing.
For pain , a somewhat larger pooled nocebo effect of the combination of conditioning with verbal suggestions (k = 21, g = 0.71, 95% confidence interval [CI] = 0.60–0.82, I 2 = 50.71%; Figure 3 A) was observed compared with verbal suggestions alone (k = 12, g = 0.63, 95% CI = 0.40–0.86, I 2 = 55.59%; Figure 3 B). In itch , however, conditioning with verbal suggestions yielded a smaller pooled effect on the magnitude of nocebo responses (k = 4, g = 0.26, 95% CI = 0.09–0.43, I 2 = 0%; Figure 3 C) compared with a medium pooled effect of verbal suggestions alone (k = 4, g = 0.53, 95% CI = 0.23–0.82, I 2 = 53.81%; Figure 3 D) on nocebo responses. Overall, nocebo responses (see Table 1 for the relevant studies) were thus associated with medium pooled effects in pain , whereas in itch , they were associated with slightly smaller pooled effects overall.
Magnitude of Nocebo Responses Based on the Type of Stimulation
For pain studies that used conditioning with verbal suggestions, we compared effects of different pain administration methods (k = 13 thermal, k = 7 electrical) excluding the single study using laser. Thermal pain yielded a somewhat larger pooled effect on the magnitude of nocebo responses (k = 13, g = 0.75, 95% CI = 0.59–0.91) compared with medium pooled effects of electrical pain (k = 7, g = 0.65, 95% CI = 0.51–0.79) on nocebo responses. For pain studies that used only verbal suggestions, we examined effects of different pain administration methods (k = 4 thermal, k = 5 electrical, k = 2 mechanical) excluding the single studies using laser, cold pressor, hot water bath, pressure, and histamine. Electrical pain yielded a slightly larger pooled effect on the magnitude of nocebo responses (k = 5, g = 0.91, 95% CI = 0.65–1.17) compared with medium effects of thermal (k = 4, g = 0.69, 95% CI = 0.21–1.16) and mechanical (k = 2, g = 0.60, 95% CI = 0.14–1.06) pain .
For itch studies that used conditioning with verbal suggestions, there were too few studies to analyze (cowhage k = 1, electrical itch k = 2, and histamine k = 1). For itch studies that used only verbal suggestions, there were again too few studies (k = 2 electrical, k = 3 histamine, k = 1 mechanical).
Magnitude of Nocebo Hyperalgesia Based on the Pain Stimulus Intensity
For pain studies that used classical conditioning with verbal suggestions, we had a sufficient sample to examine any relationship between differences in intensity of pain stimulations in the learning phase and the magnitude of nocebo responses, but a meta-regression found no significant association (Q = 0.89, p = 0.35).
Magnitude of Nocebo Hyperalgesia Based on the Number of Trials
Studies that used classical conditioning used varying numbers of learning and evocation trials. For pain only, there were sufficient studies to examine the effects of different lengths of conditioning and different lengths of evocation (i.e., the length of extinction) on nocebo magnitudes. The shortest pain learning paradigm used six nocebo and six control trials, whereas the longest paradigms used up to 30 nocebo and 30 control trials. Evocation phases ranged from 3 nocebo and 3 control trials to 30 nocebo and 30 control trials. A meta-regression of different lengths of conditioning showed no association with the magnitude of nocebo responses (Q = 0.81, p = 0.37). Similarly, there was no association between the length of evocation and nocebo magnitudes (Q = 0.19, p = 0.67).
Magnitude of Nocebo Hyperalgesia Based on the Timing of Measurement
All itch conditioning studies measured the nocebo effect as the mean of all evocation trials. Among pain studies that used a combination of conditioning with verbal suggestion, however, 13 paradigms measured nocebo responses as the mean of all evocation (testing) trials, 6 measured the magnitude of responses in the first pair of evocation trials, and 2 studies specified different timing such as pre-post measures. Studies in which first evocation trials were used yielded a large pooled effect on the magnitude of nocebo responses (k = 6, g = 0.82, 95% CI = 0.57–1.07) compared with medium pooled effects of measuring the effect as the mean of all evocation trials (k = 13, g = 0.66, 95% CI = 0.54–0.79) and nonspecified (k = 2, g = 0.67, 95% CI = 0.23–1.11).
Magnitude of Nocebo Responses Based on the RoB Score
Lastly, we examined how RoB scores (Table 1 ) may be related to nocebo magnitudes. A meta-regression showed no significant relationship between RoB scores and the magnitude of nocebo responses for pain studies that used conditioning and verbal suggestions (Q = 0.75, p = 0.39), for pain studies that used only verbal suggestions (Q = 0.00, p = 0.95), for itch studies that used conditioning and verbal suggestions (Q = 0.08, p = 0.77), or for itch studies that used verbal suggestions alone (Q = 1.9, p = 0.05).
DISCUSSION
We conducted a systematic review and meta-analysis of a total of 37 distinct nocebo studies on healthy participants. This meta-analysis showed that, on average, nocebo effects were moderate to large in magnitude. The combination of verbal suggestions with classical conditioning yielded stronger nocebo responses on pain , but this may not necessarily be the case in the small number of itch studies. Measures of the type or intensity of pain or itch , and length of conditioning did not explain the moderate heterogeneity in nocebo magnitudes between different studies. Timing of nocebo measurement in the first evocation trials yielded slightly larger nocebo magnitudes. RoB was generally low and was not related to nocebo magnitudes either. We discuss these results in relation to the role of conditioning and aversive learning , and we speculate of the reasons why none of the factors collected in the nocebo literature seem to consistently explain variations in the magnitudes of learned nocebo effects on pain and itch .
Generally, studies that aimed to experimentally induce nocebo responses yielded average responses (across the included sample) of moderate to large magnitudes, ranging from 0 (a magnitude of zero indicating no nocebo response) to high response magnitudes up to 4 points on a 0–10 scale. Few studies reported that their experimental manipulations did not induce a nocebo response on average across participants, but interindividual variations are prevalent in nocebo responding. It should be noted that little attention has been devoted in the literature included here regarding the prevalence of nocebo responses, that is, the difference between the absence and presence of a nocebo response.
We found that nocebo magnitudes had a moderate heterogeneity and were moderated only by the timing of measurement. This is unsurprising because measuring nocebo magnitudes in the first trials of the attenuation phase yields larger nocebo effects before extinction has had a chance to take place. It is important to note that this result may show that nocebo effects start becoming extinct shortly after negative learning is discontinued, even if some studies indicate that nocebo effects are more persistent than placebo effects (52 ).
Often conceptualized as the counterpart of nocebo responses, placebo effects seem to be comparable in magnitude to the overall nocebo magnitude found in the current meta-analysis, but heterogeneity in placebo responses may be higher (27 ). In a more recent meta-analysis on experimental placebo studies, placebo responses were found to yield small to moderate effects, with moderate to large heterogeneity in results (53 ). We speculate that this may indicate that the negativity of suggestions and experiences in nocebo paradigms may result in stronger learned effects, as compared with the positive expectations induced in placebo excrements. Indeed, aversive learning has consistently been shown to be prioritized over the learning of neutral or positive information in the brain (54–57 ), something that is thought to have an evolutionary basis (58 ).
Magnitudes of nocebo responses were found to be moderate to large in pain studies when looking at both verbal suggestions and combination with conditioning . As expected, in pain experiments, the addition of classical conditioning yielded somewhat larger nocebo responses, suggesting that learning by experience during behavioral conditioning may be more potent than mere negative suggestions regarding pain outcomes. For itch , however, verbal suggestions alone yielded moderate effects, whereas combination with conditioning resulted in small effects across studies. The number of studies included in each of the two itch conditions (k = 4 in each) may be insufficient to allow for further conclusions to be drawn regarding this apparent distinction between learned pain and itch effects.
Although the number of itch studies included in this meta-analysis was small (8 ) compared with pain (30 ), overall effects on pain seem to be larger than those on itch across both learning methods, based on the present findings. Itch has been shown to be prone to suggestions and can be influenced by expectations (4 ), with one study that compared placebo effects induced with verbal suggestions for either pain or itch indicating that itch might be more prone to suggestions (50 ). Our finding that pain resulted in larger nocebo magnitudes across the studies included here could suggest that, compared with itch , the learning of pain associations may be facilitated to a larger degree. In other words, we speculate that, because pain is perhaps more threatening and aversive than itch , it may signal a more vital threat to the person and thereby, from an evolutionary perspective (58 ), result in stronger learning . Further research into nocebo effects is needed, however, to reach a sufficient sample size for reliable comparison results between pain and itch .
The variability found in nocebo response magnitudes was not explained by differences between the type or intensity of pain or itch stimulation, and the length of conditioning . That the length of conditioning paradigms, during which learning of a negative association took place, is not related to the nocebo response is somewhat surprising but could be explained by learning reaching a ceiling effect in early conditioning trials or reaching a ceiling effect because of the strong role of verbal suggestions in such experimental studies. It is also possible that the length of conditioning becomes secondary because of other variations in paradigms, for example, shorter conditioning phases using longer exposure to conditioning cues and pain stimulations (9,41,43,46 ). It would be valuable for future research to explore whether a learning curve possibly takes place in nocebo conditioning , with the number of conditioning trials mattering up to a point, but after a certain threshold or as a result of strong preceding verbal suggestions, the number of trials could matter less over time.
A moderate dispersion of effect sizes across the studies analyzed is important to note, especially when the measures that are systematically reported in studies, such as the duration of learning or the intensity of pain , are unable to explain such variability in nocebo response magnitudes. The large differences in applied experimental models of nocebo effects (e.g., different types of verbal suggestions, whether the experiment was conducted in a hospital or university setting, or types of nocebo and conditioned stimuli presented), may explain some of this variability in results (11 ). Similarly to the efforts for aligning experimental paradigms in animal models of disease (59,60 ), it is essential for the field of nocebo to focus on replicating experimental paradigms and aligning paradigms according to ecologically valid models that yield comparable results across studies. For example, in the field of fear conditioning , one study reviewed the literature and summarized the methods and analyses commonly used for experimental fear induction and extinction, identifying the state-of-the-art in this domain and proposing methodological considerations for the design and analysis of such studies, aiming to set a methodological standard for experimental fear models and address the replicability crisis and inconsistency in methodological designs (61 ). Such an endeavor could be very valuable in the field of nocebo research, as this meta-analysis shows that methodological variations are all too common and compromise the comparability of results.
One of the most consistent differences between experimental nocebo studies seems to be the type of verbal suggestion delivered to participants. No two studies administered the same verbal suggestion. Different verbal suggestions could contain distinct emotional loads and be perceived as more or less threatening, which may in turn influence nocebo responses (21,25 ). Although beyond the scope and reach of the current meta-analysis, a future systematic review of distinct verbal suggestions, for example, using content analysis approaches borrowed from linguistics (62,63 ), could shed a light on how different verbal suggestions could impact nocebo responses. A method such as Natural Language Processing could be implemented by future research to help understand the specific valence of language included in verbal suggestions that leads to stronger nocebo responses and to identify the linguistic content of negative suggestions that are most potent and result in stronger and/or more persistent negative pain associations.
There are other variables that could explain variability of induced nocebo responses, such as sampling, demographics, and the inclusion criteria for participation, but a limitation is that these factors are not consistently reported in articles and could not be investigated in the current meta-analysis. In addition, studies do not systematically measure fear, which is shown repeatedly to be involved in nocebo responses (21,25,45,64,65 ). Other variables relevant to the emotional context of studies, such as the demeanor of the experimenter (66 ) or whether the experiment is set in an academic building or hospital, are also often not clearly documented and could not be analyzed here. Finally, RoB was low across all studies and showed no relationship to nocebo magnitudes. However, the assessment tool used for this meta-analysis is designed for quantitative sensory testing studies (33 ) but could have missed bias aspects, such as potential publication bias for significant results, which meta-analyses studies should consider addressing.
The growing field of nocebo research has begun to shed light on biobehavioral mechanisms that support the involvement of learning and expectations in the processing of sensory inputs such as pain and itch . A number of studies show that brain areas that are responsible for integrating prior experiences and the expectations formed regarding a particular treatment into sensory processing are involved in the aggravation of sensations such as pain (45,64,65 ). Particularly, results that implicated regions such as the anterior cingulate cortex and insula in learning nocebo associations suggest that a prominent difference between the perception of nocebo and control cues can be seen in brain areas that are thought to synthesize sensory perception based on beliefs and expectations (67,68 ). Past pain experiences, leading to negative expectations, have been shown to form differential expectations that influence pain processing (6,10,47,69 ). Similar mechanisms are thought to underlie the perception of pain in light of learned negative expectations (29 ). It is notable, however, that, although the present meta-analysis focused on studies that set out to induce explicit negative expectations regarding a particular (nocebo ) treatment, there is also extensive evidence that aggravated pain responses can result from subliminal conditioning on an unconscious level, in a phenomenon similar to conscious expectation of negative pain outcomes, but that is likely mediated by distinct subconscious mechanisms (70–72 ). In the studies included in this meta-analysis, there is little focus on explicitly measuring self-reported expectations: five studies measured participants’ expectations of pain increase at the start of the experiment (42,44,48,50,51 ), three studies measured expectations of overall pain increase at the end of the experiment (9,47,49 ), and three studies measured expectations within the experimental paradigm (6,39,40 ). In the field of nocebo effects on cutaneous sensations, it is now generally accepted that, whether consciously or subconsciously, nocebo responses are acquired as a result of prior negative experiences, leading to negative expectations. In line with a long line of research into learning that results from conditioning , as well as based on our current understanding of predictive processing—which is also a well-established mechanism by which past experiences and resulting expectations shape the way incoming stimuli are processed and perceived (73,74 )—it seems that nocebo responses may be induced by conscious expectations but could also be induced on a subconscious level that could not be captured through the measurement of self-reported expectations.
To date, the literature remains mixed and uncertain regarding the precise variables that may make particular nocebo induction methods, contexts, situations, or learning modes more potent, or the types of people that may be more susceptible to presenting nocebo effects on pain and itch . Future research should consider investigating individual differences in nocebo responding in a targeted manner, using sufficiently large sample sizes, and endeavoring to systematically compare experimental nocebo effects between different demographic groups, as well as between healthy participants and patient populations.
This systematic review and meta-analysis quantified magnitudes of nocebo responses on cutaneous sensations (pain and itch ) for distinct learning paradigms in experimental studies (classical conditioning with verbal suggestion, or verbal suggestion alone). We replicated previous findings that classical conditioning combined with negative verbal suggestions was strongest for inducing nocebo responses on pain . Meta-analyzing nocebo effects on itch is new and obtained small to moderate effects overall. Subset analyses indicated that factors related to the length of conditioning paradigms or intensity and type of sensory stimuli did not explain the moderate heterogeneity in nocebo effect sizes. This review provides a comprehensive summary of current findings in the field of nocebo research. We have ruled out some factors that were consistently reported in articles and could not explain the variability in results across studies, and we recommended some important directions for the field, such as increased consistency between study designs for inducing nocebo effects, as well as a systematic examination of the effects of different verbal suggestions on magnitudes of learned nocebo effects.
The authors would like to thank Barclay P. Wohlstetter and Elif S. Uyanik for their valuable assistance.
Source of Funding and Conflicts of Interest: The authors have no conflicts of interest to declare. This work was supported by a VICI grant awarded to A.W.M.E. by the Netherlands Organization for Scientific Research (NWO; 45316004).
REFERENCES
1. Barsky AJ. Nonspecific medication side effects and the
nocebo phenomenon. JAMA 2002;287:622–7.
2. Benedetti F, Lanotte M, Lopiano L, Colloca L. When words are painful: unraveling the mechanisms of the
nocebo effect. Neuroscience 2007;147:260–71.
3. Evers AWM, Peerdeman KJ, van Laarhoven AIM. What is new in the psychology of chronic
itch ? Exp Dermatol 2019;28:1442–7.
4. Bartels DJP, van Laarhoven AIM, Haverkamp EA, Wilder-Smith OH, Donders ART, van Middendorp H, et al. Role of
conditioning and verbal suggestion in placebo and
nocebo effects on
itch . PLoS One 2014;9:e91727.
5. Blythe J, Peerdeman K, Veldhuijzen D, van Schothorst M, Thomaidou M, Laarhoven A, et al.
Nocebo effects on cowhage-evoked
itch : a randomized controlled trial of classical
conditioning and observational
learning . Acta Derm Venereol 2021;101:adv00370.
6. Colagiuri B, Quinn VF, Colloca L.
Nocebo hyperalgesia , partial reinforcement, and extinction. J
Pain 2015;16:995–1004.
7. Colloca L, Sigaudo M, Benedetti F. The role of
learning in
nocebo and placebo effects.
Pain 2008;136:211–8.
8. Colloca L, Petrovic P, Wager TD, Ingvar M, Benedetti F. How the number of
learning trials affects placebo and
nocebo responses.
Pain 2010;151:430–9.
9. Thomaidou MA, Veldhuijzen DS, Peerdeman KJ, Wiebing NZS, Blythe JS, Evers AWM.
Learning mechanisms in
nocebo hyperalgesia : the role of
conditioning and extinction processes.
Pain 2020;161:1597–608.
10. Tu Y, Park J, Ahlfors SP, Khan S, Egorova N, Lang C, et al. A neural mechanism of direct and observational
conditioning for placebo and
nocebo responses. NeuroImage 2019;184:954–63.
11. Thomaidou MA, Peerdeman KJ, Koppeschaar MI, Evers AWM, Veldhuijzen DS. How negative experience influences the brain: a comprehensive review of the neurobiological underpinnings of
nocebo hyperalgesia . Front Neurosci 2021;15:652552. Available at:
https://www.frontiersin.org/article/10.3389/fnins.2021.652552 .
12. Blythe JS, Peerdeman KJ, Veldhuijzen DS, van Laarhoven AIM, Evers AWM. Placebo and
nocebo effects on
itch : a review of experimental methods.
Itch 2019;4:e27.
13. Taub CJ, Sturgeon JA, Johnson KA, Mackey SC, Darnall BD. Effects of a
pain catastrophizing induction on sensory testing in women with chronic low back
pain : a pilot study.
Pain Res Manag 2017;2017:1–10.
14. Madden VJ, Russek LN, Harvie DS, Vlaeyen JWS, Moseley GL. Classical
conditioning fails to elicit allodynia in an experimental study with healthy humans.
Pain Med 2016;pnw221.
15. Crettaz B, Marziniak M, Willeke P, Young P, Hellhammer D, Stumpf A, et al. Stress-induced allodynia—evidence of increased
pain sensitivity in healthy humans and patients with chronic
pain after experimentally induced psychosocial stress. PLoS One 2013;8:e69460.
16. Adamczyk WM, Buglewicz E, Szikszay TM, Luedtke K, Bąbel P. Reward for
pain :
hyperalgesia and allodynia induced by operant
conditioning : systematic review and meta-analysis. J
Pain 2019;20:861–75.
17. Weng L, van Laarhoven AIM, Peerdeman KJ, Evers AWM. Induction and generalization of
nocebo effects on
itch . Exp Dermatol 2022;31:878–89.
18. Papoiu ADP, Wang H, Coghill RC, Chan YH, Yosipovitch G. Contagious
itch in humans: a study of visual “transmission” of
itch in atopic dermatitis and healthy subjects. Br J Dermatol 2011;164:1299–303.
19. Benedetti F, Durando J, Vighetti S.
Nocebo and placebo modulation of hypobaric hypoxia headache involves the cyclooxygenase-prostaglandins pathway.
Pain 2014;155:921–8.
20. Hird EJ, Jones AKP, Talmi D, El-Deredy W. A comparison between the neural correlates of laser and electric
pain stimulation and their modulation by expectation. J Neurosci Methods 2018;293:117–27.
21. Thomaidou MA, Veldhuijzen DS, Meulders A, Evers AWM. An experimental investigation into the mediating role of
pain -related fear in boosting
nocebo hyperalgesia .
Pain 2021;162:287–99.
22. Stockhorst U. Classical
conditioning of endocrine effects. Curr Opin Psychiatry 2005;18.
23. Reicherts P, Gerdes ABM, Pauli P, Wieser MJ. Psychological placebo and
nocebo effects on
pain rely on expectation and previous experience. J
Pain 2016;17:203–14.
24. Bräscher AK, Witthöft M, Becker S. The underestimated significance of
conditioning in placebo hypoalgesia and
nocebo hyperalgesia .
Pain Res Manag 2018;2018:1–8.
25. Aslaksen PM, Lyby PS. Fear of
pain potentiates
nocebo hyperalgesia . J
Pain Res 2015;8:703–10.
26. Petersen GL, Finnerup NB, Colloca L, Amanzio M, Price DD, Jensen TS, et al. The magnitude of
nocebo effects in
pain : a meta-analysis.
Pain 2014;155:1426–34.
27. Vase L, Riley JL, Price DD. A comparison of placebo effects in clinical analgesic trials versus studies of placebo analgesia.
Pain 2002;99:443–52.
28. Bagarić B, Jokić-Begić N, Sangster Jokić C. The
nocebo effect: a review of contemporary experimental research. Int J Behav Med 2022;29:255–65.
29. Meeuwis SH, van Middendorp H, van Laarhoven AIM, van Leijenhorst C, Pacheco-Lopez G, Lavrijsen APM, et al. Placebo and
nocebo effects for
itch and
itch -related immune outcomes: a systematic review of animal and human studies. Neurosci Biobehav Rev 2020;113:325–37.
30. Yetman HE, Cox N, Adler SR, Hall KT, Stone VE. What do placebo and
nocebo effects have to do with health equity? The hidden toll of
nocebo effects on racial and ethnic minority patients in clinical care. Front Psychol 2021;12:788230. Available at:
https://www.frontiersin.org/articles/10.3389/fpsyg.2021.788230 .
31. Kong J, Gollub RL, Polich G, Kirsch I, LaViolette P, Vangel M, et al. A functional magnetic resonance imaging study on the neural mechanisms of hyperalgesic
nocebo effect. J Neurosci 2008;28:13354-13362–13354–62.
32. Pazzaglia C, Testani E, Giordano R, Padua L, Valeriani M. Expectation to feel more
pain disrupts the habituation of laser-
pain rating and laser-evoked potential amplitudes. Neuroscience 2016;333:244-251–244–51.
33. Marcuzzi A, Dean CM, Hush JM. Early changes in somatosensory function in spinal
pain : protocol for a systematic review. Syst Rev 2013;2:90.
34. R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2019. Available at:
http://www.r-project.org/ .
35. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000;56:455–63.
36. Hak T, van Rhee H, Suurmond R. How to Interpret Results of Meta-analysis. Rotterdam, the Netherlands: Erasmus Rotterdam Institute of Management; 2016:SSRN 3241367. Available at:
https://www.erim.eur.nl/research-support/meta-essentials/download/ .
37. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003;327:557–60.
38. Peerdeman KJ, van Laarhoven AIM, Keij SM, Vase L, Rovers MM, Peters ML, et al. Relieving patients’
pain with expectation interventions: a meta-analysis.
Pain 2016;157:1179–91.
39. Colagiuri B, Quinn VF. Autonomic arousal as a mechanism of the persistence of
nocebo hyperalgesia . J
Pain 2018;19:476–86.
40. Corsi N, Colloca L. Placebo and
nocebo effects: the advantage of measuring expectations and psychological factors. Front Psychol 2017;8:308. Available at:
https://www.frontiersin.org/article/10.3389/fpsyg.2017.00308 .
41. Feldhaus MH, Horing B, Sprenger C, Büchel C. Association of
nocebo hyperalgesia and basic somatosensory characteristics in a large cohort. Sci Rep 2021;11:762.
42. Freeman S, Yu R, Egorova N, Chen X, Kirsch I, Claggett B, et al. Distinct neural representations of placebo and
nocebo effects. Neuroimage 2015;112.
43. Geuter S, Buchel C. Facilitation of
pain in the human spinal cord by
nocebo treatment. J Neurosci 2013;33:13784-13790–13784–90.
44. Skvortsova A, Veldhuijzen DS, Van Middendorp H, Van den Bergh O, Evers AWM. Enhancing placebo effects in somatic symptoms through oxytocin. Psychosom Med 2018;80:353–60.
45. Tinnermann A, Geuter S, Sprenger C, Finsterbusch J, Büchel C. Interactions between brain and spinal cord mediate value effects in
nocebo hyperalgesia . Science 2017;358:105–8.
46. Weng L, Peerdeman K, Della Porta D, Laarhoven AIM, Evers A. Can placebo and
nocebo effects generalize within
pain modalities and across somatosensory sensations?
Pain 2022;163:548–59.
47. Albu S, Meagher MW. Expectation of
nocebo hyperalgesia affects EEG alpha-activity. Int J Psychophysiol 2016;109:147–52.
48. Aslaksen PM, Åsli O, Øvervoll M, Bjørkedal E.
Nocebo hyperalgesia and the startle response. Neuroscience 2016;339:599–607.
49. Camerone EM, Piedimonte A, Testa M, Wiech K, Vase L, Zamfira DA, et al. The effect of temporal information on placebo analgesia and
nocebo hyperalgesia . Psychosom Med 2021;83:43–50.
50. Van Laarhoven AIM, Vogelaar ML, Wilder-Smith O, Van Riel P, Van De Kerkhof P, Kraaimaat FW, et al. Induction of
nocebo and placebo effects on
itch and
pain by verbal suggestions
Pain 2011;152:1486–94.
51. Meeuwis SH, van Middendorp H, Lavrijsen APM, Veldhuijzen DS, Evers AWM. Open- and closed-label placebo and
nocebo suggestions about a sham transdermal patch. Psychosom Med 2021;83:33–42.
52. Badzińska J, Rubanets D, Wasylewski M, Honcharova S, Bajcar A, Bąbel P. The use of
learning processes to change placebo effects in
pain : a systematic review. 19th World Congress on
Pain 2022. Available at:
https://www.researchgate.net/publication/363730822_The_use_of_learning_processes_to_change_placebo_effects_in_pain_a_systematic_review .
53. Hróbjartsson A, Gøtzsche PC. Placebo interventions for all clinical conditions. Cochrane Database Syst Rev 2010;2010:CD003974.
54. Fullana MA, Harrison BJ, Soriano-Mas C, Vervliet B, Cardoner N, Àvila-Parcet A, et al. Neural signatures of human fear
conditioning : an updated and extended meta-analysis of fMRI studies. Molec Psychiatry 2016;21:500–8.
55. Boddez Y, Moors A, Mertens G, De Houwer J. Tackling fear: beyond associative memory activation as the only determinant of fear responding. Neurosci Biobehav Rev 2020;112:410–9.
56. Mechias ML, Etkin A, Kalisch R. A meta-analysis of instructed fear studies: Implications for conscious appraisal of threat. Neuroimage 2010;49:1760–8.
57. Kahneman D, Tversky A. The psychology of preferences. Sci Am 1982;246:160–73.
58. Ohman A, Mineka S. Fears, phobias, and preparedness: toward an evolved module of fear and fear
learning . Psychol Rev 2001;108:483–522.
59. Jones C, Watson D, Fone K. Animal models of schizophrenia. Br J Pharmacol 2011;164:1162–94.
60. Lu Y, Yin DM, Xiong WC, Mei L. Modeling schizophrenia in neuregulin 1 and ErbB4 mutant mice. In: O’Donnell P, editor. Animal Models of Schizophrenia and Related Disorders [Internet]. Totowa, NJ: Humana Press; 2011:261–77 (Neuromethods). doi:10.1007/978-1-61779-157-4_12.
61. Lonsdorf TB, Menz MM, Andreatta M, Fullana MA, Golkar A, Haaker J, et al. Don’t fear ‘fear
conditioning ’: methodological considerations for the design and analysis of studies on human fear acquisition, extinction, and return of fear. Neurosci Biobehav Rev 2017;77:247–85.
62. Ben-David BM, Moral MI, Namasivayam AK, Erel H, van Lieshout PHHM. Linguistic and emotional-valence characteristics of reading passages for clinical use and research. J Fluency Disord 2016;49:1–12.
63. Shaikh MAM, Prendinger H, Ishizuka M. Sentiment assessment of text by analyzing linguistic features and contextual valence assignment. Appl Artif Intell 2008;22:558–601.
64. Jensen K, Kaptchuk TJ, Chen X, Kirsch I, Ingvar M, Gollub RL, et al. A neural mechanism for nonconscious activation of conditioned placebo and
nocebo responses. Cereb Cortex 2015;25:3903–10.
65. Schmid J, Bingel U, Ritter C, Benson S, Schedlowski M, Gramsch C, et al. Neural underpinnings of
nocebo hyperalgesia in visceral
pain : a fMRI study in healthy volunteers. Neuroimage 2015;120:114-122–14–22.
66. Howe LC, Goyer JP, Crum AJ. Harnessing the placebo effect: exploring the influence of physician characteristics on placebo response. Health Psychol 2017;36:1074–82.
67. Lobanov OV, Zeidan F, McHaffie JG, Kraft RA, Coghill RC. From cue to meaning: brain mechanisms supporting the construction of expectations of
pain .
Pain 2014;155:129–36.
68. Zeidan F, Lobanov OV, Kraft RA, Coghill RC. Brain mechanisms supporting violated expectations of
pain .
Pain 2015;156:1772-1785–1772–85.
69. Benedetti F, Amanzio M, Vighetti S, Asteggiano G. The biochemical and neuroendocrine bases of the hyperalgesic
nocebo effect. J Neurosci 2006;26:12014–22.
70. Benedetti F, Pollo A, Lopiano L, Lanotte M, Vighetti S, Rainero I. Conscious expectation and unconscious
conditioning in analgesic, motor, and hormonal placebo/
nocebo responses. J Neurosci 2003;23:4315–23.
71. Egorova N, Yu R, Kaur N, Vangel M, Gollub RL, Dougherty DD, et al. Neuromodulation of conditioned placebo/
nocebo in heat
pain : anodal vs cathodal transcranial direct current stimulation to the right dorsolateral prefrontal cortex.
Pain 2015;156:1342-1347–1342–7.
72. Linnman C, Rougemont-Bücking A, Beucke JC, Zeffiro TA, Milad MR. Unconditioned responses and functional fear networks in human classical
conditioning . Behav Brain Res 2011;221:237–45.
73. Atlas LY, Bolger N, Lindquist MA, Wager TD. Brain mediators of predictive cue effects on perceived
pain . J Neurosci 2010;30:12964–77.
74. Walsh KS, McGovern DP, Clark A, O’Connell RG. Evaluating the neurophysiological evidence for predictive processing as a model of perception. Ann N Y Acad Sci 2020;1464:242–68.