Chronic pain is a substantial health care problem, leading to high socioeconomic and personal costs.1 In addition to physical disabilities, chronic pain is associated with high levels of emotional distress. Around half of chronic pain patients meet criteria for depression and even more experience depressed mood at a subclinical level.2–4 Teaching patients adaptive ways to cope with the debilitating effects of their condition is essential for successful pain management. Recently the adoption of positive psychology techniques in pain management programs for individuals with chronic pain has been advocated.5–7 Some current interventions for patients with chronic pain have already incorporated such a positive focus, for example, mindfulness-based techniques,8 Acceptance and Commitment Therapy,9 and Loving Kindness Meditation.10 However, there is so far only limited evidence for the usefulness of positive psychology self-help techniques in chronic pain management.
Positive psychology self-help exercises have been shown to increase well-being and decrease depressive symptoms in nonclinical populations as well as in patients with mild to moderate depressive symptoms.11,12 Preliminary evidence suggests that chronic pain patients might equally benefit from such a positive psychology self-help approach. Hausmann et al13 performed a secondary analysis of data from a previous randomized controlled trial (RCT) on the efficacy of positive psychology exercises offered through the internet to decrease depressive symptoms in self-help seeking individuals. For this secondary analysis they selected a subgroup of participants reporting mild to moderate pain at baseline. The positive psychology self-help exercises led to significant reductions in pain intensity 6 months after the intervention. More direct evidence for the usefulness of positive psychology exercises for chronic pain management was reported by Müller et al.14 These researchers examined the feasibility and efficacy of an internet-based positive psychology intervention (PPI) for people experiencing chronic pain secondary to physical disability. Feasibility and preliminary efficacy of the intervention was demonstrated by significant pretreatment to posttreatment improvements in pain intensity, pain control, pain interference, life satisfaction, and depression that were maintained up to 2.5 months after the intervention.
The present study sought to carry out the first large-scale RCT examining the efficacy of an internet-based positive psychology self-help intervention for patients with chronic pain. An 8-week internet-based program called “Happy Despite Pain” was developed, which consisted of 4 empirically validated positive psychology exercises. These exercises aimed at bolstering positive behaviors, emotions, and cognitions that have been found to be associated with better chronic pain adjustment, namely self-compassion, positive affect, and optimism. Self-compassion means responding to ones difficulties with kindness and compassion rather than self-criticism.15 Teaching patients to approach their experience in a self-compassionate way is suggested to promote resilient coping.16 Indeed, correlational studies have reported that chronic pain patients scoring higher on self-compassion are less disabled, have better mood, and catastrophize less about their pain.17 The second target component, positive affect, is also associated with increased adaptation to the challenges of chronic pain; frequent and sustained experiences of positive emotions predict adaptive recovery from pain and improve overall functioning.7 Finally, optimism seems to be one of the most important positive cognitions promoting adaptive coping with pain and counteracting pain catastrophizing.18–20 Although optimism is often seen as a trait characteristic, recently it was shown that optimism can be enhanced by positive imagery techniques21 and that this has implications for coping with pain.22,23
The purpose of the present study was to examine the efficacy of the “Happy Despite Pain” intervention to increase happiness and decrease depression and physical impairments in patients experiencing chronic musculoskeletal pain. Because it is desirable to compare the effects of new interventions with those of established ones, we set up a 3-armed trial in which we compared the new PPI with an internet-based cognitive-behavioral therapy (iCBT) intervention for chronic pain and a waitlist control condition. CBT is regarded as the golden standard for pain management24 and recent systematic reviews suggested that iCBT can be as effective as face-to-face CBT for the management of chronic pain.25,26 The iCBT intervention used in the current trail was shown to have beneficial effects for patients with chronic pain in 2 successive trials.27,28 We expected that both PPI and iCBT would lead to significant improvements in happiness, depression, and physical impairments compared with being on the waitlist. In addition, we examined sex and educational level as potential effect moderators.
MATERIALS AND METHODS
Recruitment took place from April 2012 until August 2012 through advertisements in national and local newspapers and magazines and through an announcement on the websites of the Dutch and Belgian Societies for Fibromyalgia patients. Individuals with fibromyalgia could apply by e-mail or through a link on a dedicated website. In total, >400 people showed an interest in the study and received further information, and 350 of these completed the application form. All applicants were contacted by phone for a screening interview. The interview covered details of the pain complaints, the diagnosis, and the inclusion and exclusion criteria. Inclusion criteria were: age above 18 years, having musculoskeletal pain for longer than 3 months, either generalized pain (ie, fibromyalgia) or localized in back, neck or shoulders, good command of Dutch, and having access to the internet. Exclusion criteria were: not being able to perform simple physical exercises, having a degenerative muscle diseases or a condition that could aggravate due to physical activity (eg, spinal stenosis), heart or vascular diseases, being diagnosed with psychiatric disorders in the past 3 months, pregnancy and having had psychological or multidisciplinary pain treatment in the past 3 months. Of the 350 applicants, 49 were excluded: 16 because they could not be reached and 33 because they did not fulfill inclusion criteria. The remaining 301 participants received an information letter together with the informed consent form and a questionnaire covering demographic information and pain history. Of the 301 eligible participants, 284 returned their informed consent and were subsequently randomized into either one of the treatments or waitlist condition (WLC).
Randomization was performed with a 2:2:1 ratio with an overrepresentation of participants in the 2 treatment conditions, and a set upper limit of 50 participants in the control condition. The reason for this unbalanced allocation was to increase power to detect potential differences in efficacy between the 2 treatments and to allow for moderator analyses (ie, which treatment works best for whom).29,30 To guarantee an equal distribution of sexes over the 3 conditions, male and female participants were randomized separately. Eight patients did not fill out the pretreatment measures, leaving a total of 276 participants in the study: 112 in the iCBT, 114 in the PPI, and 50 in the waiting list condition. In total, 70 participants (25.4%) dropped out in various weeks of the intervention period, resulting in 206 participants with completed posttreatment measures (80 in iCBT, 85 in PPI, and 41 in WLC). Follow-up assessment 6 months after completion of the program was only performed in patients participating in 1 of the 2 active treatments. We obtained data from 55 participants in the iCBT and 43 participants in the PPI condition, being 49% and 38% of the original sample, respectively. The flow of participants is shown in Figure 1.
The study took place between July 2012 and August 2013. Both treatment programs were delivered through the internet. Participants could access the site where the program was hosted through a username and password and a 6-digit security code that was provided to their mobile phone at every login. A short instruction movie on how to get started with the program was shown at the first login. Only after filling out the online pretreatment assessment, the actual treatment program became available. Both treatments consisted of 8 modules. In the first week, only the first module could be accessed. Exactly 1 week later, module 2 became available, again 1 week later module 3, etc. Seven weeks after participants had started with the first module, the complete treatment program was available to them. Mean duration of the intervention for intervention completers was 9.3 weeks (range, 7 to 16 wk), with no difference between the 2 interventions.
Both treatments had the same format, with each module providing online written information about the topic of that week and practical assignments. Assignments could either be completed online or in a workbook that was provided to participants at the start of the intervention. This workbook contained a summary of the online information and all of the assignments, allowing patients to complete these without the need to login. However, participants were explicitly told that the paper workbook was not a replacement for the internet program because the extended information was provided online only.
To promote adherence, telephone (weeks 1, 3, 5, and 7) and e-mail (weeks 2, 4, 6, and 8) support was provided by 5 graduate or recently graduated students in Psychology. Every participant had a single assistant assigned to them. All assistants guided participants in the iCBT as well as the PPI condition. The telephone calls were semistructured and covered participants’ efforts on the assignments of the previous weeks, possible problems, or questions regarding the modules. The average duration of the telephone calls was 15 to 20 minutes. Semistandardized e-mails were sent to participants in the weeks between the telephone contacts encouraging them to continue with the program and to share any problems they might have encountered. After participants had completed the program they were contacted one more time to thank them for their participation and to check whether they had completed their posttreatment measures or remind them to do so if they had not. Participant in the iCBT and PPI condition were contacted 6 months after completion of the program by e-mail or telephone and requested to fill in the long-term follow-up assessment.
In the WLC participants were initially only given access to the online pretreatment questionnaires. After an 8-week waiting period, participants were contacted and asked to complete the postmeasurements. After completion, they could start with the treatment program of their choice (iCBT or PPI). No further data were obtained from these patients after completion of the program and no support was provided during the intervention period, except for assistance in case of technical problems.
The iCBT Intervention
The iCBT treatment program was based on the program developed and previously tested in Sweden.27 The usefulness of this program for patients with chronic pain has been established in previous research.27,28 The main purpose of the program was to teach participants more active ways of coping with their pain and to improve their level of functioning. The original Swedish texts were translated in Dutch and slightly adapted to Dutch culture. The program consisted of 7 modules teaching applied relaxation, stretching exercises, cognitive restructuring, and coping techniques. In module 2, 3, and 4 bodyscan exercises were provided, in text and in mp3 format, and could be downloaded. In the eighth module participants made a relapse prevention plan, that is, how to continue with the strategies they had learned. The weekly components of the iCBT program are presented in Table 1. More information on the various components and structure of the program can be found in Buhrman et al.27
Happy Despite Pain: An Internet PPI
The main purpose of the PPI intervention was to promote positive behaviors, emotions, and cognitions. The content of the internet PPI program was based on a literature review of evidence-based positive psychology exercises and specifically targeted self-compassion, positive emotions, and optimism. The intervention had a gradual build-up, starting with simple exercises, and gradually working toward more complex and cognitively effortful exercises. The program started with self-compassion exercises (week, 1 to 2) to teach participants to become more self-reliant when dealing with the emotional consequences of their condition. Exercises in these first 2 modules involved becoming aware of one’s suffering and self-criticism, keeping a self-compassion diary, using a self-compassion mantra and writing a self-compassion letter to oneself.31 During the next week, the “Three Good Things” exercise was practiced with the aim to raise awareness for the good things in life and to shift the focus from a negative orientation toward a more positive one. This is one of the most frequently used and best tested exercises within positive psychology and consists of writing down 3 good things that went well that day, and why they went well.12 During the next 2 weeks participants were taught savoring techniques, with the aim to increase the frequency and intensity of positive experiences in daily life. These modules involved several exercises: being aware of small daily pleasures, planning pleasant activities, engaging in pleasant reminiscence, and keeping a savoring diary.32 Week 6 and 7 were devoted to increasing optimism for the future by means of writing about and imagining the “Best Possible Self”.21 The Best Possible Self exercise was adapted to patients with pain in that they were instructed to imagine a good life in the future despite their pain. Patients selected 3 domains for their visualization in week 6 from a list of 7 life domains (family life, romantic life, social life, professional life, leisure and hobby, educational life, societal commitment, and personal growth) and formulated future goals and ideals for each of these domains. Next, they wrote a more detailed narrative of how their ideal future in these domains would look like. Each day they visualized this future in 1 of the 3 domains. In week 7 patients choose 3 new life domains and continued the exercise with these new domains. In week 8 participants made a plan for the future, what exercises they wanted to continue using, and when and how. The aim was to prevent relapse. The weekly components of the PPI program are presented in Table 1.
A slightly different (face-to-face) version of the intervention was piloted in 6 patients with chronic pain, after which it was adapted and again piloted in 5 additional patients with chronic pain. The program was found feasible and potentially useful.33
All pretreatment and postintervention and follow-up questionnaires were delivered via the internet. At all 3 timepoints the same set of questionnaires were provided. We assessed different indices of mental and physical well-being, namely happiness, depression, anxiety, physical impairments, and pain intensity. In addition, variables that were targeted by one or both of the interventions were assessed: self-compassion, positive and negative affect, optimism, flexible goal adjustment (FGA), pain catastrophizing, perseverative thinking, helplessness, acceptance, and disease benefits. Because of the large number of dependent variables being examined we defined 3 primary outcomes, happiness and depression as indicators of respectively positive and negative mental well-being and physical impairments as indicator of physical well-being. All other dependent variables were considered secondary outcomes.
Depression was measured with the Hospital Anxiety and Depression Scale (HADS34). The HADS consists of 14 items, 7 of which assess depressive symptoms, the other 7 assess anxiety symptoms. Items are rated on a 4-point scale ranging from 0 to 3. The total depression score is obtained by summing the scores of the 7 relevant items and ranges from 0 to 21. Cronbach α in the present study was 0.79 at pretest and 0.80 for the post and follow-up assessments. Happiness was measured with 1 item, and assessed the feelings of happiness/unhappiness at the present moment. A 6-point scale was used with the following verbal labels: 1, very unhappy; 2, unhappy; 3, more unhappy then happy; 4, more happy then unhappy; 5, happy; 6, very happy. Measuring happiness by single-item questions has been found reliable and valid.35 Physical impairments were assessed by means of the Fibromyalgia Impact Questionnaire (FIQ).36 The FIQ has 11 physical impairment items which inquire about the ability to independently perform daily physical activities (eg, vacuum cleaning, preparing meals, visiting family). Each item is rated from 0 (always) to 3 (never). Nine of these items were used to assess physical impairment in the present study. Two items inquiring about the ability to drive a car and to work in the garden were excluded from the total score because these items were not relevant for all participants. The sum score of the 9 items was calculated, thus ranging from 0 to 27. Cronbach α in the present study was 0.87 at pretest and 0.88 for the post and follow-up assessments.
Anxiety was measured with the 7 anxiety items of the HADS (see above). Scores can range from 0 to 21. Cronbach αs in the present sample ranged from 0.83 to 0.85. Pain intensity was measured by the item “At this moment, how much pain do you experience,” scored from 0 to 10. Self-compassion was measured with the 12-item short form of the Self-Compassion Scale (SCS-SF).37 The SCS-SF measures the 3 main components of self-compassion: self-kindness, common humanity, and mindfulness. Responses are given on a 7- point scale ranging from 1 (almost never) to 7 (almost always) and a total score was calculated (range, 7 to 84; Cronbach αs, 0.88 to 0.89). Positive and negative mood were assessed with the Brief Mood Introspection Scale (BMIS).38 The BMIS consists of 8 positive and 8 negative mood descriptors that are rated on a 10-point scale. Cronbach αs range from 0.84 to 0.88 for both subscales. Optimism was measured by the Life Orientation Test-revised (LOT-R).39 The LOT-R consists of 10 items; 3 positively phrased, 3 negatively phrased, and 4 filler items. All items are rated on a 5-point scale, ranging from 1 to 5. A total optimism score is calculated by summing the scores of the 3 positive phrased items plus the reversed scores of the 3 negative phrased items (range, 6 to 30; Cronbach αs, 0.76 to 0.87).
FGA was measured using the scale developed by Brandtstädter and Renner.40 The FGA scale consists of 15 items measuring the tendency to flexibly select new goals when the original goal becomes blocked. Items are scored from 0 (=not agree at all) to 4 (=totally agree). Cronbach αs ranged from 0.82 to 0.85. Pain catastrophizing was measured with the Pain Catastrophizing Scale (PCS).41 The PCS consists of 13 items reflecting catastrophic thoughts about pain. Items are rated on a 5-point scale ranging from 0 to 4. The total PCS score is obtained by summing the scores of all items, and can range from 0 to 52 (Cronbach αs, 0.92 to 0.93). The Perseverative Thinking Questionnaire (PTQ42) was used to assess repetitive thinking. The PTQ consists of 15 statements assessing ruminative and intrusive thoughts that are scored on a 5-point scale (0, never; 4, almost always). Cronbach α was 0.96 at all 3 assessment times. The Illness Coping Questionnaire (ICQ43) was used to measure helplessness, acceptance, and disease benefits. The ICQ consists of 18 items that are scored on a 4-point scale (1 to 4). Six items assess helplessness, 6 acceptance, and 6 disease benefits. Item scores per subscale are summed to obtain scores for the 3 different coping styles (range, 6 to 24). Cronbach αs ranged from 0.82 to 0.88 for helplessness,0.87 to 0.91 for acceptance, and 0.85 to 0.88 for disease benefits.
Statistical analyses were performed with SPSS version 24. Intention-to-treat analyses were performed by means of mixed linear regression analysis per outcome variable, which includes all patients who started with the intervention, and which does not require imputation of missing data. Condition (iCBT, PPI, WLC) was the between-subject factor, and time of measurement the within-subject factor. The effect of interest was the condition by time interaction. We assumed an unstructured covariance matrix for the repeated measures of the outcome variable at hand, which is the most general structure. As patients in the WLC condition did not provide 6-month follow-up data, the difference in the immediate posttreatment effects between all 3 conditions and the difference in long-term effects between the 2 active treatment conditions were tested in separate regression models. In the first set of regression models condition had 3 levels, iCBT versus PPI versus WLC (reference group), and time had 2 levels, baseline (reference timepoint) versus posttreatment. In the second set of regression models condition had 2 levels, iCBT versus PPI, and time had 3 levels, baseline versus posttreatment versus follow-up. In all models, adjustments for age, sex, and educational level were made. Two dummies were created for education (medium vs. low; high vs. low). For each outcome, we checked normality and homogeneity of variance of the residuals as well as the absence of outliers or influential cases. An α of 0.05 was used to establish significance for the primary dependent variables, and 0.01 for the secondary variables. For all outcomes effect sizes together with their 95% confidence interval are reported. The effect size was computed as the regression weight of the condition by time interaction term divided by the residual outcome variance at that timepoint, for instance the regression weight of the iCBT dummy by posttest dummy interaction divided by the residual outcome variance at posttest. This measure can be interpreted as Cohen d corrected for the covariates in the model (Cima et al44).
In a further set of analyses, to establish whether the effects of the intervention (PPI vs. iCBT) were moderated by sex or educational level, the relevant interaction terms were added to the model. For testing moderation by sex the following terms were added: condition by sex, time by sex, and condition by time by sex (using dummy coding for condition, time, and sex). For testing moderation by education we added the following terms: condition by educational level, time by educational level, condition by time by educational level, again using dummy coding. Moderation is reflected by the 3-way interaction, which was tested with a likelihood ratio (LR) test of the model with, versus the model without, the 3-way interaction. Maximum Likelihood estimation was used to allow LR testing.45 An α of 0.05 was used for the 3 primary outcomes, and an α of 0.01 for the secondary outcomes. If moderation was found, then the condition effect was tested per level of the moderator.
To assess the clinical relevance of the interventions we used the HADS. The authors of the HADS propose a cut-off score of 11 to define cases of anxiety/depression and scores of 8 to 10 as doubtful cases. Scores below 8 denote noncaseness.34 The difference in the number of patients scoring 8 or higher (ie, indicating [doubtful] caseness) at postintervention and follow-up was tested by means of mixed logistic regression analysis with condition as between-subject factor, time of measurement as within-subject factor (reference: baseline), and age, sex, and educational level as covariates, using the same modeling procedure as for the continuous HADS score.
Patient characteristics and baseline data are displayed in Table 2. Mean age of patients was 48.6 years (SD=12.0) and mean pain duration was 12.8 years (SD=10.1). In total, 85% of the sample was female and two third suffered from fibromyalgia. There were no significant differences between the 3 conditions in patient characteristics except for education (χ2=10.4; P=0.035) and sick leave (χ2=6.4; P=0.040). Patients in the iCBT condition were less likely to have an educational level in the medium category compared with the other treatment groups, and reported less sick leave compared with WLC. Significant differences on the pretreatment assessment of primary and secondary outcome variables occurred for anxiety (F2,274=3.22, P=0.042) and benefit finding (F2,273=5.36, P=0.005). Post hoc testing indicated that for anxiety the difference was between iCBT and WLC, and for disease benefits between both iCBT and PPI versus WLC. These differences are controlled for because they are included as a repeated measure in the analyses. Furthermore, as expected given the randomized treatment assignment, none of the baseline group differences reported here was significant after Bonferroni correction for multiple testing.
To analyze predictors of dropout, we distinguished between dropout before posttreatment assessment (all 3 conditions) and dropout before follow-up assessment (excluding the WLC group). For each of the 2 dropout measures, logistic regression analysis were carried out using condition and all baseline variables as predictors. Dropout before posttreatment assessment did not differ between the conditions nor was it predicted by any baseline characteristic (all Ps>0.260). Dropout before follow-up assessment was also unrelated to condition (iCBT vs. PPI) and baseline characteristics, although there was a trend that older people (P=0.058) and higher educated people (P=0.078) more often provided follow-up data (all other Ps>0.136). Age and education were included as covariates.
Primary Outcome Variables
Table 3 displays the means of the primary and secondary outcome variables for the 3 conditions at each timepoint. Table 4 shows the results of the mixed regression models for the posttreatment analyses of the primary outcomes. Significant differences between iCBT and WLC and between PPI and WLC were found at posttreatment for the primary outcome variables happiness and depression. Both interventions led to a significant increase in happiness and a significant decrease in depression immediately posttreatment as compared with WLC. PPI led to a somewhat larger increase in happiness than iCBT, and this difference at posttreatment just attained significant at the level of P=0.05. Table 5 shows the results of the follow-up analyses. Because the WLC did not have a follow-up assessment, only iCBT and PPI were compared. There were no differences between the 2 treatments at 6-month follow-up, neither for depression nor for happiness.
Figs. 2, 3 show the time course of happiness and depression per condition based on predicted outcome values from the mixed regression analyses. As can be seen from the figures, the improvements in depression and happiness were largely maintained at 6-month follow-up. Multilevel regression analysis within conditions showed that levels of depression and happiness at 6 months were still significantly different from the pretreatment assessment in both treatment conditions. Rerunning the model with posttreatment as the reference timepoint indicated that depression showed a slight but significant increase from posttreatment to follow-up in the iCBT condition only (B[SE]=0.64[0.29]; P=0.034). Both conditions showed a slight decrease in happiness from posttreatment to follow-up, and this change was significant within the PPI group (B[SE]=0.25[0.11]; P=0.032).
The third primary outcome, physical impairments, did not show a significant time by condition interaction at posttreatment. There was a significant decrease in physical impairments at posttreatment in the 2 active treatment conditions, but this did not differ significantly from the decrease in the WLC. Also PPI and iCBT did not differ from each other at follow-up.
Secondary Outcome Variables
Results of the mixed regression analyses for secondary outcomes are displayed in Supplementary tables S1 (Supplemental Digital Content 1, http://links.lww.com/CJP/A427) and S2 (Supplemental Digital Content 2, http://links.lww.com/CJP/A428). Significant differences were found at posttreatment between iCBT and WLC, and between PPI and WLC for anxiety, positive and negative affect, self-compassion, optimism, FGA, pain catastrophizing, acceptance, disease benefits, and helplessness (all in the expected direction). The iCBT condition additionally led to a significant increase in disease benefits compared with WLC. There were no significant differences at posttreatment or follow-up between iCBT and PPI for any of the secondary outcomes. All improvements were maintained until 6-month follow-up as shown by the within condition mixed regression analyses. The change from baseline to 6-month follow-up assessments was still significant and there were no significant change from posttreatment to follow-up.
For pain intensity and perseverative thinking no significant time, condition, or time by condition effects were found at posttreatment or follow-up.
Moderation by Sex and Educational Level
Moderation by sex was tested by testing the condition by time by sex interaction in each of the 2 sets of analyses, the one with the WLC group and without the follow-up, and the one without the WLC and with the follow-up (for details of the moderation models, see the Statistical analyses part of the Materials and Methods section). No moderation by sex was found for any of the primary or secondary outcome variable (P>0.05 for all LR tests of the 3-way interaction on primary outcomes, P>0.01 for all secondary outcomes).
Moderation by educational level was tested by adding the condition by time by education interaction to the model, with education as an ordinal covariate instead of with dummy coding to improve power (LR tests of the model with education via dummy coding versus the model with education as a covariate supported the latter simplification, P>0.05 for both outcomes and both analyses, with and without the WLC). Moderation by education was found for 2 of the 3 primary outcomes. For depression, the LR test showed a condition by time by education interaction in the analysis including the WLC and excluding the follow-up (χ2=8.44; df=2; P=0.019) and also in the analysis excluding the WLC and including the follow-up (χ2=6.43; df=2; P=0.040). Simple effect analyses per educational level showed 2 things. First, both iCBT and PPI were significantly more effective than WLC at posttest for each educational level, although the effect was largest for low education, and smallest for high education. Second, for low and medium educational level, iCBT and PPI did not significantly differ from each other either at posttest or at follow-up, but for higher educated patients, PPI was more effective than iCBT (B[SE]=−1.22[0.61]; P=0.049 at postintervention and (B[SE]=−1.35[0.63]; P=0.035 at follow-up). The predicted outcome values for depression over time per education group are shown in Figure 4.
Also for happiness there was a significant condition by education interaction in both analyses, the one with the WLC group without the follow-up (χ2=8.81; P=0.012) and the one without the WLC group with the follow-up (χ2=6.13; P=0.047). Simple effect analyses within the 3 educational groups showed again 2 things. First, iCBT and PPI were both more effective than WLC at posttest for each educational level, albeit not significantly for iCBT in the high education subgroup, and the effect was again largest for low education and smallest for high education. Second, for low and medium educational level, iCBT and PPI did not significantly differ from each other either at posttest or at follow-up, but for highly educated patients PPI was more effective than iCBT at postintervention (B[SE]=0.51[0.16]; P=0.002) and follow-up (B[SE]=0.55 [0.25]; P=0.029). Figure 5 shows the predicted values for happiness over time per education group.
The treatment effect on the third primary outcome, physical impairment, was not moderated by education level. Using P>0.01 for the secondary outcome variables did not indicate a significant moderation effect for these variables either. Positive affect did show a trend toward moderation both for the comparison using the WLC group without the follow-up (χ2=7.52; P=0.023) and the comparison without the WLC group with the follow-up (χ2=7.28; P=0.026). However, simple effect analyses within the 3 educational groups did not indicate any differences between the 2 active conditions.
Figures 6 and 7 show the percentage of cases, doubtful cases, and noncases for depression and anxiety per condition at pretreatment and posttreatment. For the PPI and iCBT condition also the percentages at 6-month follow-up are displayed. As can be seen from the figures the percentage of (doubtful) cases of depression and anxiety remained approximately the same in WLC, whereas there was a clear decrease in both PPI and iCBT postintervention, which remained stable until 6-month follow-up. For depression, the percentage of (doubtful) cases decreased by 54% after PPI and by 50% after iCBT at postintervention. For anxiety the decrease in (doubtful) cases was 42% for PPI and 43% for iCBT.
Differences in the number of (doubtful) cases for depression and anxiety between the 3 conditions postintervention and between iCBT and PPI at follow-up were tested by means of mixed logistic regression analysis. It should be noted that whereas percentages displayed in the figures are based on a variable number of participants at various timepoints, the mixed logistic regression analyses take all participants with a baseline assessment into account. The results of the mixed regression showed that at postintervention, the decrease in number of (doubtful) depression cases was significantly stronger after PPI (B=−1.12[0.37]; P=0.003) and iCBT (B=−1.10[0.39]; P=0.005) than after WLC. The decrease did not differ between PPI and iCBT, either at postintervention or at follow-up. Similarly for anxiety, the decrease in (doubtful) caseness was significantly stronger after PPI (B=−1.15[0.40]; P=0.004) and iCBT (B=−1.38[0.40]; P=0.001) than after WLC, with no difference between the 2 active conditions.
This study sought to evaluate the efficacy of an internet-based PPI for patients with chronic musculoskeletal pain by comparing its effect with that of an existing iCBT intervention and a WLC. The results show that the newly developed PPI had a significant effect on 2 of our primary outcomes, namely depression and happiness. There was no significant difference with the iCBT condition but compared with the WLC, effect sizes were large across both active interventions. Significant posttreatment and follow-up effects were also obtained for most of the secondary outcomes, namely anxiety, positive and negative affect, self-compassion, optimism, either “flexible goal adjustment” of “FGA”, pain catastrophizing, helplessness, and pain acceptance, with medium effect sizes compared with the WLC at posttreatment. Beneficial effects for primary and secondary outcomes were maintained at 6-month follow-up. However, PPI nor iCBT led to a significant decrease in physical impairments, our third primary outcome, compared with the WLC.
Positive psychology exercises have been found effective in decreasing depressive feelings and increasing happiness in community samples as well as in people with mild to moderate depression.11,12 Their usefulness for relieving suffering in chronic pain patients has so far received scarce attention, despite theoretical accounts proposing the added value of interventions specifically focusing on increasing positive states and traits.5,7 To our knowledge there is only 1 previous RCT examining the effects of positive psychology exercises in patients with chronic pain.14 This study found that a package of 4 individually tailored exercises led to decreases in pain intensity, depression, pain interference and pain catastrophizing and increased life satisfaction, positive affect and pain control, with small to moderate effect sizes. Most benefits remained until 2.5-month follow-up. However, for many of the outcomes the control group showed similar benefits and at follow-up there were no longer significant differences between the groups. Because there might have been an active ingredient in the control condition as well (ie, journaling about daily activities), the results were somewhat difficult to interpret. Nevertheless as this was primarily a feasibility and acceptability study, the study did show that internet-based PPIs have potential. This potential is further underlined by the present study.
In addition to the self-help exercises used in the present study and the previous study by Müller, other interventions that can be situated within the domain of positive psychology have been examined for their efficacy in helping people to cope with chronic pain. Examples are solution-focused therapy,46 Loving Kindness Meditation,10 and a mindfulness-based program complemented with principles from positive psychology (eg, savoring).47 These interventions have also been found helpful, although for each of these interventions there is only preliminary evidence from small scale or pilot studies. Our study is the largest RCT so far on the usefulness of positive psychology techniques for chronic pain. Moreover, in contrast to the interventions described above which included group sessions led by a therapist, our program was based on self-help exercises. The absence of therapist involvement may greatly increase accessibility and dissemination potential. It should be noted that in the current trial psychology students provided assistance and encouragement to reduce dropout, but refrained from any therapeutic intervention. The trade-off of the large dissemination potential of internet interventions are the usually high attrition rates.48 Previous studies reported that PPIs may be more engaging and fun and therefore may have better retention than internet interventions using a more traditional approach (eg, CBT49,50), but we did not see this in the current trial. Telephone, internet, or e-mail guidance can improve adherence,51 but may make large-scale dissemination less feasible. Automated guidance or user platforms could be one solution.
Although the internet-based PPIs was effective and yielded relatively large effects sizes it was not more efficacious than the iCBT intervention. A small advantage was found for PPI compared with iCBT on increases in happiness immediately posttreatment, but at 6-month follow-up this advantage had disappeared. This finding is very similar to what has been found in other RCTs comparing different interventions for chronic pain. For instance, a recent large trial comparing mindfulness-based stress reduction (MBSR) with CBT and treatment as usual found no significant differences in effectiveness between MBSR and CBT, although both were associated with greater improvement in back pain and functional limitations compared with treatment as usual.52 In addition, meta-analysis has shown that mindfulness-based interventions and Acceptance and Commitment Therapy are equally effective in lowering depression and anxiety in chronic pain, with effect sizes comparable with those after CBT.53
Interestingly, the effects of the iCBT intervention seemed to be more extensive and affected a larger range of outcomes than what was found in previous studies using this intervention.27,28 Whereas the previous studies mainly found an effect on pain catastrophizing, with no decrease in depression, the present study did find large and clinically significant effects on depression. What exactly underlies this apparently increased efficacy is unknown. Although some of the texts were slightly adapted, the content was basically the same.
Neither intervention significantly decreased physical impairments or pain intensity. The absence of an effect of a psychological intervention on pain intensity is a common finding.54 Most interventions, including the present one, aim to improve functioning and quality of life and decrease distress, but are not directly targeting pain reductions. Decreased disability has been reported after psychological interventions, although this effect often seems short-lived.54 We used 9 items from the FIQ to measure physical impairments, which basically assesses the ability to perform large muscle tasks. It might be speculated that our interventions not so much affected functional abilities itself, but rather the motivation to engage in these activities. This may be better captured by interference measures such as the pain interference scale of the BPI55 or the PROMIS interference items.56
Comparison of the 2 active interventions suggested a slight advantage of PPI over iCBT for the primary outcomes in patients with a higher education. For patients with a lower or medium education level the difference between the PPI and iCBT condition did not reach significance but this might have resulted from lower power for these comparisons because of a smaller number of patients in low and intermediate education groups. The raw data and graphs suggest that for lower educated patients the iCBT intervention might have been more effective. In fact, the posttreatment change scores indicated that for PPI the decrease in depression and the increase in happiness became larger as a function of the level of education, whereas the opposite was seen for iCBT. The positive psychology exercises may require a certain level of cognitive and intellectual functioning to be able to maximally engage in and optimally profit from the exercises. Many previous studies showing the efficacy of positive psychology exercises have been performed in university students. Interestingly, a recent study found that participants scoring higher on intelligence reported stronger increases in happiness after a PPI.57 The iCBT exercises may have required less cognitive and intellectual abilities because they were more concrete and written in plain language. This may have been advantageous for lower educated people, but patients with a higher education might have become annoyed by the somewhat overly simple language that we noticed when translating the texts. Because education effects were not a priori predicted, results should be viewed with caution and future studies should confirm whether indeed positive psychology self-help exercises are most useful for people with higher educational levels.
The PPI consisted of 4 different exercises. These exercises were selected on the basis of available evidence for their efficacy in inducing positive states in various populations. Specifically, the exercises targeted self-compassion, positive affect and optimism, all of which have been associated with better chronic pain coping.7,17–19 The intervention had the intended effect, and significantly increased self-compassion, positive affect, and optimism, both at posttreatment and at follow-up. However, as similar increases in these variables were found after iCBT, the mechanisms underlying both interventions may be less specific than assumed. Indeed, the distinctiveness of the pathways along which different pain treatments achieve their gains has recently been challenged.58,59 Even though CBT, MBSR, and acceptance and commitment therapy originate from different theoretical conceptualizations they seem to act through shared underlying mechanisms. Because the content and targets of our PPI were quite different from other pain interventions, that is, none of the exercises in PPI specifically addressed pain, we did expect to find differences between PPI and iCBT on the process variables. Future analyses of the weekly data that were also collected may possibly reveal differences in the timing and trajectories of the various process variables. Nevertheless it cannot be excluded that also PPI acts upon the same underlying mechanisms as interventions that are more pain focused.
Although the choice of exercises in the PPI was theory-driven, we do not know whether the selection and duration (1 or 2 weeks) of these exercises, and the sequence of the modules were optimal. Our design does not allow assessing the effectiveness of each exercise separately, or whether all 4 exercises are necessary and contribute to outcome. Programs offering a variety of positive exercises have been advocated as being more beneficial than single exercises, although there may be a limit to this.49 A study comparing the efficacy of a 6-week program consisting of 2, 4, or 6 different positive psychology exercises suggested that a program with 4 exercises was most efficacious in decreasing depressive symptoms, and that efficacy declined when participants were given a new exercise every week.60 Future trials could confirm the added value of each of the individual exercises by using a dismantling technique, systematically leaving 1 exercise out.
The study also had some limitations. First, there was a considerable dropout. Around 25% of the patients across the 3 conditions did not provide posttreatment data. Dropout at follow-up was on an average 55% for the 2 conditions. Although dropout analyses did not indicate systematic differences between patients providing posttreatment and/or follow-up data and those that did not, and although the mixed regression analyses takes all available data into account, some influence on the results cannot be excluded. Second, because patients in the control group were allowed to commence treatment after the 8-week waiting period, we could not examine long-term effect in comparison with the control condition. Analyses within the treatment groups indicated, however, that the beneficial effects were largely maintained until 6-month follow-up. Third, patients responded to announcements on a patient website or advertisement in newspapers and thus were self-selected to participate in an internet intervention. Moreover, patients not being able to perform simple exercises, those with degenerative muscle, heart or vascular diseases and patients with psychiatric conditions or recent psychological treatment were excluded. It is not known how well the results will generalize to patients in other settings or with more severe conditions and comorbidities. Finally we have no data regarding the frequency and intensity with which patients engaged in the exercises, and whether patients providing posttreatment data actually completed all modules. Future studies should try to gain more insight in the amount of time actually spent exercising to examine a dose-response relationship.
This study has important clinical implications. The efficacy of a positive psychology internet intervention to decrease distress and increase mental well-being in patients with chronic pain could be demonstrated in self-selected patients completing the course. Effect sizes were moderate to large and the beneficial effects were maintained until 6 months later. The effects in the current trail also seemed to be clinically relevant. The number of (doubtful) cases of depression was substantially reduced. Comorbid depression is a considerable problem in patients with chronic pain, with typical prevalence rates of 30% to 50%. Pain management is less successful in patients with comorbid depression,61,62 and the presence of depression has been related to increased suicide risk in patients with chronic pain.63 Hence, depression is an important target for treatment. Moreover, the intervention not only reduced depression and other negative emotional states, it also significantly increased happiness. This increase seemed to be quite substantial in terms of the percentage of patients reporting being “happy” or “very happy.” At baseline 23% of patients reported to feel (very) happy and this increased to 58% immediately postintervention and to 49% at 6-month follow-up. In combination with the significant improvements that were found on the other positive state and trait variables (ie, acceptance, disease benefits, and optimism), this suggests that positive psychology internet intervention can promote positive well-being in patients with chronic pain.
Can an internet-based positive psychology self-help intervention be recommended as stand-alone treatment for chronic pain? Programs such as these, delivered over the internet with minimal guidance, have the advantage of high accessibility at low costs. Thereby large numbers of pain patients can potentially be reached, also patients who otherwise would be unable or reluctant to seek treatment. Consequently, even moderate effects may have a large societal impact. Nevertheless, benefits were mostly restricted to the affective domain, leaving pain intensity and functioning unaffected. As these are also important outcomes for patients and other interventions have been shown to be able to increase functional capacity and to a lesser extend decrease pain intensity, one could argue that the PPI intervention could best be used as an add-on to existing treatment instead of a stand-alone intervention. Because alleviating affective symptoms might be the key to successful pain rehabilitation,61,62 addressing these with PPI before entering a pain management program might increase its effectivity. Preliminary evidence has shown that adding an emotion regulation intervention to exposure-based treatment for chronic pain led to more prominent improvements in pain and disability compared with “standard” exposure treatment for chronic pain.64 Another interesting possibility is that using PPI in adjunct to other treatments could prevent relapse through empowerment of patients. Future studies should examine whether adding PPI to existing pain management programs could indeed increase their effectivity and reinforce long-term efficacy.
Another aspect that should be further examined is who profits most from an internet PPI, and who will be better off with iCBT. The present study already hinted to an effect of education. Another moderator might be preference of the individual. For some, positive psychology may be too vague or controversial, whereas others may be particularly attracted to this fresh approach that recently has become popular. Thus PPI might be better for some patients than for others, be it as a stand-alone or an add-on intervention. For clinicians, being acquainted with PPI techniques will provide them with a larger tool box which they can apply as adjunct treatment, or offer to their patients as empowerment strategy before treatment or afterwards to prevent relapse.
In conclusion, the newly developed PPI as well as more traditional CBT each have potential for self-management of chronic pain. Future research should identify whether combining it with established pain treatment approaches has additional benefit.
1. Breivik H, Eisenberg E, O’Brien T. The individual and societal burden of chronic pain
in Europe: the case for strategic prioritisation and action to improve knowledge and availability of appropriate care. BMC Pub Health. 2013;13:1229.
2. Bair MJ, Robinson RL, Katon W, et al. Depression and pain comorbidity: a literature review. Arch Intern Med. 2003;163:2433–2445.
3. Clyde Z, Williams ACLinton SJ. Depression and mood. New Avenues for the Prevention of Chronic Musculoskeletal Pain and Disability. Amsterdam: Elsevier; 2002:105–121.
4. Linton SJ, Bergbom S. Understanding the link between depression and pain. Scand J Pain. 2011;2:47–54.
5. Finan PH, Garland EL. The role of positive affect in pain and its treatment. Clin J Pain. 2015;31:177–187.
6. Keefe FJ, Wren AA. Optimism and pain: a positive move forward. Pain. 2013;154:7–8.
7. Ong AD, Zautra AJ, Reid MC. Chronic pain
and the adaptive significance of positive emotions. Am Psychol. 2015;70:283–284.
8. Davis MC, Zautra AJ. An online mindfulness intervention targeting socioemotional regulation in fibromyalgia: results of a randomized controlled trial. Ann Behav Med. 2013;46:273–284.
9. McCracken LM, Vowles KE. Acceptance and Commitment Therapy and mindfulness for chronic pain
: model, process, and progress. Am Psychol. 2014;69:178–187.
10. Carson JW, Keefe FJ, Lynch TR, et al. Loving-kindness meditation for chronic low back pain: results from a pilot trial. J Holist Nurs. 2005;23:287–304.
11. Bolier L, Haverman M, Westerhof GJ, et al. Positive psychology interventions: a meta-analysis of randomized controlled studies. BMC Pub Health. 2013;13:119.
12. Seligman ME, Steen TA, Park N, et al. Positive psychology progress: empirical validation of interventions. Am Psychol. 2005;60:410–421.
13. Hausmann LR, Parks A, Youk AO, et al. Reduction of bodily pain in response to an online positive activities intervention. J Pain. 2014;15:560–567.
14. Müller R, Gertz KJ, Molton IR, et al. Effects of a tailored positive psychology intervention on well-being and pain in individuals with chronic pain
and a physical disability: a feasibility trial. Clin J Pain. 2016;32:32–44.
15. Neff KD, Germer CK. A pilot study and randomized controlled trial of the mindful self-compassion program. J Clin Psychol. 2013;69:28–44.
16. Purdie F, Morley S. Self-compassion, pain, and breaking a social contract. Pain. 2015;156:2354–2363.
17. Wren AA, Somers TJ, Wright MA, et al. Self-compassion in patients with persistent musculoskeletal pain: relationship of self-compassion to adjustment to persistent pain. J Pain Symptom Manage. 2012;43:759–770.
18. Pulvers K, Hood A. The role of positive traits and pain catastrophizing in pain perception. Curr Pain Headache Rep. 2013;17:330.
19. Goodin BR, Bulls HW. Optimism and the experience of pain: benefits of seeing the glass as half full. Curr Pain Headache Rep. 2013;17:329.
20. Hanssen MM, Vancleef LM, Vlaeyen JW, et al. More optimism, less pain! The influence of generalized and pain-specific expectations on experienced cold-pressor pain. J Behav Med. 2014;37:47–58.
21. Meevissen YM, Peters ML, Alberts HJ. Become more optimistic by imagining a best possible self: effects of a two week intervention. J Behav Ther Exp Psychiatry. 2011;42:371–378.
22. Hanssen MM, Peters ML, Vlaeyen JW, et al. Optimism lowers pain: evidence of the causal status and underlying mechanisms. Pain. 2013;154:53–58.
23. Boselie JJ, Vancleef LM, Smeets T, et al. Increasing optimism abolishes pain-induced impairments in executive task performance. Pain. 2014;155:334–340.
24. Ehde DM, Dillworth TM, Turner JA. Cognitive-behavioral therapy for individuals with chronic pain
: efficacy, innovations, and directions for research. Am Psychol. 2014;69:153–166.
25. Buhrman M, Gordh T, Andersson G. Internet interventions for chronic pain
including headache: a systematic review. Internet Interv. 2016;4:17–34.
26. Eccleston C, Fisher E, Craig L, et al. Psychological therapies (internet-delivered) for the management of chronic pain
in adults. Cochrane Database Syst Rev. 2014;26:CD010152.
27. Buhrman M, Faltenhag S, Strom L, et al. Controlled trial of internet-based treatment with telephone support for chronic back pain. Pain. 2004;111:368–377.
28. Buhrman M, Fredriksson A, Edstrom G, et al. Guided internet-delivered cognitive behavioural therapy for chronic pain
patients who have residual symptoms after rehabilitation treatment: randomized controlled trial. Eur J Pain. 2013;17:753–765.
29. Peckham E, Brabyn S, Cook L, et al. The use of unequal randomisation in clinical trials—an update. Contemp Clin Trials. 2015;45:113–122.
30. Dumville JC, Hahn S, Miles JN, et al. The use of unequal randomisation ratios in clinical trials: a review. Contemp Clin Trials. 2006;27:1–12.
31. Smeets E, Neff K, Alberts H, et al. Meeting suffering with kindness: effects of a brief self-compassion intervention for female college students. J Clin Psychol. 2014;70:794–807.
32. Bryant FB, Veroff J. Savoring: A New Model of Positive Experience. Mahwah, NJ: Lawrence Erlbaum; 2007.
33. Flink IK, Smeets E, Bergbom S, et al. Happy despite pain: pilot study of a positive psychology intervention for patients with chronic pain
. Scand J Pain. 2015;7:71–79.
34. Zigmond AS, Snaith RP. The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand. 1983;67:361–370.
35. Abdel-Khalek A. Measuring happiness with a single-item scale. Soc Behav Pers. 2006;34:139–150.
36. Bennett R. The Fibromyalgia Impact Questionnaire (FIQ): a review of its development, current version, operating characteristics and uses. Clin Exp Rheumatol. 2005;23:S154–S162.
37. Raes F, Pommier E, Neff KD, et al. Construction and factorial validation of a short form of the Self-Compassion Scale. Clin Psychol Psychother. 2011;18:250–255.
38. Mayer JD, Gaschke YN. The experience and meta-experience of mood. J Pers Soc Psychol. 1988;55:102–111.
39. Scheier MF, Carver CS, Bridges MW. Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the Life Orientation Test. J Pers Soc Psychol. 1994;67:1063–1078.
40. Brandtst ädter J, Renner G. Tenacious goal pursuit and flexible goal adjustment: explication and age-related analysis of assimilative and accommodative strategies of coping. Psychol Aging. 1990;5:58–67.
41. Sullivan MJL, Bishop SR, Pivik J. The Pain Catastrophizing Scale: developmentand validation. Psychol Assess. 1995;7:524–532.
42. Ehring T, Raes F, Weidacker K, et al. Validation of the Dutch version of the Perseverative Thinking Questionnaire (PTQ-NL). Eur J Psychol Assess. 2012;28:102–108.
43. Evers AW, Kraaimaat FW, van Lankveld W, et al. Beyond unfavorable thinking: the illness cognition questionnaire for chronic diseases. J Consult Clin Psychol. 2001;69:1026–1036.
44. Cima RF, Maes IH, Joore MA, et al. Specialised treatment based on cognitive behaviour therapy versus usual care for tinnitus: a randomised controlled trial. Lancet. 2012;379:1951–1959.
45. Verbeke G, Molenberghs G. Linear Mixed Models for Longitudinal Data. New York, NY: Springer; 2000.
46. Simm R, Iddon J, Barker C. A community pain service solution-focused pain management programme: delivery and preliminary outcome data. Br J Pain. 2014;8:49–56.
47. Garland EL, Thomas E, Howard MO. Mindfulness-oriented recovery enhancement ameliorates the impact of pain on self-reported psychological and physical function among opioid-using chronic pain
patients. J Pain Symptom Manag. 2014;48:1091–1099.
48. Eysenbach G. The law of attrition. J Med Internet Res. 2005;7:e11.
49. Parks AC. A case for the advancement of the design and study of online positive psychological interventions. J Posit Psychol. 2014;9:502–508.
50. Geraghty AW, Wood AM, Hyland ME. Attrition from self-directed interventions: investigating the relationship between psychological predictors, intervention content and dropout from a body dissatisfaction intervention. Soc Sci Med. 2010;71:30–37.
51. Bennett GG, Glasgow RE. The delivery of public health interventions via the internet: actualizing their potential. Annu Rev Public Health. 2009;30:273–292.
52. Cherkin DC, Sherman KJ, Balderson BH, et al. Effect of mindfulness-based stress reduction vs. cognitive-behavioral therapy or usual care on back pain and functional limitations in adults with chronic low back pain: a randomized clinical trial. JAMA. 2016;315:1240–1249.
53. Veehof MM, Trompetter HR, Bohlmeijer ET, et al. Acceptance- and mindfulness-based interventions for the treatment of chronic pain
: a meta-analytic review. Cogn Behav Ther. 2016;45:5–31.
54. Williams AC, Eccleston C, Morley S. Psychological therapies for the management of chronic pain
(excluding headache) in adults. Cochrane Database Syst Rev. 2012;11:CD007407.
55. Cleeland CS, Ryan KM. Pain assessment: global use of the Brief Pain Inventory. Ann Acad Med Singapore. 1994;23:129–138.
56. Amtmann D, Cook KF, Jensen MP, et al. Development of a Promis item bank to measure pain interference. Pain. 2010;150:173–182.
57. Proyer RT, Gander F, Wellenzohn S, et al. Addressing the role of personality, ability, and positive and negative affect in positive psychology interventions: findings from a randomized intervention based on the authentic happiness theory and extensions. J Posit Psychol. 2016;11:609–621.
58. Burns JW. Mechanisms, mechanisms, mechanisms: it really does all boil down to mechanisms. Pain. 2016;157:2393–2394.
59. Turner JA, Anderson ML, Balderson BH, et al. Mindfulness-based stress reduction and cognitive-behavioral therapy for chronic low back pain: similar effects on mindfulness, catastrophizing, self-efficacy, and acceptance in a randomized controlled trial. Pain. 2016;157:2434–2444.
60. Schueller SM, Parks AC. Disseminating self-help: positive psychology exercises in an online trial. J Med Internet Res. 2012;14:e63.
61. Breivik H, Reme SE, Linton SJ. High risk of depression and suicide attempt among chronic pain
patients: always explore catastrophizing and suicide thoughts when evaluating chronic pain
patients. Scand J Pain. 2014;5:1–3.
62. Sullivan MJ, Adams H, Tripp D, et al. Stage of chronicity and treatment response in patients with musculoskeletal injuries and concurrent symptoms of depression. Pain. 2008;135:151–159.
63. Stenager E, Christiansen E, Handberg G, et al. Suicide attempts in chronic pain
patients. A register-based study. Scand J Pain. 2014;5:4–7.
64. Linton SJ, Fruzetti AE. A hybrid emotion-focused exposure treatment for chronic pain
: a feasibility study. Scand J Pain. 2014;5:151–158.