Hostname: page-component-7c8c6479df-24hb2 Total loading time: 0 Render date: 2024-03-19T02:07:43.360Z Has data issue: false hasContentIssue false

Cognitive–behavioural therapy for the symptoms of schizophrenia: systematic review and meta-analysis with examination of potential bias

Published online by Cambridge University Press:  02 January 2018

S. Jauhar*
Affiliation:
Department of Psychosis Studies, Institute of Psychiatry, London, UK
P. J. McKenna
Affiliation:
FIDMAG Germanes Hospitalàries Research Foundation, Barcelona and CIBERSAM, Spain
J. Radua
Affiliation:
FIDMAG Germanes Hospitalàries Research Foundation, Barcelona and CIBERSAM, Spain
E. Fung
Affiliation:
Department of Psychiatry, Faculty of Medicine, University of Calgary, Alberta, Canada
R. Salvador
Affiliation:
FIDMAG Germanes Hospitalàries Research Foundation, Barcelona and CIBERSAM, Spain
K. R. Laws
Affiliation:
School of Life and Medical Sciences, University of Hertfordshire, Hatfield, UK
*
P. J. McKenna, Benito Menni CASM. Germanes Hospitalàries del Sagrat Cor de Jesús, C/Doctor Antoni Pujades 38-C, 08830 - Sant Boi de Llobregat (BARCELONA), Spain. Email: mckennapeter1@googlemail.com
Rights & Permissions [Opens in a new window]

Abstract

Background

Cognitive–behavioural therapy (CBT) is considered to be effective for the symptoms of schizophrenia. However, this view is based mainly on meta-analysis, whose findings can be influenced by failure to consider sources of bias.

Aims

To conduct a systematic review and meta-analysis of the effectiveness of CBT for schizophrenic symptoms that includes an examination of potential sources of bias.

Method

Data were pooled from randomised trials providing end-of-study data on overall, positive and negative symptoms. The moderating effects of randomisation, masking of outcome assessments, incompleteness of outcome data and use of a control intervention were examined. Publication bias was also investigated.

Results

Pooled effect sizes were −0.33 (95% CI −0.47 to −0.19) in 34 studies of overall symptoms, −0.25 (95% CI −0.37 to −0.13) in 33 studies of positive symptoms and −0.13 (95% CI −0.25 to −0.01) in 34 studies of negative symptoms. Masking significantly moderated effect size in the meta-analyses of overall symptoms (effect sizes −0.62 (95% CI −0.88 to −0.35) v. −0.15 (95% CI −0.27 to −0.03), P = 0.001) and positive symptoms (effect sizes −0.57 (95% CI −0.76 to −0.39) v. −0.08 (95% CI −0.18 to 0.03), P<0.001). Use of a control intervention did not moderate effect size in any of the analyses. There was no consistent evidence of publication bias across different analyses.

Conclusions

Cognitive–behavioural therapy has a therapeutic effect on schizophrenic symptoms in the ‘small’ range. This reduces further when sources of bias, particularly masking, are controlled for.

Type
Review Articles
Copyright
Copyright © Royal College of Psychiatrists, 2014

Fifteen years after the first substantive trial,Reference Kuipers, Garety, Fowler, Dunn, Bebbington and Freeman1 cognitive-behavioural therapy (CBT) has become the first form of psychotherapy to achieve widespread acceptance in schizophrenia. In the UK, the National Institute for Health and Care Excellence (NICE) have now recommended it twice,2,3 the second time for all people with the disorder. The American Psychiatric Association approved it ‘with moderate clinical confidence’ in 2004 for patients with stable schizophrenia,Reference Lehman, Lieberman, Dixon, McGlashan, Miller and Perkins4 and more recently the US Schizophrenia Patient Outcomes Research Team (PORT) have endorsed it for patients who have persistent psychotic symptoms while receiving adequate pharmacotherapy.Reference Kreyenbuhl, Buchanan, Dickerson and Dixon5,Reference Dixon, Dickerson, Bellack, Bennett, Dickinson and Goldberg6 Other guideline development groups around the world have followed suit.Reference Rathod, Phiri and Kingdon7

But is this therapeutic optimism justified? Most large, methodologically rigorous trials of CBT have failed to demonstrate a significant advantage at trial end on either symptomatic or relapse-related measures,Reference Sensky, Turkington, Kingdon, Scott, Scott and Siddle8-Reference Klingberg, Wolwer, Engel, Wittorf, Herrlich and Meisner12 with only two finding clear evidence of benefit on their primary outcomes.Reference Turkington, Kingdon and Turner13,Reference van der Gaag, Stant, Wolters, Buskens and Wiersma14 Instead, the judgement that CBT is effective rests on a series of meta-analyses, which have variously concluded that it is promising;Reference Jones, Cormac, Silveira da Mota Neto and Campbell15 that it produces higher rates of improvement in mental state;Reference Pilling, Bebbington, Kuipers, Garety, Geddes and Orbach16 that it reduces positive symptoms;Reference Zimmermann, Favrod, Trieu and Pomini17 that it has a small but consistent effect over standard drug treatment;Reference Lincoln, Suttner and Nestoriuc18 that it has beneficial effects on positive and negative symptoms, mood, functioning and social anxiety;Reference Wykes, Steel, Everitt and Tarrier19 and that it is effective in reducing readmissions to hospital, duration of admission and symptom severity.3

It is possible for meta-analyses to come to positive conclusions even when most of the individual studies included had negative findings (for example Lau et al Reference Lau, Antman, Jimenez-Silva, Kupelnick, Mosteller and Chalmers20). Nevertheless, basing judgements on meta-analyses requires that their findings should be reliable and valid, and there are clear indications that this may not always be the case. Thus, different meta-analyses of the same studies have had opposite findings, as has been found with mammography for breast cancer;Reference Green and Taplin21 or similar findings can be interpreted differently, as StreinerReference Streiner22 has argued is at the heart of the controversy over the effectiveness of selective serotonin reuptake inhibitors in depression. A further problem is that meta-analyses have sometimes been found not to agree with the findings of subsequent ‘mega trials’ of the same treatment.Reference Egger and Smith23,Reference LeLorier, Gregoire, Benhaddad, Lapierre and Derderian24

One reason why meta-analyses can reach unreliable conclusions is failure to take into account study quality. In a review of this issue, Jüni et al Reference Jüni, Altman and Egger25 concluded that there was ample evidence that the deficiencies of methodologically weak trials translated into biased findings in systematic reviews, and argued that the influence of study quality should be routinely assessed. Only one of the meta-analyses of CBT for schizophrenia has formally done this: Wykes et al Reference Wykes, Steel, Everitt and Tarrier19 found that a quality score combining information from different aspects of the design and reporting of trials did not significantly moderate effect size in their main meta-analysis of end-of-study positive symptom scores. However, the use of quality scales is now no longer recommended, since these often rate aspects of a study that bear little relationship to known sources of bias, and also because different quality scales have been found to give different results.Reference Jüni, Altman and Egger25-Reference Higgins and Altman27 A range of aspects of study quality were assessed separately by NICE3, but low-quality studies continued to be included in all meta-analyses and potential moderating effects were not examined.

A further aspect of study quality relevant to trials of psychological treatment is whether the therapy is compared with treatment as usual (TAU) or to a control intervention. The position usually taken here is that evidence-based psychotherapies need to demonstrate benefits over and above what can be attributed to the so-called shared or non-specific effects of psychological intervention,Reference Chambless and Hollon28,Reference Jensen, Weersing, Hoagwood and Goldman29 although an alternative view exists which considers that applying the logic of placebo-controlled trials to psychotherapy research is flawed.Reference Kirsch30,Reference Bentall31 Bentall,Reference Bentall31 for example, has argued that whereas psychological factors such as warmth, kindness and the instilling of hope are unwanted complications that need to be removed from trials of medical treatments, they are intrinsic elements of all forms of psychotherapy without which nothing can be expected to happen. Some meta-analyses of CBT for schizophrenia carried out separate comparisons of CBT v. TAU and CBT v. other psychological interventions;3,Reference Jones, Cormac, Silveira da Mota Neto and Campbell15,Reference Pilling, Bebbington, Kuipers, Garety, Geddes and Orbach16,Reference Lincoln, Suttner and Nestoriuc18 however, these did not statistically compare the two sets of effect sizes. The potential importance of this issue has recently been highlighted by a Cochrane reviewReference Jones, Hacker, Cormac, Meaden and Irving32 that found no advantage for CBT compared with other psychosocial treatments - including those that were categorised as either active or inactive - on a range of measures including relapse, readmission to hospital and various measures of mental state and social functioning.

A final problem facing meta-analysis is publication bias, the fact that trials with positive findings are more likely to be published than those with negative findings. Publication bias is typically examined by means of funnel plots, which may show an absence of small studies with negative findings, and this can be supplemented by one or more statistical tests for asymmetry. To date, the only meta-analysis of CBT for schizophrenia to examine publication bias has been that of Wykes et al:Reference Wykes, Steel, Everitt and Tarrier19 they found that a funnel plot of studies in their meta-analysis of positive symptoms was reasonably symmetrical, but they did not assess this further with statistical testing.

Five and four years, respectively, have passed since the two most recent comprehensive meta-analyses of CBT for schizophrenia by Wykes et al Reference Wykes, Steel, Everitt and Tarrier19 and NICE3. During this time a considerable number of further studies have been published (for exampleReference Penn, Meyer, Evans, Wirth, Cai and Burchinal33-Reference Shawyer, Farhall, Mackinnon, Trauer, Sims and Ratcliff43), including two with samples of approximately 100 patients in each group.Reference Klingberg, Wolwer, Engel, Wittorf, Herrlich and Meisner12,Reference van der Gaag, Stant, Wolters, Buskens and Wiersma14 We therefore conducted an updated meta-analysis of CBT, specifically with respect to its effect on core schizophrenic symptoms. We used this data-set to examine the influence of three well-recognised sources of bias on effect size: randomisation, masking and completeness of outcome data. We also evaluated use of a control intervention as a potential moderating factor. Finally, we tested whether publication bias might be affecting the findings.

Method

Identification and selection of studies

The review was conducted in accordance with PRISMA guidelines.Reference Liberati, Altman, Tetzlaff, Mulrow, Gotzsche and Ioannidis44 Trials of CBT for schizophrenia were searched for using MEDLINE (1993 to Week 3, March 2013), PsycINFO (1993 until Week 4, March 2013), Embase (1993 until Week 4, March 2013) and the Cochrane central register of controlled trials (1993 until end of March 2013); 1993 being the year of the first published trial of CBT in schizophrenia. We used the following MeSH headings/keywords: (a) “cognitive therapy” OR “cognitive behavioural therapy” OR “CBT”; (b) “schizophrenia” OR “schizoaffective disorder” OR “psychosis” OR “non affective psychosis” OR “schizo*”; (c) “randomised controlled trial” OR “clinical trial” (cognitive behavioural therapy or cognitive therapy or CBT) and (schizophrenia or schizo* or psychosis) and (randomised controlled trial or clinical trial). Studies in any language were considered. The search was supplemented by hand searching of meta-analyses and review articles. The reference lists of all obtained studies were also checked. This part of the search was also used to check for trails that potentially could be included that were carried out prior to 1993. A search for completed but not yet published trials was also conducted using metaRegister at Current Controlled Trials (www.controlled-trials.com/mrct) and authors of any such trials were contacted for details about prospective publication dates.

We employed broad inclusion criteria similar to those used by Wykes et al,Reference Wykes, Steel, Everitt and Tarrier19 NICE3 and the Cochrane Collaboration.Reference Jones, Hacker, Cormac, Meaden and Irving32 Thus, studies were included if a majority of the patients had a diagnosis of schizophrenia, schizoaffective or non-affective functional psychosis, either made clinically or according to diagnostic criteria. Studies had to include a parallel control group, but this could be of any type, i.e. waitlist, TAU or an intervention designed to control for the non-specific effects of psychotherapy (see below). We only included randomised trials, specifically excluding those which the authors stated were non-randomised or which used inappropriate randomisation methods (e.g. allocation by alternation or by availability of the intervention).Reference Higgins and Altman27,Reference Schulz and Grimes45

Since the outcome measures were schizophrenic symptoms, we required a statement that the type of CBT used was directed to at least one class of symptoms. Such studies were included in all of the three main meta-analyses of overall symptoms, positive symptoms and negative symptoms unless they specified that the CBT was specialised for negative symptoms, in which case they were only included in that meta-analysis. A small number of studies used CBT directed specifically to auditory hallucinations and these were only included in a supplementary meta-analysis of these and other studies reporting hallucination scores. Studies that indicated that the type of CBT used was not directed to schizophrenic symptoms, but was instead adapted for self-esteem,Reference Hall and Tarrier46 obsessive-compulsive symptoms,Reference Tundo, Salvati, Di Spigno, Cieri, Parena and Necci47 post-traumatic stress symptoms,Reference Jackson, Trower, Reid, Smith, Hall and Townend48 anxietyReference Halperin, Nathan, Drummond and Castle49,Reference Kingsep, Nathan and Castle50 or suicidalityReference Power, Bell, Mills, Herrman-Doig, Davern and Henry51 were not included in any of the analyses.

We included studies using both individual and group CBT. Given that CBT technique varied considerably across the studies, those that incorporated additional elements of therapy such as motivational interviewing,Reference Haddock, Barrowclough, Shaw, Dunn, Novaco and Tarrier36 family engagement,Reference Drury, Birchwood, Cochrane and Macmillan52 behaviour therapyReference Bradshaw53 and social skills trainingReference Granholm, Holden, Link, McQuaid and Jeste42,Reference Granholm, McQuaid, McClure, Auslander, Perivoliotis and Pedrelli54 were not excluded. Like other meta-analyses, however, we did not include studies that delivered CBT only as part of a prespecified, multicomponent package of care including several other interventions (sometimes referred to as integrated treatment or similar).Reference Jenner, Nienhuis and Wiersma55-Reference Moritz, Veckenstedt, Randjbar, Vitzthum and Woodward61

We included two studies that used acceptance and commitment therapy, since the authors considered this to be both related to CBT and directed to psychotic symptoms.Reference White, Gumley, McTaggart, Rattrie, McConville and Cleare41,Reference Gaudiano and Herbert62 On the same grounds we included one study where CBT took the form predominantly of coping skills enhancement.Reference Leclerc, Lesage, Ricard, Lecomte and Cyr63 In recognition of the uncertainties about these therapies, however, we also calculated pooled effect sizes excluding these three studies.

Data extraction

Data were initially extracted by two of the authors working together, and were then independently re-extracted by another author, with differences being resolved. Effect sizes were calculated using Hedges’ g, (i.e. the standardised difference between means, corrected for the tendency towards overestimation in small studies). When a study used two control groups the effect size for CBT was calculated against both of these combined. When data could not be extracted from information given in the article, sometimes it was available on the National Collaborating Centre for Mental Health website (www.nccmh.org.uk), the body which carries out meta-analyses on behalf of NICE. If the data still could not be found, authors were contacted. Data were pooled using Comprehensive Meta-analysis, version 2 for Windows (www.meta-analysis.com). The random effects option was used in all analyses. Heterogeneity was examined by means of Q and I 2 statistics.

Overall symptoms

For the analysis of overall symptoms we included studies reporting total scores on general psychiatric scales that rated not just positive and negative symptoms but also other symptoms. Scales used included the Positive and Negative Syndrome Scale (PANSS), the Brief Psychiatric Rating Scale (BPRS), the Comprehensive Psychopathology Rating Scale (CPRS) and the Hopkins Psychiatric Rating Scale. Some studies separately reported PANSS positive, negative and general psychopathology subscale scores. In these cases we calculated the total score as the sum of the three subscale scores, taking into account the correlation coefficients between them as reported by Peralta & CuestaReference Peralta and Cuesta64 in a sample of 100 patients with DSM-III-R schizophrenia (see online Data Supplement 1). We did not average scores from studies that only reported positive and negative symptom scores.

Positive symptoms

For the positive symptoms analysis we included studies that reported scores for delusions and hallucination subscales of published scales (i.e. the reality distortion syndrome) or for delusions, hallucinations and formal thought disorder subscales (i.e. the older, broader concept of positive symptoms). Scales used included positive symptom subscales of the PANSS, BPRS, the Krawiecka (Manchester) scale, the Schedule for the Assessment of Positive Symptoms (SAPS) and the Psychotic Symptom Rating Scales (PSYRATS). We did not include the change subscale of the CPRS, as this does not approximate very closely to positive psychotic symptoms. If a study reported separate measures of reality distortion and disorganisation, these were summed assuming a correlation of 0.40 between the two syndromes, as reported in a meta-analytic factor analysis of schizophrenic syndromes by Smith et al.Reference Smith, Mar and Turoff65 Similarly, if a study provided separate delusion and hallucination subscale scores, these were averaged assuming a correlation of 0.34 from Smith et al.Reference Smith, Mar and Turoff65

Negative symptoms

Scales used by the studies in this analysis included negative symptom subscale of the PANSS, the SANS, the BPRS negative factor, a negative symptoms scale derived from the CPRS and from the Krawiecka (Manchester) scale. For one study that did not report global negative symptom scoresReference Grant, Huh, Perivoliotis, Stolar and Beck40 we averaged scores from the four subscales of the SANS employed, using correlations reported in Smith et al.Reference Smith, Mar and Turoff65 Another study used factor scores from the SANS,Reference Granholm, Holden, Link, McQuaid and Jeste42 and these were also averaged using published data concerning the correlations between them.Reference Sayers, Curran and Mueser66

Hallucinations

Most studies used the hallucinations scale from the PSYRATS; one study used a single item from the BPRS and another summed scores from four items from the CPRS. When studies reported individual PSYRATS hallucination subscale scores, these were averaged based on the correlations among them in a study of 276 patients with psychosis.Reference Steel, Garety, Freeman, Craig, Kuipers and Bebbington67

Examination of potential biasing factors in studies

We examined three sources of bias: randomisation, masking and incompleteness of outcome data. Bias from randomisation can be further divided into two distinct processes: (a) sequence generation, i.e. whether the method for allocating participants to interventions was based on some explicitly random process; and (b) allocation concealment, i.e. the demonstration that steps were taken to prevent the investigators gaining knowledge of forthcoming allocations. Studies were classified as being at low risk, at high risk or unclear using the Cochrane Risk of Bias ToolReference Higgins and Altman27,Reference Higgins and Green68 (see online Table DS1 for individual studies’ categorisations). Studies at high and low risk of bias were compared statistically if there were enough studies to do so. If not, low-risk studies were entered in a subanalysis of studies at low risk of bias from all three factors. Once again random effects models were used.

Randomisation (sequence generation)

We considered at low risk of bias studies that described use of random number tables, a random number generator, coin toss or drawing lots. Statements about block randomisation and/or stratification (within a centre), use of an independent statistician or independent service were also accepted, on the grounds that these strongly imply use of random numbers. Studies that merely stated that they used randomisation without further details were classified as unclear. Since we excluded a priori non-randomised trials, most studies that would have been classified as at high risk of bias were automatically removed from consideration. The only exception was an included study where a subset of the patients were assigned using inadequate randomisation.Reference Lecomte, Leclerc, Corbiere, Wykes, Wallace and Spidel69

Randomisation (allocation concealment)

We accepted as evidence of central allocation (one indicator of effective allocation concealment) any statement that indicated that randomisation was performed by an outside service or a person independent of the research team. If randomisation was carried out by a member of the research team, we required an explicit statement that he/she was independent or had no involvement in the baseline assessments. If studies only referred to use of envelopes, but did not state that they were sequentially numbered, opaque and sealed, they were categorised as unclear.

Masking

Since no studies of CBT have used double-blinding, only masking of the outcome assessment was examined. To be categorised as at low risk of bias, we required the study to state that the assessments were carried out by interviewers masked to treatment assignment. Studies that made no statement about masking were treated as at high risk of bias, on the grounds that it is unlikely that authors would fail to mention such a key methodological factor if they had employed it. Studies that referred to independent assessors without further elaboration were considered as unclear and authors were contacted. Four studies that indicated that the masking could have been compromisedReference van der Gaag, Stant, Wolters, Buskens and Wiersma14,Reference Lincoln, Ziegler, Mehl, Kesting, Lullmann and Westermann38,Reference Jolley, Garety, Craig, Dunn, White and Aitken70,Reference Jackson, McGorry, Killackey, Bendall, Allott and Dudgeon71 were also rated as unclear.

Incomplete outcome data

If no further details were given, we used a cut-off of >20% attrition in the whole sample as the threshold for considering a study to be at high risk of bias. Studies with attrition rates above this threshold were still considered as low risk if either (a) details of individuals who dropped out were given and were justifiable, or (b) if studies used intention-to-treat (ITT) analysis. Some studies used ITT, but data could only be extracted from tables that reported data for those who completed the study. In these cases, the study was categorised as being at low risk of bias if the drop-out rate was ⩾20% (without reasons) and ‘unclear’ if the rate was >20% (without reasons).

Effect of the use of a control intervention

The aim here was to examine the influence of the use of an intervention designed to control for the non-specific effects of psychotherapy. To this end we compared studies that employed control interventions that (a) were stated or implied to control for this (recreation and support, group support, befriending, supportive counselling/therapy, social activity therapy and goal-focused supportive contact); or (b) could be considered unlikely to have a specific effect on schizophrenic symptoms (psychoeducation and cognitive remediation therapy). We did not include the family therapy arm of one study (which the authors considered to be potentially therapeutic).Reference Garety, Fowler, Freeman, Bebbington, Dunn and Kuipers11 Studies where we combined data from two control groups (i.e. control intervention and TAU)Reference Lewis, Tarrier, Haddock, Bentall, Kinderman and Kingdon9,Reference Lecomte, Leclerc, Corbiere, Wykes, Wallace and Spidel69,Reference Tarrier, Wittkowski, Kinney, McCarthy, Morris and Humphreys72,Reference Durham, Guthrie, Morton, Reid, Treliving and Fowler73 were not included in this analysis.

Publication bias

This was examined using three statistical techniques, Duval & Tweedie’sReference Duval and Tweedie74 trim and fill, Begg & Mazumdar’sReference Begg and Mazumdar75 rank correlation test and Egger’sReference Egger, Davey Smith, Schneider and Minder76 test of the intercept.

Results

The search produced 1246 articles. Titles and, where relevant, abstracts were checked by two of the authors, leading to 1169 being eliminated. The full text of the 77 remaining studies plus 13 more added from further searching were examined. Fifty articles reporting 52 studies were finally included (two studies reported on two separate samples)Reference Kuipers, Garety, Fowler, Dunn, Bebbington and Freeman1,Reference Sensky, Turkington, Kingdon, Scott, Scott and Siddle8-Reference van der Gaag, Stant, Wolters, Buskens and Wiersma14,Reference Penn, Meyer, Evans, Wirth, Cai and Burchinal33-Reference Shawyer, Farhall, Mackinnon, Trauer, Sims and Ratcliff43,Reference Drury, Birchwood, Cochrane and Macmillan52-Reference Granholm, McQuaid, McClure, Auslander, Perivoliotis and Pedrelli54,Reference Gaudiano and Herbert62,Reference Leclerc, Lesage, Ricard, Lecomte and Cyr63,Reference Lecomte, Leclerc, Corbiere, Wykes, Wallace and Spidel69-Reference Durham, Guthrie, Morton, Reid, Treliving and Fowler73,Reference Daniels77-Reference Rathod, Phiri, Harris, Underwood, Thagadur and Padmanabi97 A flow chart of the selection process is shown in Fig. 1. Individual effect sizes extracted from the included studies plus a list of the excluded studies are given in online Table DS1 and Data Supplement 2.

Pooled effect sizes

The pooled effect size for 34 studies of overall symptoms was –0.33 (95% CI –0.47 to –0.19, P<0.001) (negative sign favours CBT). The studies were heterogeneous (Q = 102.71, P<0.001), with an I 2 value of 67.9 (95% CI 54.2-77.5), indicating that two-thirds of the variation among studies was as a result of heterogeneity rather than chance. The pooled effect size for 33 studies of positive symptoms was –0.25 (95% CI –0.37 to –0.13, P<0.001). Once again the studies were heterogeneous (Q = 63.12, P = 0.001; I 2 = 49.3, 95% CI 24.1-66.1). The pooled effect size for 34 studies of negative symptoms was –0.13 (95% CI –0.25 to –0.01, P = 0.03). These studies were also heterogeneous (Q = 63.11, P = 0.001; I 2 = 47.7, 95% CI 21.9-65.0).

Forest plots of the studies in the meta-analysis of overall symptoms and positive symptoms are shown in Figs 2 and 3 (see online Figs DS1 and DS2 for those for negative symptoms and hallucinations).

Recalculating the pooled effect sizes excluding studies using coping strategy enhancement or acceptance and commitment therapy made little difference to the findings (overall symptoms: effect size –0.33 (95% CI –0.48 to –0.19, P<0.001, 32 studies); positive symptoms: effect size –0.24 (95% CI –0.36 to –0.11, P<0.001, 30 studies); negative symptoms: –0.14 (95% CI –0.26 to –0.01, P = 0.04, 31 studies).

There were 15 studies in the supplementary meta-analysis of hallucinations. The pooled effect size was –0.34 (95% CI –0.61 to –0.06, P = 0.01). These studies were heterogeneous (Q = 46.02, P<0.001) with I 2 = 69.6 (95% CI 48.3-82.1).

Fig. 1 Flow chart of the selection process.

Examination of bias within studies

The findings with respect to sequence generation, allocation concealment, masking and completeness of outcome data are summarised in Table 1. It can be seen that masking significantly moderated effect size for overall symptoms (–0.62 in 10 non-masked studies v. –0.15 in 20 masked studies, P = 0.001) and positive symptoms (–0.57 in 8 non-masked studies v. –0.08 in 21 masked studies, P<0.001). The effect for negative symptoms was not significant (–0.22 in 8 non-masked studies v. –0.04 in 22 masked studies, P = 0.26).

Only a few studies were considered to be at high risk of bias with respect to sequence generation, allocation concealment and incompleteness of outcome data (1-2 studies across all analyses) and so statistical analysis was not carried out. Instead, studies at low risk of bias from all three factors (i.e. high-risk studies plus those categorised as ‘unclear’), were entered into a subanalysis including only these studies. Pooled effect sizes were as follows: overall symptoms –0.15 (95% CI –0.32 to 0.01, P = 0.07, 8 studies); positive symptoms –0.10 (95% CI –0.28 to 0.09, P = 0.30, 9 studies); negative symptoms –0.02 (95% CI –0.15 to 0.11, P = 0.76, 11 studies).

In the supplementary meta-analysis of hallucinations, there was a large difference between masked and non-masked studies (effect size –0.18 (95% CI –0.37 to 0.01) in 12 masked studies v. –0.91 (95% CI –2.67 to 0.85) in 2 non-masked studies), but statistical significance was not tested owing to the small number of non-masked studies. No studies were rated as being at high risk of bias for sequence generation or allocation concealment and only one study for incompleteness of outcome data. The pooled effect size for 10 studies at low risk of bias from all three variables was –0.20 (95% CI –0.44 to 0.04, P= 0.10).

Fig. 2 Forest plot of studies in the meta-analysis of overall symptoms.

CBT, cognitive-behavioural therapy.

Fig. 3 Forest plot of studies in the meta-analysis of positive symptoms.

CBT, cognitive-behavioural therapy.

Table 1 Comparisons between studies at high and low risk of bias from masking, allocation concealment and incomplete outcome data

High risk of bias Low risk of bias
Effect size (95% CI) Studies, n Effect size (95% CI) Studies, n Q(B) P
Sequence generation
    Overall symptoms −0.15 (−0.57 to 0.27) 1 −0.15 (−0.24 to −0.06) 20 n/a n/a
    Positive symptoms −0.07 (−0.49 to 0.35) 1 −0.19 (−0.32 to −0.06) 23 n/a n/a
    Negative symptoms 0.14 (−0.28 to 0.56) 1 −0.01 (−0.11 to 0.09) 22 n/a n/a
Allocation concealment
    Overall symptoms −0.48 (−1.10 to 0.14) 1 −0.17 (−0.28 to −0.06) 16 n/a n/a
    Positive symptoms −0.96 (−1.61 to −0.32) 1 −0.19 (−0.30 to −0.08) 19 n/a n/a
    Negative symptoms 0.09 (−0.52 to 0.69) 1 −0.07 (−0.18 to 0.04) 19 n/a n/a
Masking
    Overall symptoms −0.62 (−0.88 to −0.35) 10 −0.15 (−0.27 to −0.03) 20 10.10 0.001
    Positive symptoms −0.57 (−0.76 to −0.39) 8 −0.08 (−0.18 to 0.03) 20 20.51 <0.001
    Negative symptoms −0.22 (−0.51 to 0.08) 8 −0.04 (−0.14 to 0.06) 22 1.27 0.26
Incomplete outcome data
    Overall symptoms −1.45 (−2.54 to −0.37) 1 −0.22 (−0.32 to −0.12) 27 n/a n/a
    Positive symptoms −0.18 (−0.60 to 0.25) 2 −0.26 (−0.39 to −0.13) 27 n/a n/a
    Negative symptoms −0.05 (−0.56 to 0.46) 1 −0.11 (−0.23 to 0.00) 29 n/a n/a

n/a, not applicable.

Effect of use of a control intervention

Effect sizes for studies that did and did not use a control intervention in the three main analyses are shown in Table 2. This factor did not significantly moderate effect size in any of the analyses.

In the meta-analysis of hallucinations, the pooled effect size was smaller in five studies using a control intervention than in eight studies that did not, but once again the difference was not significant (effect size –0.15 (95% CI –0.54 to 0.24) v. –0.55 (95% CI –1.04 to –0.06), Q(B) = 1.58, P = 0.21).

Examination of publication bias

Funnel plots of the studies in the three main analyses are shown in Fig. 4, and results of the statistical analyses are shown in Table 3. Trim and fill only imputed studies in the meta-analysis of positive symptoms (one study), reducing the effect size minimally from –0.25 to –0.24. Begg & Mazumdar’s test was at trend level, but Egger’s test was not significant. Begg & Mazumdar’s test was significant in the meta-analyses of overall symptoms and negative symptoms, at P = 0.009 and 0.02 respectively. Egger’s test was at trend level in the meta-analysis of overall symptoms (P = 0.06) and was not significant in the meta-analysis of negative symptoms (P = 0.30).

Discussion

Main findings

This meta-analysis, which employed broad inclusion criteria similar to those used by Wykes et al,Reference Wykes, Steel, Everitt and Tarrier19 NICE3 and the Cochrane Collaboration,Reference Jones, Hacker, Cormac, Meaden and Irving32 found that pooled effect sizes were in the ‘small’ range for all the classes of symptoms considered. Other recent meta-analyses have struggled to demonstrate levels of effectiveness against symptoms higher than this. Thus, Zimmerman et al Reference Zimmermann, Favrod, Trieu and Pomini17 found a pooled effect size of –0.37 for positive symptoms at the end of treatment, but they only included 15 studies. Wykes et al Reference Wykes, Steel, Everitt and Tarrier19 also found a pooled effect size of –0.37 for positive symptoms in a larger set of 32 studies, plus an effect size of –0.44 for negative symptoms in 23 studies. However, they used Glass’s method of calculating effect size, which divides the difference in means by the standard deviation of the control group alone rather than the combined standard deviation of both groups; it is known that this can inflate the estimate of effect size.Reference Hunt98 Although NICE3 concluded that ‘CBT was shown to be effective in reducing symptom severity as measured by total scores on items such as the PANSS and BPRS… at end of treatment’, the effect sizes for total symptom scores were –0.27 in 13 studies comparing CBT with standard care and –0.13 (a non-significant value) in 6 studies comparing it with ‘other active treatments’. The corresponding effect sizes for positive symptoms were –0.17 (eight studies) and –0.13 (six studies).

Table 2 Comparison between studies not using and using a control intervention

CBT v. TAU CBT v. control intervention
Effect size (95% CI) Studies, n Effect size (95% CI) Studies, n Q(B) P
Overall symptoms −0.33 (−0.45 to −0.21) 21 −0.32 (−0.74 to 0.09) 9 <0.001 0.99
    Positive symptoms −0.31 (−0.45 to −0.17) 19 −0.24 (−0.54 to 0.06) 10 0.17 0.68
    Negative symptoms −0.17 (−0.33 to −0.02) 20 −0.08 (−0.29 to 0.13) 12 0.49 0.48

CBT, cognitive–behavioural therapy; TAU, treatment as usual.

The influences of sources of bias

The importance of masking in trials of psychological treatments is recognised, even though less attention often seems to be paid to it than to other aspects of methodology.Reference Chambless and Hollon28,Reference Jensen, Weersing, Hoagwood and Goldman29 Nevertheless, its moderating effects have only previously been examined twice. Zimmerman et al Reference Zimmermann, Favrod, Trieu and Pomini17 found effect sizes of –0.29 and –0.54 in studies with and without masked assessment in their meta-analysis of 15 studies of positive symptoms, but the difference was not significant. Wykes et al Reference Wykes, Steel, Everitt and Tarrier19 found values of –0.31 in 14 masked studies compared with –0.49 in 10 non-masked studies; they did not state whether this represented a significant difference. Our meta-analysis of a larger set of studies found considerably larger differences - four to seven times across the three main meta-analyses - suggesting an exaggeration of the treatment effect that is at least as great as the 17-36% found in trials of medical treatments.Reference Schulz, Chalmers, Hayes and Altman99-Reference Hrobjartsson, Thomsen, Emanuelsson, Tendal, Hilden and Boutron101 In this respect it is worth noting that, in the forest plots shown in Figs 2 and 3, only two studies published since 2008 (the cut-off year in the NICE3 meta-analysis) have found a significant advantage for CBT against overall symptoms,Reference Deng, Li and Song94,Reference Wu, Wang and Kong96 and only one for positive symptoms.Reference van der Gaag, Stant, Wolters, Buskens and Wiersma14 The assessments in the first two of these studies were presumptively made non-masked (the authors did not comment on masking), and in the third the masking was found to have become progressively more compromised as the trial went on.

Fig. 4 Funnel plots of studies in the meta-analyses of overall symptoms (a), positive symptoms (b) and negative symptoms (c).

Studies with positive findings are to the left; white circles are imputed studies.

Table 3 Results of tests for publication bias in the analyses of overall symptoms, positive symptoms and negative symptoms

Effect size (95% CI) Begg & Mazumdar’s testFootnote a Egger’s testFootnote a
Studies, n Unadjusted Trim and fill adjusted z P t P
Overall symptoms 34 −0.33 (−0.47 to −0.19) 2.37 0.009 1.56 0.06
Positive symptoms 33 −0.25 (−0.37 to −0.13) −0.24 (−0.36 to −0.12)Footnote b 1.49 0.07 0.15 0.44
Negative symptoms 34 −0.13 (−0.25 to −0.01) 2.12 0.02 0.54 0.30

a. P-values are one-tailed, as recommended.

b. One study imputed.

Statistical examination of the effects of bias from inadequate randomisation and incompleteness of outcome data was not possible because of the small numbers of studies classified as being at high risk. Nevertheless, restriction of the sample to studies considered to be at low risk of bias from all three sources reduced the pooled effect sizes to non-significance for all classes of symptom. These pooled effect sizes may not be reliable, since the numbers of studies that survived this procedure were quite small (this was due to large numbers of studies being classified as ‘unclear’). However, such a finding does arguably place an onus on advocates of CBT for schizophrenia to demonstrate its effectiveness in at least one large trial free of the above methodological weaknesses.

Surprisingly, given the universal agreement on the importance of using a placebo in trials of medical treatments, we found that use of a control for the non-specific effects of psychological intervention did not moderate effect size in any of the analyses. One explanation of this finding could simply be that there were not enough studies using control interventions (9-12 in the three main analyses) to detect an effect. There is a possible hint that this may be the case, in that the pooled effect sizes for studies using a control intervention were found to be non-significant in all the three main analyses. But clearly, more studies will be needed to decide this issue.

Other explanations of our null finding here are also possible, notably that it supports the argument of authors like KirschReference Kirsch30 and Bentall,Reference Bentall31 that pill placebo and control for the non-specific effects of psychotherapy are not equatable. As described in the introduction, this position is based mainly on theoretical arguments and neither author attempted to tackle an important practical consideration, that of the Hawthorne effect.Reference Gillespie102 This is the well-established finding that people singled out for almost any kind of intervention tend to improve their performance or behaviour simply by virtue of the special attention they receive; it seems unlikely that this would not happen in psychotherapy trials. Apart from this, variations in the degree of ‘therapeuticness’ among different control interventions almost certainly needs to be considered. We were quite restrictive in our approach, including only control interventions that would not be expected to have specific effects on schizophrenic symptoms. In contrast, NICE3 compared CBT with ‘other active treatments’ in one of their two main sets of meta-analyses, including under this heading not only supportive counselling, befriending and the like, but also family therapy. Clearly, such an approach blurs the boundary between controlling for psychological confounding factors and examining whether CBT is more effective than other forms of psychotherapy.

Our findings with respect to publication bias did not suggest that this factor was exerting a significant influence on effect size. Some statistical evidence of bias was found in the meta-analysis of overall symptoms, and to a lesser extent in that of negative symptoms, but this could hardly be regarded as convergent. Our findings accord with those of Niemeyer et al,Reference Niemeyer, Musch and Pietrowsky103 who imputed studies in ten data-sets selected from five published meta-analyses of CBT for schizophrenia and found that this resulted in no or relatively minor reductions in pooled effect sizes. However, it goes against findings in depression: Cuijpers et al Reference Cuijpers, Smit, Bohlmeijer, Hollon and Andersson104 found that an initial pooled effect size of 0.69 in 89 studies reduced to 0.49 after Duval & Tweedie’s trim and fill imputed 26 studies, and both Begg & Mazumbar’s and Egger’s tests were highly significant.

Implications

Should CBT for schizophrenia continue to be recommended in clinical practice? Given that we, and others including NICE,3 have found evidence for only small effects on overall symptoms, plus the fact that a large, methodologically rigorous 2008 trial failed to demonstrate any effectiveness against relapse,Reference Garety, Fowler, Freeman, Bebbington, Dunn and Kuipers11 the UK government’s continued vigorous advocacy of this form of treatment (for example see The All Party Parliamentary Group on Mental Health105) might be considered puzzling. Our finding of non-significant effects on positive symptoms in a relatively large set of 21 masked studies also suggests that claims that CBT is effective against these symptoms of the disorder are no longer tenable. The same appears to apply to negative symptoms, although here the possibility that specially adapted forms of therapy will have an effect cannot be excluded (there have been only two such studies to date). We did not examine the effect of CBT on depression, anxiety or distress as a result of psychotic symptoms, so no judgements on its effects in these areas can be made.

Acknowledgements

This work was supported in part by (a) Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), (b) several grants from the Instituto de Salud Carlos III including Miguel Servet Research Contract to RS (CP07/00048); Rio Hortega Research Contract to J.R. (CM11/00024) and intensification grant to P.J.M. (12/325). We thank those authors who kindly supplied us with additional data from their studies.

Footnotes

Declaration of interest

None.

References

1 Kuipers, E Garety, P Fowler, D Dunn, G Bebbington, P Freeman, D et al. London–East Anglia randomised controlled trial of cognitive–behavioural therapy for psychosis. I: effects of the treatment phase. Br J Psychiatry 1997; 171: 319327.CrossRefGoogle ScholarPubMed
2 National Collaborating Centre for Mental Health. Schizophrenia. Full National Clinical Guideline on Core Interventions in Primary and Secondary Care. Royal College of Psychiatrists and the British Psychological Society, 2003.Google Scholar
3 National Institute of Health and Clinical Excellence. Schizophrenia: Core Interventions in the Treatment and Management of Schizophrenia in Adults in Primary and Secondary Care (Update). NICE, 2009.Google Scholar
4 Lehman, A Lieberman, JA Dixon, LB McGlashan, TH Miller, AL Perkins, DO et al. American Psychiatric Association Practice Guideline for the Treatment of Patients with Schizophrenia (2nd edn). American Psychiatric Association, 2004.Google Scholar
5 Kreyenbuhl, J Buchanan, RW Dickerson, FB Dixon, LB The Schizophrenia Patient Outcomes Research Team (PORT): updated treatment recommendations 2009. Schizophr Bull 2010; 36: 94103.CrossRefGoogle ScholarPubMed
6 Dixon, LB Dickerson, F Bellack, AS Bennett, M Dickinson, D Goldberg, RW et al. The 2009 schizophrenia PORT psychosocial treatment recommendations and summary statements. Schizophr Bull 2010; 36: 4870.CrossRefGoogle ScholarPubMed
7 Rathod, S Phiri, P Kingdon, D Cognitive behavioral therapy for schizophrenia. Psychiatr Clin North Am 2010; 33: 527536.CrossRefGoogle ScholarPubMed
8 Sensky, T Turkington, D Kingdon, D Scott, JL Scott, J Siddle, R et al. A randomized controlled trial of cognitive-behavioral therapy for persistent symptoms in schizophrenia resistant to medication. Arch Gen Psychiatry 2000; 57: 165172.CrossRefGoogle ScholarPubMed
9 Lewis, S Tarrier, N Haddock, G Bentall, R Kinderman, P Kingdon, D et al. Randomised controlled trial of cognitive–behavioural therapy in early schizophrenia: acute-phase outcomes. Br J Psychiatry 2002; 181 (suppl 43): s91s97.CrossRefGoogle Scholar
10 Bechdolf, A Knost, B Kuntermann, C Schiller, S Klosterkotter, J Hambrecht, M et al. A randomized comparison of group cognitive-behavioural therapy and group psychoeducation in patients with schizophrenia. Acta Psychiatr Scand 2004; 110: 2128.CrossRefGoogle ScholarPubMed
11 Garety, PA Fowler, DG Freeman, D Bebbington, P Dunn, G Kuipers, E Cognitive–behavioural therapy and family intervention for relapse prevention and symptom reduction in psychosis: randomised controlled trial. Br J Psychiatry 2008; 192: 412423.CrossRefGoogle ScholarPubMed
12 Klingberg, S Wolwer, W Engel, C Wittorf, A Herrlich, J Meisner, C et al. Negative symptoms of schizophrenia as primary target of cognitive behavioral therapy: results of the randomized clinical TONES study. Schizophr Bull 2011; 37 (suppl 2): S98110.CrossRefGoogle ScholarPubMed
13 Turkington, D Kingdon, D Turner, T Effectiveness of a brief cognitive–behavioural therapy intervention in the treatment of schizophrenia. Br J Psychiatry 2002; 180: 523527.CrossRefGoogle ScholarPubMed
14 van der Gaag, M Stant, AD Wolters, KJK Buskens, E Wiersma, D Cognitive–behavioural therapy for persistent and recurrent psychosis in people with schizophrenia-spectrum disorder: cost-effectiveness analysis. Br J Psychiatry 2011; 198: 5965.CrossRefGoogle ScholarPubMed
15 Jones, C Cormac, I Silveira da Mota Neto, J Campbell, C Cognitive behaviour therapy for schizophrenia. Cochrane Database Syst Rev 2004; 4: CD000524.Google Scholar
16 Pilling, S Bebbington, P Kuipers, E Garety, P Geddes, J Orbach, G et al. Psychological treatments in schizophrenia: I. Meta-analysis of family intervention and cognitive behaviour therapy. Psychol Med 2002; 32: 763782.CrossRefGoogle ScholarPubMed
17 Zimmermann, G Favrod, J Trieu, VH Pomini, V The effect of cognitive behavioral treatment on the positive symptoms of schizophrenia spectrum disorders: a meta-analysis. Schizophr Res 2005; 77: 19.CrossRefGoogle ScholarPubMed
18 Lincoln, TM Suttner, C Nestoriuc, Y Effects of cognitive interventions for schizophrenia: a meta-analysis [Wirksamkeit kognitiver interventionen für schizophrenie: eine meta-analyse]. Psychol Rundsch 2008; 59: 217232.CrossRefGoogle Scholar
19 Wykes, T Steel, C Everitt, B Tarrier, N Cognitive behavior therapy for schizophrenia: effect sizes, clinical models, and methodological rigor. Schizophr Bull 2008; 34: 523537.CrossRefGoogle ScholarPubMed
20 Lau, J Antman, EM Jimenez-Silva, J Kupelnick, B Mosteller, F Chalmers, TC Cumulative meta-analysis of therapeutic trials for myocardial infarction. N Engl J Med 1992; 327: 248254.CrossRefGoogle ScholarPubMed
21 Green, BB Taplin, SH. Breast cancer screening controversies. J Am Board Fam Pract 2003; 16: 233241.CrossRefGoogle ScholarPubMed
22 Streiner, DL. I have the answer, now what's the question?: Why metaanalyses do not provide definitive solutions. Can J Psychiatry 2005; 50: 829831.CrossRefGoogle Scholar
23 Egger, M Smith, GD. Misleading meta-analysis. BMJ 1995; 310: 752754.CrossRefGoogle ScholarPubMed
24 LeLorier, J Gregoire, G Benhaddad, A Lapierre, J Derderian, F Discrepancies between meta-analyses and subsequent large randomized, controlled trials. N Engl J Med 1997; 337: 536542.CrossRefGoogle ScholarPubMed
25 Jüni, P Altman, DG Egger, M Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ 2001; 323: 4246.CrossRefGoogle ScholarPubMed
26 Herbison, P Hay-Smith, J Gillespie, WJ Adjustment of meta-analyses on the basis of quality scores should be abandoned. J Clin Epidemiol 2006; 59: 12491256.CrossRefGoogle ScholarPubMed
27 Higgins, JPT Altman, DG. Assessing risk of bias in included studies. In Cochrane Handbook for Systematic Reviews of Interventions, Version 5.0.1 (eds JPT Higgins, S Green). The Cochrane Collaboration, 2008.CrossRefGoogle Scholar
28 Chambless, DL Hollon, SD. Defining empirically supported therapies. J Consult Clin Psychol 1998; 66: 718.CrossRefGoogle ScholarPubMed
29 Jensen, PS Weersing, R Hoagwood, KE Goldman, E What is the evidence for evidence-based treatments? A hard look at our soft underbelly. Ment Health Serv Res 2005; 7: 5374.CrossRefGoogle Scholar
30 Kirsch, I. Placebo psychotherapy: synonym or oxymoron? J Clin Psychol 2005; 61: 791803.CrossRefGoogle ScholarPubMed
31 Bentall, R. Doctoring the Mind: Why Psychiatric Treatments Fail. Allen Lane, 2009.Google Scholar
32 Jones, C Hacker, D Cormac, I Meaden, A Irving, CB Cognitive behaviour therapy versus other psychosocial treatments for schizophrenia. Cochrane Database Syst Rev 2012; 4: CD008712.Google ScholarPubMed
33 Penn, DL Meyer, PS Evans, E Wirth, RJ Cai, K Burchinal, M A randomized controlled trial of group cognitive-behavioral therapy vs. enhanced supportive therapy for auditory hallucinations. Schizophr Res 2009; 109: 5259.CrossRefGoogle ScholarPubMed
34 Farhall, J Freeman, NC Shawyer, F Trauer, T An effectiveness trial of cognitive behaviour therapy in a representative sample of outpatients with psychosis. Br J Clin Psychol 2009; 48: 4762.CrossRefGoogle Scholar
35 Fowler, D Hodgekins, J Painter, M Reilly, T Crane, C Macmillan, I et al. Cognitive behaviour therapy for improving social recovery in psychosis: a report from the ISREP MRC Trial Platform Study (Improving Social Recovery in Early Psychosis). Psychol Med 2009; 39: 16271636.CrossRefGoogle ScholarPubMed
36 Haddock, G Barrowclough, C Shaw, JJ Dunn, G Novaco, RW Tarrier, N Cognitive–behavioural therapy v. social activity therapy for people with psychosis and a history of violence: randomised controlled trial. Br J Psychiatry 2009; 194: 152157.CrossRefGoogle Scholar
37 Pinninti, NR Rissmiller, DJ Steer, RA Cognitive-behavioral therapy as an adjunct to second-generation antipsychotics in the treatment of schizophrenia. Psychiatr Serv 2010; 61: 940943.CrossRefGoogle ScholarPubMed
38 Lincoln, TM Ziegler, M Mehl, S Kesting, ML Lullmann, E Westermann, S et al. Moving from efficacy to effectiveness in cognitive behavioral therapy for psychosis: a randomized clinical practice trial. J Consult Clin Psychol 2012; 80: 674686.CrossRefGoogle ScholarPubMed
39 Edwards, J Cocks, J Burnett, P Maud, D Wong, L Yuen, HP et al. Randomized controlled trial of clozapine and CBT for first-episode psychosis with enduring positive symptoms: a pilot study. Schizophr Res Treatment 2011; March 30 (Epub ahead of print).CrossRefGoogle Scholar
40 Grant, PM Huh, GA Perivoliotis, D Stolar, NM Beck, AT Randomized trial to evaluate the efficacy of cognitive therapy for low-functioning patients with schizophrenia. Arch Gen Psychiatry 2012; 69: 121127.CrossRefGoogle ScholarPubMed
41 White, R Gumley, A McTaggart, J Rattrie, L McConville, D Cleare, S et al. A feasibility study of acceptance and commitment therapy for emotional dysfunction following psychosis. Behav Res Ther 2011; 49: 901907.CrossRefGoogle ScholarPubMed
42 Granholm, E Holden, J Link, PC McQuaid, JR Jeste, DV Randomized controlled trial of cognitive behavioral social skills training for older consumers with schizophrenia: defeatist performance attitudes and functional outcome. Am J Geriatr Psychiatry 2013; 21: 251262.CrossRefGoogle ScholarPubMed
43 Shawyer, F Farhall, J Mackinnon, A Trauer, T Sims, E Ratcliff, K et al. A randomised controlled trial of acceptance-based cognitive behavioural therapy for command hallucinations in psychotic disorders. Behav Res Ther 2012; 50: 110121.CrossRefGoogle ScholarPubMed
44 Liberati, A Altman, DG Tetzlaff, J Mulrow, C Gotzsche, PC Ioannidis, JP et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 2009; 6: e1000100.CrossRefGoogle ScholarPubMed
45 Schulz, KF Grimes, DA. Generation of allocation sequences in randomised trials: chance, not choice. Lancet 2002; 359: 515519.CrossRefGoogle Scholar
46 Hall, PL Tarrier, N. The cognitive-behavioural treatment of low self-esteem in psychotic patients: a pilot study. Behav Res Ther 2003; 41: 317332.CrossRefGoogle ScholarPubMed
47 Tundo, A Salvati, L Di Spigno, D Cieri, L Parena, A Necci, R et al. Cognitive-behavioral therapy for obsessive-compulsive disorder as a comorbidity with schizophrenia or schizoaffective disorder. Psychother Psychosom 2012; 81: 5860.CrossRefGoogle ScholarPubMed
48 Jackson, C Trower, P Reid, I Smith, J Hall, M Townend, M et al. Improving psychological adjustment following a first episode of psychosis: a randomised controlled trial of cognitive therapy to reduce post psychotic trauma symptoms. Behav Res Ther 2009; 47: 454462.CrossRefGoogle ScholarPubMed
49 Halperin, S Nathan, P Drummond, P Castle, D A cognitive-behavioural, group-based intervention for social anxiety in schizophrenia. Aust N Z J Psychiatry 2000; 34: 809813.CrossRefGoogle ScholarPubMed
50 Kingsep, P Nathan, P Castle, D Cognitive behavioural group treatment for social anxiety in schizophrenia. Schizophr Res 2003; 63: 121129.CrossRefGoogle ScholarPubMed
51 Power, PJ Bell, RJ Mills, R Herrman-Doig, T Davern, M Henry, L et al. Suicide prevention in first episode psychosis: the development of a randomised controlled trial of cognitive therapy for acutely suicidal patients with early psychosis. Aust N Z J Psychiatry 2003; 37: 414420.CrossRefGoogle ScholarPubMed
52 Drury, V Birchwood, M Cochrane, R Macmillan, F Cognitive therapy and recovery from acute psychosis: a controlled trial. I. Impact on psychotic symptoms. Br J Psychiatry 1996; 169: 593601.CrossRefGoogle Scholar
53 Bradshaw, W. Integrating cognitive-behavioral psychotherapy for persons with schizophrenia into a psychiatric rehabilitation program: results of a three year trial. Community Ment Health J 2000; 36: 491500.CrossRefGoogle ScholarPubMed
54 Granholm, E McQuaid, JR McClure, FS Auslander, LA Perivoliotis, D Pedrelli, P et al. A randomized, controlled trial of cognitive behavioral social skills training for middle-aged and older outpatients with chronic schizophrenia. Am J Psychiatry 2005; 162: 520529.CrossRefGoogle ScholarPubMed
55 Jenner, JA Nienhuis, FJ Wiersma, D van de Willige G. Hallucination focused integrative treatment: a randomized controlled trial. Schizophr Bull 2004; 30: 133145.CrossRefGoogle ScholarPubMed
56 Kuipers, E Holloway, F Rabe-Hesketh, S Tennakoon, L An RCT of early intervention in psychosis: Croydon Outreach and Assertive Support Team (COAST). Soc Psychiatry Psychiatr Epidemiol 2004; 39: 358363.CrossRefGoogle ScholarPubMed
57 Garety, PA Craig, TKJ Dunn, G Fornells–Ambrojo, M Colbert, S Rahaman, N et al. Specialised care for early psychosis: symptoms, social functioning and patient satisfaction. Randomised controlled trial. Br J Psychiatry 2006; 188: 3745.CrossRefGoogle ScholarPubMed
58 Grawe, RW Falloon, IR Widen, JH Skogvoll, E Two years of continued early treatment for recent-onset schizophrenia: a randomised controlled study. Acta Psychiatr Scand 2006; 114: 328336.CrossRefGoogle ScholarPubMed
59 Guo, X Zhai, J Liu, Z Fang, M Wang, B Wang, C et al. Effect of antipsychotic medication alone vs combined with psychosocial intervention on outcomes of early-stage schizophrenia: a randomized, 1-year study. Arch Gen Psychiatry 2010; 67: 895904.CrossRefGoogle ScholarPubMed
60 Gleeson, JF Cotton, SM Alvarez-Jimenez, M Wade, D Gee, D Crisp, K et al. A randomized controlled trial of relapse prevention therapy for first-episode psychosis patients. J Clin Psychiatry 2009; 70: 477486.CrossRefGoogle ScholarPubMed
61 Moritz, S Veckenstedt, R Randjbar, S Vitzthum, F Woodward, TS Antipsychotic treatment beyond antipsychotics: metacognitive intervention for schizophrenia patients improves delusional symptoms. Psychol Med 2011; 41: 18231832.CrossRefGoogle ScholarPubMed
62 Gaudiano, BA Herbert, JD. Acute treatment of inpatients with psychotic symptoms using acceptance and commitment therapy: pilot results. Behav Res Ther 2006; 44: 415437.CrossRefGoogle ScholarPubMed
63 Leclerc, C Lesage, AD Ricard, N Lecomte, T Cyr, M Assessment of a new rehabilitative coping skills module for persons with schizophrenia. Am J Orthopsychiatry 2000; 70: 380388.CrossRefGoogle ScholarPubMed
64 Peralta, V Cuesta, MJ. Psychometric properties of the positive and negative syndrome scale (PANSS) in schizophrenia. Psychiatry Res 1994; 53: 3140.CrossRefGoogle ScholarPubMed
65 Smith, DA Mar, CM Turoff, BK The structure of schizophrenic symptoms: a meta-analytic confirmatory factor analysis. Schizophr Res 1998; 31: 5770.CrossRefGoogle ScholarPubMed
66 Sayers, SL Curran, PJ Mueser, KT Factor structure and construct validity of the Scale for the Assessment of Negative Symptoms. Psychol Assess 1996; 8: 269280.CrossRefGoogle Scholar
67 Steel, C Garety, PA Freeman, D Craig, E Kuipers, E Bebbington, P et al. The multidimensional measurement of the positive symptoms of psychosis. Int J Methods Psychiatr Res 2007; 16: 8896.CrossRefGoogle ScholarPubMed
68 Higgins, JPT Green, S (eds). Cochrane Handbook for Systematic Reviews of Interventions, version 5.1.0. The Cochrane Collaboration, 2011.Google Scholar
69 Lecomte, T Leclerc, C Corbiere, M Wykes, T Wallace, CJ Spidel, A Group cognitive behavior therapy or social skills training for individuals with a recent onset of psychosis? Results of a randomized controlled trial. J Nerv Ment Dis 2008; 196: 866875.CrossRefGoogle ScholarPubMed
70 Jolley, S Garety, P Craig, T Dunn, G White, J Aitken, M Cognitive therapy in early psychosis: a pilot randomized controlled trial. Behav Cogn Psychother 2003; 31: 473478.CrossRefGoogle Scholar
71 Jackson, HJ McGorry, PD Killackey, E Bendall, S Allott, K Dudgeon, P et al. Acute-phase and 1-year follow-up results of a randomized controlled trial of CBT versus Befriending for first-episode psychosis: the ACE project. Psychol Med 2008; 38: 725735.CrossRefGoogle ScholarPubMed
72 Tarrier, N Wittkowski, A Kinney, C McCarthy, E Morris, J Humphreys, L Durability of the effects of cognitive–behavioural therapy in the treatment of chronic schizophrenia: 12-month follow-up. Br J Psychiatry 1999; 174: 500504.CrossRefGoogle ScholarPubMed
73 Durham, RC Guthrie, M Morton, RV Reid, DA Treliving, LR Fowler, D et al. Tayside–Fife clinical trial of cognitive–behavioural therapy for medication-resistant psychotic symptoms. Results to 3-month follow-up. Br J Psychiatry 2003; 182: 303311.CrossRefGoogle ScholarPubMed
74 Duval, S Tweedie, R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000; 56: 455463.CrossRefGoogle ScholarPubMed
75 Begg, CB Mazumdar, M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994; 50: 10881101.CrossRefGoogle Scholar
76 Egger, M Davey Smith, G Schneider, M Minder, C Bias in meta-analysis detected by a simple, graphical test. BMJ 1997; 315: 629634.CrossRefGoogle ScholarPubMed
77 Daniels, L. A group cognitive-behavioral and process-oriented approach to treating the social impairment and negative symptoms associated with chronic mental illness. J Psychother Pract Res 1998; 7: 167176.Google ScholarPubMed
78 Levine, J Barak, Y Granek, I Cognitive group therapy for paranoid schizophrenics: applying cognitive dissonance. J Cogn Psychother 1998; 12: 312.CrossRefGoogle Scholar
79 Haddock, G Tarrier, N Morrison, AP Hopkins, R Drake, R Lewis, S A pilot study evaluating the effectiveness of individual inpatient cognitive-behavioural therapy in early psychosis. Soc Psychiatry Psychiatr Epidemiol 1999; 34: 254258.CrossRefGoogle ScholarPubMed
80 Pinto, A La Pia, S Mennella, R Giorgio, D DeSimone, L Cognitive-behavioral therapy and clozapine for clients with treatment-refractory schizophrenia. Psychiatr Serv 1999; 50: 901904.CrossRefGoogle ScholarPubMed
81 Turkington, D Kingdon, D. Cognitive–behavioural techniques for general psychiatrists in the management of patients with psychoses. Br J Psychiatry 2000; 177: 101106.CrossRefGoogle ScholarPubMed
82 Granholm, E McQuaid, JR McClure, FS Pedrelli, P Jeste, DV A randomized controlled pilot study of cognitive behavioral social skills training for older patients with schizophrenia. Schizophr Res 2002; 53: 167169.CrossRefGoogle ScholarPubMed
83 Gumley, A O'Grady, M McNay, L Reilly, J Power, K Norrie, J Early intervention for relapse in schizophrenia: results of a 12-month randomized controlled trial of cognitive behavioural therapy. Psychol Med 2003; 33: 419431.CrossRefGoogle ScholarPubMed
84 Rector, NA Seeman, MV Segal, ZV Cognitive therapy for schizophrenia: a preliminary randomized controlled trial. Schizophr Res 2003; 63: 111.CrossRefGoogle ScholarPubMed
85 Wang, C Li, Y Zhao, Z Controlled study on long-term effect of cognitive behavior intervention on first episode schizophrenia. Chin Ment Health J 2003; 17: 200202.Google Scholar
86 Startup, M Jackson, MC Bendix, S North Wales randomized controlled trial of cognitive behaviour therapy for acute schizophrenia spectrum disorders: outcomes at 6 and 12 months. Psychol Med 2004; 34: 413422.CrossRefGoogle ScholarPubMed
87 Trower, P Birchwood, M Meaden, A Byrne, S Nelson, A Ross, K Cognitive therapy for command hallucinations: randomised controlled trial. Br J Psychiatry 2004; 184: 312320.CrossRefGoogle ScholarPubMed
88 Cather, C Penn, D Otto, MW Yovel, I Mueser, KT Goff, DC A pilot study of functional cognitive behavioral therapy (fCBT) for schizophrenia. Schizophr Res 2005; 74: 201209.CrossRefGoogle ScholarPubMed
89 Valmaggia, LR van der Gaag, M Tarrier, N Pijnenborg, M Slooff, CJ Cognitive–behavioural therapy for refractory psychotic symptoms of schizophrenia resistant to atypical antipsychotic medication. Randomised controlled trial. Br J Psychiatry 2005; 186: 324330.CrossRefGoogle ScholarPubMed
90 Wykes, T Hayward, P Thomas, N Green, N Surguladze, S Fannon, D et al. What are the effects of group cognitive behaviour therapy for voices? A randomised control trial. Schizophr Res 2005; 77: 201210.CrossRefGoogle ScholarPubMed
91 Barrowclough, C Haddock, G Lobban, F Jones, S Siddle, R Roberts, C et al. Group cognitive–behavioural therapy for schizophrenia. Randomised controlled trial. Br J Psychiatry 2006; 189: 527532.CrossRefGoogle ScholarPubMed
92 Penadés, R Catalan, R Salamero, M Boget, T Puig, O Guarch, J et al. Cognitive remediation therapy for outpatients with chronic schizophrenia: a controlled and randomized study. Schizophr Res 2006; 87: 323331.CrossRefGoogle ScholarPubMed
93 McLeod, T Morris, M Birchwood, M Dovey, A Cognitive behavioural therapy group work with voice hearers. Part 2. Br J Nurs 2007; 16: 292295.CrossRefGoogle ScholarPubMed
94 Deng, L-H Li, Y-D Song, Z-W Controlled trial of cognitive behavioral therapy for slowly-episode schizophrenia [in Chinese]. Med J Chin People's Health 2008; 15: 17021707.Google Scholar
95 England, M. Significance of cognitive intervention for voice hearers. Perspect Psychiatr Care 2008; 44: 4047.CrossRefGoogle ScholarPubMed
96 Wu, N Wang, Q Kong, L A controlled study of cognitive behaviour therapy in chronic schizophrenia [in Chinese]. J Clin Psychosom Dis 2008; 14: 206207.Google Scholar
97 Rathod, S Phiri, P Harris, S Underwood, C Thagadur, M Padmanabi, U et al. Cognitive behaviour therapy for psychosis can be adapted for minority ethnic groups: a randomised controlled trial. Schizophr Res 2013; 143: 319326.CrossRefGoogle ScholarPubMed
98 Hunt, N. How Science takes Stock: The Story of Meta-Analysis. Sage, 1997.Google Scholar
99 Schulz, KF Chalmers, I Hayes, RJ Altman, DG Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273: 408412.CrossRefGoogle ScholarPubMed
100 Wood, L Egger, M Gluud, LL Schulz, KF Juni, P Altman, DG et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ 2008; 336: 601605.CrossRefGoogle ScholarPubMed
101 Hrobjartsson, A Thomsen, AS Emanuelsson, F Tendal, B Hilden, J Boutron, I et al. Observer bias in randomised clinical trials with binary outcomes: systematic review of trials with both blinded and non-blinded outcome assessors. BMJ 2012; 344: e1119.CrossRefGoogle ScholarPubMed
102 Gillespie, R. Manufacturing Knowledge: A History of the Hawthorne Experiments. Cambridge University Press, 1991.Google Scholar
103 Niemeyer, H Musch, J Pietrowsky, R Publication bias in meta-analyses of the efficacy of psychotherapeutic interventions for schizophrenia. Schizophr Res 2012; 138: 103112.CrossRefGoogle ScholarPubMed
104 Cuijpers, P Smit, F Bohlmeijer, E Hollon, SD Andersson, G Efficacy of cognitive–behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias. Br J Psychiatry 2010; 196: 173178.CrossRefGoogle ScholarPubMed
105 The All Party Parliamentary Group on Mental Health. Implementation of NICE Guideline on Schizophrenia. Department of Health, 2010.Google Scholar
Figure 0

Fig. 1 Flow chart of the selection process.

Figure 1

Fig. 2 Forest plot of studies in the meta-analysis of overall symptoms.CBT, cognitive-behavioural therapy.

Figure 2

Fig. 3 Forest plot of studies in the meta-analysis of positive symptoms.CBT, cognitive-behavioural therapy.

Figure 3

Table 1 Comparisons between studies at high and low risk of bias from masking, allocation concealment and incomplete outcome data

Figure 4

Table 2 Comparison between studies not using and using a control intervention

Figure 5

Fig. 4 Funnel plots of studies in the meta-analyses of overall symptoms (a), positive symptoms (b) and negative symptoms (c).Studies with positive findings are to the left; white circles are imputed studies.

Figure 6

Table 3 Results of tests for publication bias in the analyses of overall symptoms, positive symptoms and negative symptoms

Supplementary material: PDF

Jauhar et al. supplementary material

Supplementary Material

Download Jauhar et al. supplementary material(PDF)
PDF 146.9 KB
Submit a response

eLetters

No eLetters have been published for this article.