The British Journal of Psychiatry (2008) 192: 401-403. doi: 10.1192/bjp.bp.108.053876
© 2008 The Royal College of Psychiatrists
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit an eLetter
Right arrow View responses
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Related articles in BJP
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Scott, J.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Scott, J.

EDITORIALS

Cognitive–behavioural therapy for severe mental disorders: back to the future?{dagger}

Jan Scott, MD FRCPsych

School of Neurology, Neurobiology & Psychiatry, University of Newcastle, Newcastle upon Tyne NE1 7RU, UK. Email: jan.scott{at}newcastle.ac.uk

Declaration of interest

Jan Scott was Principal Investigator on the Medical Research Council effectiveness study of cognitive–behavioural therapy for bipolar disorders and on the Trial Steering Committee for the Welcome study undertaken by Garety et al (in this issue). She has received honoraria for Continuing Medical Education talks on psychological therapies for severe mental disorders from AstraZeneca, BMS-Otsuka, Eli Lilly, GlaxoSmithKline, Jansen-Cilag and Sanofi Aventis.

Jan Scott (pictured) is Professor of Psychological Medicine at the University of Newcastle, UK. She is a Distinguished Founding Fellow of the Academy of Cognitive Therapy.

{dagger} See pp. 412–23, this issue. Back


arrow
ABSTRACT
 
Like recent medication studies, it appears that when cognitive–behavioural therapy is tested in pragmatic effectiveness trials involving routine clinical populations it does not fare as well as in efficacy trials. Given the multitude of factors that can `muddy the waters' in clinical trials, how do we best make sense of the findings?


arrow
INTRODUCTION
 


Figure 1
View larger version (131K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
The basic aims of treatments for schizophrenia, and indeed all severe mental disorders, are to reduce symptoms and distress, enhance functioning and prevent relapse. For many decades, individual variability in the nature and severity of symptoms and differing responses to available treatments suggested achieving these aims would remain elusive. The introduction of second-generation atypical antipsychotics followed by developments such as cognitive–behavioural therapy (CBT) for medication-refractory delusions created renewed optimism, especially as initial randomised controlled trials (RCTs) indicated that these new interventions produced significantly better clinical outcomes with fewer side-effects than all the previously established treatments. Presentations at research meetings began to echo the Dodo in Alice's Adventures in Wonderland: `Everybody had won and all must have prizes'.1 Further efficacy RCTs of second-generation antipsychotics and CBT demonstrated benefits across the full range of severe mental disorders – indeed, a cursory review of the research literature at the turn of the century might easily leave the impression that second-generation antipsychotics and CBT were psychiatry's equivalent of steroids in general medicine.

Failures to replicate the initial impressive benefits in later trials together with a series of meta-analyses of antipsychotics and psychological therapies for schizophrenia suggested that effects had been overestimated. Sadly, this information neither received as much attention as the results of earlier studies, nor deterred those advocating for increased availability of these interventions. The National Institute for Health and Clinical Excellence (NICE)2 in the UK, and similar international organisations elsewhere, published treatment guidelines recommending therapeutic doses of antipsychotic medication,3 with a nod of approval towards the newer second-generation antipsychotics, as the mainstay of clinical management, but also promoted wider access to adjunctive `empirically supported' therapies such as family therapy and CBT. Providing CBT for psychosis across the National Health Service (NHS) was not supported unanimously.4 However, the guidance was based on the balance of available evidence at that time from RCTs, still the gold standard for judging the relative benefits of treatments.5 Most of these trials involved selected patient populations and now we have new evidence from larger pragmatic studies that the second-generation antipsychotics have, quite literally, been oversold,6 and the trial of CBT reported in this issue by Garety et al,7 seems to suggest that this treatment too is in a similar position. So the important question is whether we have truly been led astray or whether these larger studies in the real world are defective and have come up with the wrong answers?

Large-scale multicentre efficacy RCTs of (relatively) homogeneous patient populations are critical in establishing the benefits and tolerability of antipsychotic compounds, but most of these have the prime objective of meeting regulatory requirements. Narrow inclusion criteria dictate that only about 10% of individuals receiving treatment for schizophrenia are eligible for recruitment.8 The necessary post-marketing, large-scale effectiveness RCTs are seldom undertaken, but those available less commonly indicate clear advantages for new medications. It is this limited focus and lack of generalisability of efficacy trials that has prompted the multicentre CATIE (Clinical Antipsychotic Trials of Intervention Effectiveness) and CUtLASS (Cost Utility of the Latest Antipsychotic Drugs in Schizophrenia Study) trials.6,9 The benefits achieved were considerably less than for highly selected patients receiving carefully titrated doses of medication in controlled research environments.6,812 The medication efficacy-effectiveness gap and failure to achieve significant recovery in schizophrenia stimulated the introduction of adjunctive psychological treatment for those with severe mental disorders. Ironically, the data supporting adjunctive therapy has virtually all come from efficacy RCTs, and it is important to acknowledge that it is not just Big Pharma that introduces bias into such studies;5 it is equally possible with psychological treatments, and the findings are as much at risk of tendentious reporting as medication studies. The consequence of this now seems to be that when independent multicentre RCTs of effectiveness are carried out in `real world' secondary care settings the apparent additional benefits of new treatments disappear.6,9,1315 It is in this context that the trial of Garety et al7 needs to be judged.

Onken et al16 describe three progressive stages in the evolution of evidence-based therapies: the development phase (feasibility studies, development of therapy manuals), efficacy RCTs and exploratory studies of mechanisms of action, and studies of generalisability and transportability. Cognitive–behavioural therapy for psychosis had a remarkably long gestation, with case reports appearing nearly 40 years before the publication of pilot RCTs and therapy manuals. There are now over 30 published efficacy trials and a recent comprehensive meta-analysis17 reported that, compared with usual treatment alone, CBT plus usual treatment demonstrates statistically significant effects on depression, anxiety, positive and negative symptoms and functioning, but not relapse rates. It confirmed that individuals who show the most robust benefit from CBT for psychosis have stable, persistent but distressing, medication-refractory positive symptoms. However, the meta-analysis also demonstrated that as sample sizes and methodological rigour increase, effect sizes decrease by 50–100%.


arrow
Effectiveness trials and the exploration of generalisability
 
In light of this comprehensive evaluation of existing research,17 the findings of Garety et al7 fall within the range of expected outcomes. The design of their trial also offers insights into factors affecting the general application of CBT and family therapy for psychoses. The findings that CBT is not effective in reducing relapses in psychosis, yet has some benefit on depression, delusional distress and social functioning are consistent with the more modest effect sizes reported in larger-scale efficacy RCTs. Also, Garety et al note that in CBT, for people with psychosis, some of the therapy benefits are restricted to those living with a significant other person (a factor known to predict better outcome in CBT for depression). Unfortunately, the equivalence in group outcomes was not a consequence of a good response to standard care in the controls but rather to a disappointing lack of progress across all randomised groups. Although suboptimal prescribing3 and non-adherence were frequent, the clear message was that adjunctive therapy did not perform well and it is important to consider the reasons for this. First, in a sample predominantly comprised of single males, the acceptability of and adherence with therapy was no greater than for medication; the drop-out rates for CBT and family therapy (25–30%) are equivalent to those reported for medication, while those allocated to therapy usually attended only about 60% of the sessions offered. Furthermore, even though access to NHS therapy is still restricted and waiting times extensive, only 44% of more than 600 potential participants agreed to inclusion. It is highly likely that, among the many reasons for this low level of agreement, some declined because they did not want therapy. It seemed especially hard to get patients and their family to simultaneously consent to participate in family therapy, and there appeared to be under-representation of high `expressed emotion' families (those we might postulate would benefit most from family therapy) among those recruited.

One barrier to the generalisability of CBT may be the level of competence of local therapists and their compliance to the model. Garety et al monitored quality as much as was feasible, but their comment that `therapy was competently delivered', may be an overestimate. The data provided only allow us to conclude that 44% of those in the CBT and 39% in the family therapy groups received some sessions that met appropriate standards. More tellingly, the authors discuss that, in the absence of acute symptoms or distress, CBT therapists often found it difficult to maintain a clear focus and instead covered a wide range of nonspecific problems and `adopted a general approach to emotional distress'. The lack of specific active elements of CBT would suggest the approach had relatively few features distinguishing it from generic case management. This may have undermined the effectiveness of CBT in this RCT, but it is a realistic representation of the problems of delivering therapy in general clinical settings.


arrow
Every treatment has limits
 
No single research trial provides the answers to all the questions that arise when we endeavour to employ research-proven treatments in clinical practice. Critics of efficacy RCTs are quick to suggest we cannot use reported outcomes to predict response rates in heterogeneous clinical samples, but critics of effectiveness trials justifiably argue that these RCTs just trade one set of problems for another. Broad-based, pragmatic trials with few exclusion criteria often mean that moderators of group outcome (e.g. duration of illness, social support, comorbidities, quality of prescribing, compliance) produce so much `noise' that the chances of uncovering evidence of differential treatment response are minimised.7,1315 However, RCTs report group outcomes while clinicians treat individuals and we will continue to make selective rather than blanket referrals for CBT. Clinically meaningful information about who is more likely to do well or badly with different treatment packages can be provided from secondary and/or post hoc analyses of effectiveness trials.6,13 These secondary studies, despite the perils of post hoc interpretation, can also pave the way for the next step in the research process. In Garety et al's study, the standard deviations are very wide for most of the continuous measures, suggesting considerable interindividual variability in outcome. It may be possible to identify signals relating to patient, therapy/therapist, or combinations of factors suggesting under what circumstances adjunctive therapy should be employed or directing us to where further studies are warranted. Garety et al's study should not be interpreted as a setback for CBT research, but it introduces some healthy realism about the limits for the role of adjunctive therapy in severe mental disorders. It is also a timely reminder that, away from the `therapy for all' media hysteria, the world of routine psychiatric practice brings us into contact with some patients who do not want or do not respond optimally to antipsychotic medication, but who also do not always want or benefit from psychological therapies either.


arrow
REFERENCES
 
    1
  1. Carroll L. Alice's Adventures in Wonderland. Macmillan & Co, 1865.
  2. 2
  3. National Institute for health and Clinical Excellence. Schizophrenia: Core interventions in the Treatment and Management of Schizophrenia in Primary and Secondary Care. NICE, 2003 .
  4. 3
  5. Baldessarini RJ, Cohen BM, Teicher MH. Significance of neuroleptic dose and plasma level in the pharmacological treatment of psychoses. Arch Gen Psychiatry 1988; 45: 79-91.[Abstract/Free Full Text]
  6. 4
  7. McKenna P. What works in schizophrenia: cognitive behaviour therapy is not effective. BMJ 2006; 333: 353.[Free Full Text]
  8. 5
  9. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effect in controlled trials. JAMA 1995; 273: 408 -12.[Abstract/Free Full Text]
  10. 6
  11. Lieberman JA, Stroup S, McEvoy JP, Swartz MS, Rosenheck RA, Perkins DO, Keefe RSE, Davis SM, Davis CE, Lebowitz BD, Severe J, Hsiao JK, for the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) Investigators. Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. N Engl J Med 2005; 353: 1209 -23.[Abstract/Free Full Text]
  12. 7
  13. Garety P, Fowler DG, Freeman D, Bebbington P, Dunn G, Kuipers E. Cognitive–behavioural therapy and family intervention for relapse prevention and symptom reduction in psychosis: randomised controlled trial. Br J Psych 2008; 192: 412 -23.[Abstract/Free Full Text]
  14. 8
  15. Leucht S, Heres S, Hamann J, Kane JM. Methodological issues in current antipsychotic drug trials. Schizophr Bull 2008; 34: 275 -85.[Abstract/Free Full Text]
  16. 9
  17. Jones PB, Barnes TR, Davies L, Dunn G, Lloyd H, Hayhurst KP, Murray RM, Markwick A, Lewis SW. Randomized controlled trial of effect on quality of life of second- vs first-generation antipsychotic drugs in schizophrenia. Cost Utility of the Latest Antipsychotic Drugs in Schizophrenia Study (CUtLASS 1). Arch Gen Psychiatry 2006; 63: 1079 -87.[Abstract/Free Full Text]
  18. 10
  19. Heres S, Davis J, Maino K, Jetzinger E, Kissling W, Leucht S. Why olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine beats olanzapine: an exploratory analysis of head-to-head comparison studies of second-generation antipsychotics. Am J Psychiatry 2006; 163: 185 -94.[Abstract/Free Full Text]
  20. 11
  21. Lewis S, Lieberman J. CATIE and CUtLASS: can we handle the truth? Br J Psychiatry 2008; 192: 161-3.[Abstract/Free Full Text]
  22. 12
  23. Davies LM, Lewis S, Jones PB, Barnes TRE, Gaughran F, Hayhurst K, Markwick A, Lloyd H on behalf of the CUtLASS team. Cost-effectiveness of first- v. second-generation antipsychotic drugs: results from a randomised controlled trial in schizophrenia responding poorly to previous therapy. Br J Psychiatry 2007; 191: 14-22.[Abstract/Free Full Text]
  24. 13
  25. Scott J, Paykel E, Morriss R, Bentall R, Kinderman P, Hayhurst H, Abbot R, Johnson T. Cognitive–behavioural therapy for severe and recurrent bipolar disorders: randomised controlled trial. Br J Psychiatry 2006; 188: 313 -20.[Abstract/Free Full Text]
  26. 14
  27. Tarrier N, Lewis S, Haddock G, Bentall R, Drake R, Kinderman P, Kingdon D, Siddle R, Everitt J, Leadley K, Benn A, Grazebrook K, Haley C, Akhtar S, Davies L, Palmer S, Dunn G. Cognitive–behavioural therapy in first-episode and early schizophrenia. 18-month follow-up of a randomised controlled trial. Br J Psychiatry 2004; 184: 231-9.[Abstract/Free Full Text]
  28. 15
  29. Tyrer P, Thompson S, Schmidt U, Jones V, Knapp M, Davidson K, Catalan J, Airlie J, Baxter S, Byford S, Byrne G, Cameron S, Caplan R, Cooper S, Ferguson B, Freeman C, Frost S, Godley J, Greenshields J, Henderson J, Holden N, Keech P, Kim L, Logan K, Manley C, MacLeod A, Murphy R, Patience L, Ramsay L, De Munroz S, Scott J, Seivewright H, Sivakumar K, Tata P, Thornton S, Ukoumunne OC, Wessely S. Randomized controlled trial of brief cognitive behaviour therapy versus treatment as usual in recurrent deliberate self-harm: the POPMACT study. Psychol Med 2003; 33: 969-76.[CrossRef][Medline]
  30. 16
  31. Onken L, Blaine J, Battjes R. Behavioural therapy research: a conceptualization of a process. In Innovative Approaches From Difficult To Treat Populations (eds. S Hengeler, R Amentos): 477 -85. American Psychiatric Press, 1977 .
  32. 17
  33. Wykes T, Steel C, Everitt B, Tarrier N. Cognitive behavior therapy for schizophrenia: effect sizes, clinical models, and methodological rigor. Schizophr Bull 2008; 34: 523-37.[Abstract/Free Full Text]
Received for publication April 9, 2008. Revision received April 17, 2008. Accepted for publication April 17, 2008.


Related articles in BJP:

Cognitive–behavioural therapy and family intervention for relapse prevention and symptom reduction in psychosis: randomised controlled trial
Philippa A. Garety, David G. Fowler, Daniel Freeman, Paul Bebbington, Graham Dunn, and Elizabeth Kuipers
BJP 2008 192: 412-423. [Abstract] [Full Text]  

From the Editor's desk
Peter Tyrer
BJP 2008 192: 482. [Full Text]  



This article has been cited by other articles:


Home page
Br. J. PsychiatryHome page
K. Marlowe
Risk of harm after psychological intervention
The British Journal of Psychiatry, October 1, 2008; 193(4): 345 - 345.
[Full Text] [PDF]

eLetters:

Read all eLetters

Mindfulness Based Cognitive Behavioural Therapy (MBCT) and awareness in basic requirements for Evide
Alain Braillon, et al.
BJP Online, 31 Jul 2008 [Full text]

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit an eLetter
Right arrow View responses
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Related articles in BJP
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Scott, J.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Scott, J.