The British Journal of Psychiatry (2008) 192: 401-403. doi: 10.1192/bjp.bp.108.053876
© 2008 The Royal College of Psychiatrists
Cognitive–behavioural therapy for severe mental disorders: back to the future?
Jan Scott, MD FRCPsych
School of Neurology, Neurobiology & Psychiatry, University of
Newcastle, Newcastle upon Tyne NE1 7RU, UK. Email:
jan.scott{at}newcastle.ac.uk
Declaration of interest
Jan Scott was Principal Investigator on the Medical Research Council
effectiveness study of cognitive–behavioural therapy for bipolar
disorders and on the Trial Steering Committee for the Welcome study undertaken
by Garety et al (in this issue). She has received honoraria for
Continuing Medical Education talks on psychological therapies for severe
mental disorders from AstraZeneca, BMS-Otsuka, Eli Lilly, GlaxoSmithKline,
Jansen-Cilag and Sanofi Aventis.
Jan Scott (pictured) is Professor of Psychological Medicine at the
University of Newcastle, UK. She is a Distinguished Founding Fellow of the
Academy of Cognitive Therapy.
See pp.
412–23, this
issue. 

ABSTRACT
Like recent medication studies, it appears that when
cognitive–behavioural
therapy is tested in pragmatic effectiveness
trials involving
routine clinical populations it does not fare as well as in
efficacy trials. Given the multitude of factors that can `muddy
the waters' in
clinical trials, how do we best make sense of
the findings?

INTRODUCTION
The basic aims of treatments for schizophrenia, and indeed all
severe
mental disorders, are to reduce symptoms and distress,
enhance functioning and
prevent relapse. For many decades,
individual variability in the nature and
severity of symptoms
and differing responses to available treatments suggested
achieving
these aims would remain elusive. The introduction of
second-generation
atypical antipsychotics followed by developments such as
cognitive–behavioural
therapy (CBT) for medication-refractory delusions
created renewed
optimism, especially as initial randomised controlled trials
(RCTs) indicated that these new interventions produced significantly
better
clinical outcomes with fewer side-effects than all the
previously established
treatments. Presentations at research
meetings began to echo the Dodo in
Alice's Adventures in Wonderland:
`Everybody had won and all must
have prizes'.
1
Further efficacy
RCTs of second-generation antipsychotics and CBT demonstrated
benefits across the full range of severe mental disorders –
indeed, a
cursory review of the research literature at the
turn of the century might
easily leave the impression that
second-generation antipsychotics and CBT were
psychiatry's
equivalent of steroids in general medicine.
Failures to replicate the initial impressive benefits in later trials
together with a series of meta-analyses of antipsychotics and psychological
therapies for schizophrenia suggested that effects had been overestimated.
Sadly, this information neither received as much attention as the results of
earlier studies, nor deterred those advocating for increased availability of
these interventions. The National Institute for Health and Clinical Excellence
(NICE)2 in the UK,
and similar international organisations elsewhere, published treatment
guidelines recommending therapeutic doses of antipsychotic
medication,3 with a
nod of approval towards the newer second-generation antipsychotics, as the
mainstay of clinical management, but also promoted wider access to adjunctive
`empirically supported' therapies such as family therapy and CBT. Providing
CBT for psychosis across the National Health Service (NHS) was not supported
unanimously.4
However, the guidance was based on the balance of available evidence at that
time from RCTs, still the gold standard for judging the relative benefits of
treatments.5 Most of
these trials involved selected patient populations and now we have new
evidence from larger pragmatic studies that the second-generation
antipsychotics have, quite literally, been
oversold,6 and the
trial of CBT reported in this issue by Garety et
al,7 seems to
suggest that this treatment too is in a similar position. So the important
question is whether we have truly been led astray or whether these larger
studies in the real world are defective and have come up with the wrong
answers?
Large-scale multicentre efficacy RCTs of (relatively) homogeneous patient
populations are critical in establishing the benefits and tolerability of
antipsychotic compounds, but most of these have the prime objective of meeting
regulatory requirements. Narrow inclusion criteria dictate that only about 10%
of individuals receiving treatment for schizophrenia are eligible for
recruitment.8 The
necessary post-marketing, large-scale effectiveness RCTs are seldom
undertaken, but those available less commonly indicate clear advantages for
new medications. It is this limited focus and lack of generalisability of
efficacy trials that has prompted the multicentre CATIE (Clinical
Antipsychotic Trials of Intervention Effectiveness) and CUtLASS (Cost Utility
of the Latest Antipsychotic Drugs in Schizophrenia Study)
trials.6,9
The benefits achieved were considerably less than for highly selected patients
receiving carefully titrated doses of medication in controlled research
environments.6,8–12
The medication efficacy-effectiveness gap and failure to achieve significant
recovery in schizophrenia stimulated the introduction of adjunctive
psychological treatment for those with severe mental disorders. Ironically,
the data supporting adjunctive therapy has virtually all come from efficacy
RCTs, and it is important to acknowledge that it is not just Big Pharma that
introduces bias into such
studies;5 it is
equally possible with psychological treatments, and the findings are as much
at risk of tendentious reporting as medication studies. The consequence of
this now seems to be that when independent multicentre RCTs of effectiveness
are carried out in `real world' secondary care settings the apparent
additional benefits of new treatments
disappear.6,9,13–15
It is in this context that the trial of Garety et
al7 needs to be
judged.
Onken et
al16 describe
three progressive stages in the evolution of evidence-based therapies: the
development phase (feasibility studies, development of therapy manuals),
efficacy RCTs and exploratory studies of mechanisms of action, and studies of
generalisability and transportability. Cognitive–behavioural therapy for
psychosis had a remarkably long gestation, with case reports appearing nearly
40 years before the publication of pilot RCTs and therapy manuals. There are
now over 30 published efficacy trials and a recent comprehensive
meta-analysis17
reported that, compared with usual treatment alone, CBT plus usual treatment
demonstrates statistically significant effects on depression, anxiety,
positive and negative symptoms and functioning, but not relapse rates. It
confirmed that individuals who show the most robust benefit from CBT for
psychosis have stable, persistent but distressing, medication-refractory
positive symptoms. However, the meta-analysis also demonstrated that as sample
sizes and methodological rigour increase, effect sizes decrease by
50–100%.

Effectiveness trials and the exploration of generalisability
In light of this comprehensive evaluation of existing
research,
17 the
findings of Garety
et
al7 fall within
the range of expected
outcomes. The design of their trial also offers insights
into
factors affecting the general application of CBT and family
therapy for
psychoses. The findings that CBT is not effective
in reducing relapses in
psychosis, yet has some benefit on
depression, delusional distress and social
functioning are
consistent with the more modest effect sizes reported in
larger-scale
efficacy RCTs. Also, Garety
et al note that in CBT, for
people
with psychosis, some of the therapy benefits are restricted
to those
living with a significant other person (a factor known
to predict better
outcome in CBT for depression). Unfortunately,
the equivalence in group
outcomes was not a consequence of
a good response to standard care in the
controls but rather
to a disappointing lack of progress across all randomised
groups.
Although suboptimal
prescribing
3 and
non-adherence were frequent,
the clear message was that adjunctive therapy did
not perform
well and it is important to consider the reasons for this. First,
in a sample predominantly comprised of single males, the acceptability
of and
adherence with therapy was no greater than for medication;
the drop-out rates
for CBT and family therapy (25–30%)
are equivalent to those reported for
medication, while those
allocated to therapy usually attended only about 60%
of the
sessions offered. Furthermore, even though access to NHS therapy
is
still restricted and waiting times extensive, only 44% of
more than 600
potential participants agreed to inclusion. It
is highly likely that, among
the many reasons for this low
level of agreement, some declined because they
did not want
therapy. It seemed especially hard to get patients and their
family to simultaneously consent to participate in family therapy,
and there
appeared to be under-representation of high `expressed
emotion' families
(those we might postulate would benefit most
from family therapy) among those
recruited.
One barrier to the generalisability of CBT may be the level of competence
of local therapists and their compliance to the model. Garety et al
monitored quality as much as was feasible, but their comment that `therapy was
competently delivered', may be an overestimate. The data provided only allow
us to conclude that 44% of those in the CBT and 39% in the family therapy
groups received some sessions that met appropriate standards. More tellingly,
the authors discuss that, in the absence of acute symptoms or distress, CBT
therapists often found it difficult to maintain a clear focus and instead
covered a wide range of nonspecific problems and `adopted a general approach
to emotional distress'. The lack of specific active elements of CBT would
suggest the approach had relatively few features distinguishing it from
generic case management. This may have undermined the effectiveness of CBT in
this RCT, but it is a realistic representation of the problems of delivering
therapy in general clinical settings.

Every treatment has limits
No single research trial provides the answers to all the questions
that
arise when we endeavour to employ research-proven treatments
in clinical
practice. Critics of efficacy RCTs are quick to
suggest we cannot use reported
outcomes to predict response
rates in heterogeneous clinical samples, but
critics of effectiveness
trials justifiably argue that these RCTs just trade
one set
of problems for another. Broad-based, pragmatic trials with
few
exclusion criteria often mean that moderators of group
outcome (e.g. duration
of illness, social support, comorbidities,
quality of prescribing, compliance)
produce so much `noise'
that the chances of uncovering evidence of
differential treatment
response are
minimised.
7,13–15
However, RCTs report
group outcomes while clinicians treat individuals and we
will
continue to make selective rather than blanket referrals for
CBT.
Clinically meaningful information about who is more likely
to do well or badly
with different treatment packages can be
provided from secondary and/or
post hoc analyses of effectiveness
trials.
6,13
These secondary studies, despite the perils of
post hoc interpretation, can
also pave the way for the next
step in the research process. In Garety
et
al's study, the
standard deviations are very wide for most of the
continuous
measures, suggesting considerable interindividual variability
in
outcome. It may be possible to identify signals relating
to patient,
therapy/therapist, or combinations of factors suggesting
under what
circumstances adjunctive therapy should be employed
or directing us to where
further studies are warranted. Garety
et al's study should not be
interpreted as a setback for CBT
research, but it introduces some healthy
realism about the
limits for the role of adjunctive therapy in severe mental
disorders.
It is also a timely reminder that, away from the `therapy for
all'
media hysteria, the world of routine psychiatric practice
brings us into
contact with some patients who do not want or
do not respond optimally to
antipsychotic medication, but who
also do not always want or benefit from
psychological therapies
either.

REFERENCES
1 - Carroll L. Alice's Adventures in
Wonderland. Macmillan & Co, 1865.
2 - National Institute for health and Clinical Excellence.
Schizophrenia: Core interventions in the Treatment and Management
of Schizophrenia in Primary and Secondary Care. NICE, 2003
.
3 - Baldessarini RJ, Cohen BM, Teicher MH. Significance of neuroleptic
dose and plasma level in the pharmacological treatment of psychoses.
Arch Gen Psychiatry 1988;
45: 79-91.[Abstract/Free Full Text]
4 - McKenna P. What works in schizophrenia: cognitive behaviour therapy
is not effective. BMJ 2006;
333: 353.[Free Full Text]
5 - Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of
bias: dimensions of methodological quality associated with estimates of
treatment effect in controlled trials. JAMA 1995; 273: 408
-12.[Abstract/Free Full Text]
6 - Lieberman JA, Stroup S, McEvoy JP, Swartz MS, Rosenheck RA, Perkins
DO, Keefe RSE, Davis SM, Davis CE, Lebowitz BD, Severe J, Hsiao JK, for the
Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE)
Investigators. Effectiveness of antipsychotic drugs in patients with chronic
schizophrenia. N Engl J Med 2005;
353: 1209
-23.[Abstract/Free Full Text]
7 - Garety P, Fowler DG, Freeman D, Bebbington P, Dunn G, Kuipers E.
Cognitive–behavioural therapy and family intervention for relapse
prevention and symptom reduction in psychosis: randomised controlled trial.
Br J Psych 2008;
192: 412
-23.[Abstract/Free Full Text]
8 - Leucht S, Heres S, Hamann J, Kane JM. Methodological issues in
current antipsychotic drug trials. Schizophr Bull 2008; 34: 275
-85.[Abstract/Free Full Text]
9 - Jones PB, Barnes TR, Davies L, Dunn G, Lloyd H, Hayhurst KP, Murray
RM, Markwick A, Lewis SW. Randomized controlled trial of effect on quality of
life of second- vs first-generation antipsychotic drugs in schizophrenia. Cost
Utility of the Latest Antipsychotic Drugs in Schizophrenia Study (CUtLASS 1).
Arch Gen Psychiatry 2006;
63: 1079
-87.[Abstract/Free Full Text]
10 - Heres S, Davis J, Maino K, Jetzinger E, Kissling W, Leucht S. Why
olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine
beats olanzapine: an exploratory analysis of head-to-head comparison studies
of second-generation antipsychotics. Am J Psychiatry 2006; 163: 185
-94.[Abstract/Free Full Text]
11 - Lewis S, Lieberman J. CATIE and CUtLASS: can we handle the truth?
Br J Psychiatry 2008;
192: 161-3.[Abstract/Free Full Text]
12 - Davies LM, Lewis S, Jones PB, Barnes TRE, Gaughran F, Hayhurst K,
Markwick A, Lloyd H on behalf of the CUtLASS team. Cost-effectiveness of
first- v. second-generation antipsychotic drugs: results from a randomised
controlled trial in schizophrenia responding poorly to previous therapy.
Br J Psychiatry 2007;
191: 14-22.[Abstract/Free Full Text]
13 - Scott J, Paykel E, Morriss R, Bentall R, Kinderman P, Hayhurst H,
Abbot R, Johnson T. Cognitive–behavioural therapy for severe and
recurrent bipolar disorders: randomised controlled trial. Br J
Psychiatry 2006; 188: 313
-20.[Abstract/Free Full Text]
14 - Tarrier N, Lewis S, Haddock G, Bentall R, Drake R, Kinderman P,
Kingdon D, Siddle R, Everitt J, Leadley K, Benn A, Grazebrook K, Haley C,
Akhtar S, Davies L, Palmer S, Dunn G. Cognitive–behavioural therapy in
first-episode and early schizophrenia. 18-month follow-up of a randomised
controlled trial. Br J Psychiatry 2004;
184: 231-9.[Abstract/Free Full Text]
15 - Tyrer P, Thompson S, Schmidt U, Jones V, Knapp M, Davidson K,
Catalan J, Airlie J, Baxter S, Byford S, Byrne G, Cameron S, Caplan R, Cooper
S, Ferguson B, Freeman C, Frost S, Godley J, Greenshields J, Henderson J,
Holden N, Keech P, Kim L, Logan K, Manley C, MacLeod A, Murphy R, Patience L,
Ramsay L, De Munroz S, Scott J, Seivewright H, Sivakumar K, Tata P, Thornton
S, Ukoumunne OC, Wessely S. Randomized controlled trial of brief cognitive
behaviour therapy versus treatment as usual in recurrent deliberate self-harm:
the POPMACT study. Psychol Med 2003;
33: 969-76.[CrossRef][Medline]
16 - Onken L, Blaine J, Battjes R. Behavioural therapy research: a
conceptualization of a process. In Innovative Approaches From
Difficult To Treat Populations (eds. S Hengeler, R Amentos): 477
-85. American Psychiatric Press, 1977
.
17 - Wykes T, Steel C, Everitt B, Tarrier N. Cognitive behavior therapy
for schizophrenia: effect sizes, clinical models, and methodological rigor.
Schizophr Bull 2008;
34: 523-37.[Abstract/Free Full Text]
Received for publication April 9, 2008.
Revision received April 17, 2008.
Accepted for publication April 17, 2008.
Related articles in BJP:
- Cognitive–behavioural therapy and family intervention for relapse prevention and symptom reduction in psychosis: randomised controlled trial
- Philippa A. Garety, David G. Fowler, Daniel Freeman, Paul Bebbington, Graham Dunn, and Elizabeth Kuipers
BJP 2008 192: 412-423.
[Abstract]
[Full Text]
- From the Editor's desk
- Peter Tyrer
BJP 2008 192: 482.
[Full Text]
This article has been cited by other articles:

|
 |

|
 |
 
K. Marlowe
Risk of harm after psychological intervention
The British Journal of Psychiatry,
October 1, 2008;
193(4):
345 - 345.
[Full Text]
[PDF]
|
 |
|
eLetters:
Read all eLetters
- Mindfulness Based Cognitive Behavioural Therapy (MBCT) and awareness in basic requirements for Evide
- Alain Braillon, et al.
- BJP Online, 31 Jul 2008
[Full text]