Hostname: page-component-7c8c6479df-8mjnm Total loading time: 0 Render date: 2024-03-28T04:51:26.772Z Has data issue: false hasContentIssue false

Symptom rating scales and outcome in schizophrenia

Published online by Cambridge University Press:  02 January 2018

Ann M. Mortimer*
Affiliation:
Department of Psychiatry, University of Hull, Hertford Building, Cottingham Road, Hull HU6 7RX. Email: a.m.mortimer@hull.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Background

Symptom rating scales are now well established in schizophrenia research buttheir scores are notthe same as outcome

Aims

To appraise the usefulness of symptom rating scales in evaluating the outcome of people with schizophrenia

Method

Literature on the use of the Brief Psychiatric Rating Scale (BPRS) the Positive and Negative Syndrome Scale (PANSS) and the Clinical Global Impression (CGI) in schizophrenia research was studied

Results

Scales were designed to make diagnoses, to categorise patients, syndromes or both, and to demonstrate antipsychotic efficacy, as well as to measure outcome. There is much redundancy both between and within scales. Early work suggests limited concurrent validity with external outcome variables. Data are at best ordinal and there are particular difficulties in equating outcome with percentage changes in scores. The concept of remission, which uses absolute item score thresholds with a duration criterion, is a promising outcome measure

Conclusions

Symptom rating scale scores can only comprise a limited part of outcome measurement. Standardised remission criteria may present advantages in outcome research

Type
Review Articles
Copyright
Copyright © Royal College of Psychiatrists, 2007 

Outcome measures are important in schizophrenia because we need to identify whether outcomes are modified by the medications and psychosocial interventions which we offer. Leaving aside social cultural and environmental factors, before the antipsychotic era it is unlikely that outcome was influenced by anything other than the intrinsic nature and severity of the schizophrenic illness. Providing basic nursing care and protection probably influenced negative outcomes to some extent.

Outcome is not a unitary construct defined simply by lack of symptoms: personal and social function, cognition and quality of life must be of substantial relevance. Other aspects such as economic outcome, although important to commissioners and providers of services, might be of limited consequence to clinicians and patients, who naturally focus on professional and consumer (satisfaction) standpoints respectively. Hence, outcome evaluation applied to services differs from that applied to patients.

Symptom rating scales in schizophrenia were not initially designed to assess the efficacy of antipsychotic drug treatments. Nevertheless, they have been used in this role more than any other. This is not surprising as antipsychotic drugs are used primarily to control patients' symptoms; the underlying neuroscience is consistent with this, and not with any direct therapeutic effects on cognition, personal and social function, or quality of life (unless mediated by symptom control). Although such distal effects have been proposed, there are numerous independent variables which influence these aspects of outcome (e.g. upbringing, premorbid personality and adjustment, intellect and mood, social circumstances and availability of a support network). Furthermore, it has been proposed that antipsychotic drugs, particularly conventional antipsychotics, have little effect on negative symptoms of schizophrenia. Negative symptoms are one of the most clinically important targets, and overlap with cognition and function (Reference Mortimer and SpenceMortimer & Spence, 2001).

SYMPTOM RATINGS AS OUTCOME MEASURES

Although there is evidence that changes in distinct psychopathological dimensions differentially influence broader aspects of outcome (Reference Van Os, Fahy and JonesVan Os et al, 1996) it is now accepted that fixed factors such as duration of untreated psychosis, gender, age of onset and family psychiatric history make a substantial contribution (Reference Murray and Van OsMurray & Van Os, 1998). Symptom rating scales can be viewed as quantifying the skilled clinician's judgement of current psychopathology, and change over time. The worth of routine use of such rating scales in ordinary clinical practice is the subject of continuing debate; the clinician makes an initial, comprehensive assessment of the patient, and reviews this as treatment proceeds and the final outcome becomes clearer. The added value of a highly structured approach can be questioned in a clinical review of an individual patient's progress. Most patients manifest only a minority of the range of possible symptoms and generally do not develop too many new symptoms during treatment. In routine practice, symptom scales are perhaps little more than a formalised guide to what the clinician should be doing already. They have specific utility in training junior staff in the full range of psychopathology they are likely to encounter, and the finer points of mental state examination. Repeated scores, represented graphically, may have some utility in communicating a patient's progress to other clinicians. In research, symptom rating scales in schizophrenia will inform the investigator what is the nature and ‘volume’ of symptoms experienced by the patient, and the magnitude of any change over time.

Limitations

Symptom rating scale data can never be anything more than ordinal; the overall total of symptom item scores will often lump together categorical data, containing symptoms associated in clusters, such as the positive, negative and disorganisation syndromes. Specific syndrome scores derived from scales may have more utility than the total score regarding an overall perspective. Current thinking includes that schizophrenia syndromes may comprise positive (disorganisation and reality distortion) and negative categories, with non-negative affective symptoms (mostly depressive) in a significant minority of patients. Consequently three or four syndrome scores in the context of a defined range may give a reasonable ‘snapshot’ of a patient's current clinical status. Such quantification may inform judgement regarding aetiology, treatment and prognosis (Reference Van Os, Fahy and JonesVan Os et al, 1996). For example, negative symptoms are known to have adverse consequences for personal and social function and cognition (Reference Rocca, Bellino and CalvareseRocca et al, 2005). By contrast, even extensive, but isolated, reality distortion may generate minimal functional consequence, whereas disorganisation syndrome is usually very disruptive (Reference Schuldberg, Quinlan and GlazerSchuldberg et al, 1999). Depression may arise from several sources, with varying outcome (Reference Emsley, Oosthuizen and JoubertEmsley et al, 1999). Such data have implications for treatment interventions. The Clinical Global Impression–Schizophrenia scale (CGI–SCH; Reference Haro, Kamath and OchoaHaro et al, 2003) represents, conceivably, a step in this direction although its positive, negative, depression and cognitive scores are rated according to judgement of severity rather than from items comprising these syndromes.

The value of symptom item or even syndrome score totals per se is increasingly questioned in the determination of outcome status. A more patient-centred definition of outcome, stressing personal and social function, is often viewed as more practical than the presence or absence of esoteric phenomena (symptoms), which may have little bearing on subjective experience or uptake of healthcare. Influential work has attempted to explore the meaning and consequences of delusions and hallucinations for patients (Reference Chadwick and BirchwoodChadwick & Birchwood, 1995), but scales derived from this work are not in widespread use outside the research setting. Self-administered symptom scales have been developed (Reference Hamera, Schneider and PotockyHamera et al, 1996) but again these have not found wide usage, in contrast to the emphasis on patient-rated quality of life as an outcome. Clinicians increasingly seek treatment outcomes such as degree of independent living, time to discontinuation of medication, and time to relapse and rehospitalisation rather than changes in symptom rating scale scores (Reference Tiihonen, Wahlbeck and LonnqvistTiihonen et al, 2006).

Concurrent validity

The question remains whether any rating scale (or factorial components of it) demonstrates sufficient concurrent validity to predict these external outcome variables. Operational definitions of remission may achieve this. These consist of multiple item threshold rather than factorial scores, with the addition of a duration condition. In the absence of concurrent validity with other outcome measures, symptom rating scales can only constitute a small part of the appraisal of overall outcome. Symptom rating scales will answer the question ‘Did the antipsychotic drug work on this patient's symptoms?’ as opposed to ‘What is this patient's outcome?’ Reference Marshall, Lockwood and BradleyMarshall et al, 2000 emphasise that the use of unpublished rating scales in controlled trials is associated with consistent claims of superiority of new treatments and that familiar, well-validated scales may give a more accurate answer.

THE BIG THREE

Three symptom rating scales have dominated the field of schizophrenia research and, in particular, studies of antipsychotic efficacy. With the admonition of Marshall (Reference Marshall, Lockwood and BradleyMarshall et al, 2000) in mind they will be dealt with in some detail here.

Brief Psychiatric Rating Scale

The Brief Psychiatric Rating Scale (BPRS; Reference Overall and GorhamOverall & Gorham, 1962) is a one-page, 16- or 18-item rating scale which was developed more than 40 years ago. It assesses a range of psychotic and affective symptoms rated from both observation of the patient and the patient's own report. The original purpose of the BPRS was the rapid evaluation of clinical change irrespective of origin (e.g. natural remission or treatment response) in the broad range of psychiatric patients, not just those with schizophrenia. It was not, therefore, specifically designed as an outcome measure; the authors hoped that the scale would develop into a diagnostic instrument, which they considered of greater long-term value than detecting change. Standard definitions of outcome were developed later, e.g. ‘consumer outcome is the effect on a patient's health status attributable to an intervention by a health professional or health service’ (Reference Andrews, Peters and TeesonAndrews et al, 1994). Even so, the authors later stated that the BPRS was designed to fill a special need in clinical psychopharmacology research, at the inception of the Early Clinical Drug Evaluation Units of the National Institute of Mental Health in the USA (Reference Overall and GorhamOverall & Gorham, 1988).

Extent of use and adaptation

The BPRS has perhaps been used more extensively than any other symptom rating scale, in many diagnostic groups and for a wide range of purposes. It is highly sensitive to change, and excellent interrater reliability can be achieved with training and a standard interview procedure (Reference Overall and RhoadesOverall & Rhoades, 1982). As well as the evaluation of efficacy of several classes of psychotropic medication (Reference Hedlund and ViewegHedlund & Vieweg, 1980; Reference Overall and RhoadesOverall & Rhoades 1982; Reference Perry, Sanger and BeasleyPerry et al, 1997; Reference Hamilton, Revicki and GendusoHamilton et al, 1998), the BPRS has been used extensively to compare diagnostic concepts internationally and in epidemiological studies (Reference Delmonte, Gabrielli and GibertieDelmonte et al, 1970; Reference Engelsmann and FormankovaEngelsmann & Formankova, 1967; Reference Engelsmann, Finar and PichotEngelsmann et al, 1970; Reference Overall and BellerOverall & Beller, 1984). It has been translated into many languages and frequently modified for specific purposes, including for use with children (Reference Overall and PfefferbaumOverall & Pfefferbaum, 1982; Reference Emslie, Rush and WeinbergEmslie et al, 1997). It has been expanded to 24 items to make it more comprehensive in the area of psychotic and affective symptoms, with items on bizarre behaviour, suicidality, self-neglect, elevated mood, distractability and motor hyperactivity (Reference Ventura, Neuchterlein and GutkindVentura et al, 2000). The BPRS has been demonstrated as reliable for use by nursing staff, increasing its utility (Reference McGorry, Goodwin and StuartMcGorry et al, 1988). Most adaptations of the BPRS use one of two scoring versions for each item (either a 0- to 3-point or a 0- to 7-point scale.

Limitations

The factor structure of BPRS responses depends upon the characteristics of the patient group under study, and the version being used. The BPRS was, until the advent of the Positive and Negative Syndrome Scale (PANSS; Reference Kay, Fiszbein and OplerKay et al, 1987) which itself is partially derived from the BPRS, the most widely used scale in schizophrenia research. This reflected its broad coverage of typical schizophrenia phenomena in the positive, negative and disorganisation categories. However, its coverage of the negative syndrome has been criticised; there are only three negative syndrome items, and it has been suggested that a more extensive scale is necessary for sensitivity to change (Reference Eckert, Diamond and MillerEckert et al, 1996).

The authors themselves were dismissive of the use of their scale to determine differences between specific symptoms or syndromes during treatment, stating that ‘Although psychiatric symptomatology is multidimensional, the difference between pre-treatment pathology and post-treatment pathology (or lack of it) can be represented by a single dimension spanning the multivariate space’ (Reference Overall and GorhamOverall & Gorham, 1988). Despite this, with the assistance of 20 psychiatrists, they gave 13 different weights to each item according to diagnosis, in order to increase or reduce the relevance of treatment effects to the total score. For instance, the score on item 8, ‘grandiosity’, would be multiplied by a 0 in a patient with depression and by 3 in a patient with paranoia. This complex and somewhat arbitrary scoring system appears never to have been taken up.

Clinical Global Impression

The CGI is not strictly a symptom rating scale but is included because of its wide use, influence and the recent development of forms specific to the schizophrenia syndromes (CGI–SCH). The original version is a simple instrument which rates the overall severity of any mental disorder (Reference GuyGuy, 1976). This is rated entirely according to clinical judgement in routine professional practice, on a scale for the overall current severity of symptoms from 1 (healthy, not ill) to 7 (among the most severely ill). There is also a 7-point scale for global improvement (usually from baseline to the current condition), rating from 1 (very much improved) to 7 (very much worse). The CGI has been used in several efficacy and effectiveness studies in schizophrenia, is sensitive to change and correlates well with changes assessed with more complex scales (Reference Haro, Kamath and OchoaHaro et al, 2003; Reference Leucht and EngelLeucht & Engel, 2006; Reference Leucht, Kane and EtschelLeucht et al, 2006; Reference Rabinowitz, Mehnert and EerdekensRabinowitz et al 2006).

The main criticism levelled at the CGI, that it lacks standard definitions (Reference Beneke and RasmusBeneke & Rasmus, 1992), reflects what many consider its main strength – the use of an adequate level of clinical judgement. Its brevity, utility and appeal to clinical commonsense have ensured its continued use over many more complex rating scales. The CGI has been adapted for the assessment of bipolar affective disorder (CGI–BP) and schizophrenia (Reference Spearing, Post and LeverichSpearing et al, 1997; Reference Haro, Kamath and OchoaHaro et al, 2003). The CGI–SCH has demonstrated good reliability and validity in the evaluation of severity of positive, negative, depressive and cognitive symptoms, and is recommended for both research and clinical practice.

Positive And Negative Syndrome Scale

The PANSS (Kay et al, Reference Kay, Fiszbein and Opler1987, Reference Kay, Opler and Lindenmayer1988, Reference Kay, Opler and Lindenmayer1989) originated from a growing need to reduce the heterogeneity of what was known about schizophrenia. Crow's (Reference CrowCrow, 1980) positive–negative dichotomy presented a promising theoretical model for explaining and understanding variability in the aetiology of schizophrenia, treatment and prognosis. However, attempts to utilise the model in practice met with inconsistent results (Reference AndreasenAndreasen, 1982; Reference Andreasen and OlsenAndreasen & Olsen, 1982; Reference Pogue-Geile and HarrowPogue-Geile & Harrow, 1984; Reference Lindenmayer, Kay and FriedmanLindenmayer et al, 1986), and it was suggested that this might be because of the lack of a comprehensive rating scale for positive and negative symptoms that was feasible, accurate, well validated, reliable, sensitive and standardised. The PANSS, therefore, was not developed to assess outcome per se, or even the results of treatment interventions.

Nature and scoring

The PANSS is a 30-item 7-point (1–7) rating scale which amalgamated the 18-item BPRS and 12 items from the Psychopathology Rating Schedule (Reference Singh and KaySingh & Kay, 1975). The items were precisely defined, as were anchor points for the numerical rating of each item. The PANSS was divided into positive, negative and general psychopathology sub-scales (a ‘manic’ sub-scale was later derived; Reference Lindenmayer, Brown and BakerLindenmayer et al, 2004) and trialled on over 100 well-characterised patients with chronic illness. Sub-scale scores were shown to be normally distributed and independent of each other; they were robust to the effects of mood, chronicity, medication side-effects and cognition. The PANSS was furthermore sensitive and specific regarding pharmacological manipulation of the levels of both positive and negative symptoms in patients with schizophrenia. The validity of its sub-scales was confirmed in an exploration of a classification of patients by predominant symptom class. Sub-scale scores were associated with a number of clinical, treatment and cognitive variables, including premorbid adjustment (Reference Krauss, Marwinski and HeldKrauss et al, 1998), but not outcome. One of the strengths claimed for the PANSS is consistency in scoring individual patients over time and illness course. A potentially confusing feature of the PANSS, however, is that even those without any mental ill health will score 30. In effect, this means that 30 must be subtracted from the patient's score in order to gain a meaningful understanding.

Correlations and factors

Several studies have sought correlations between PANSS total and sub-scale scores, and other aspects of the illness, to demonstrate concurrent validity. Other aspects have included ventricular enlargement and cortical atrophy (Reference d'Amato, Rochet and Daleryd'Amato et al, 1992), work performance (Reference Bell, Milstein and Beam-GouletBell et al. 1992), neuropsychological impairment (Reference Bell, Lysaker and MilsteinBell et al, 1994; Reference Liu, Hwu and ChenLiu et al, 1997; Reference Mass, Schoemig and HitschfeldMass et al, 2000; Reference Bozikas, Kosmidis and GamvrulaBozikas et al, 2004; Reference Good, Rabinowitz and WhitehornGood et al, 2004; Reference Ritsner, Blumenkrantz and DubinskyRitsner et al, 2006) and violent behaviour (Reference Steinert, Wolfle and GebhardtSteinert et al, 2000). Overall these findings appear not to be sufficiently convincing as to be of clinical use, and PANSS scores have generally not been used as proxy variables. For example, when PANSS ‘cognitive’ items were used to predict global cognitive function 66% of the variance was unexplained, suggesting that the PANSS lacked sensitivity and specificity in this regard (Reference Good, Rabinowitz and WhitehornGood et al, 2004). This approach appears not to have generated further research hypotheses.

Factorial validity (the nature and purity of the syndromal components of the scale) is essential to the success of investigations utilising sub-scale scores. There are many reports on the factor (syndrome) structure of PANSS items, with much controversy over whether data best fit a three-, four-, five- or even six-factor solution (Reference Peralta and CuestaPeralta & Cuesta, 1994; Reference Lindenmayer, Bernstein-Hyman and GrochowskiLindenmayer et al, 1994; Reference Wolthaus, Dingemans and ScheneWolthaus et al, 2000; Reference Fresan, De la Fuente-Sandoval and LoyzagaFresan et al, 2005; Reference WhiteWhite, 2005; Reference Van den Oord, Rujescu and RobiesVan den Oord et al, 2006). The simplest factor solutions comprise a syndrome made up of negative symptom items (psychomotor poverty syndrome), a syndrome made up of delusions and hallucinations (reality distortion syndrome) and a syndrome made up of thought disorder and inappropriate affect symptom items (disorganisation syndrome). Although several five-factor models have been proposed, none has been validated by confirmatory factor analysis (Reference van der Gaag, Cuijpers and Hoffmanvan der Gaag et al, 2006a ). This might reflect the ambiguous definitions of some symptom items, such as lack of judgement and insight, which have more than one cause in schizophrenia.

Another complication is that the depression sub-scale (unlike the Calgary Depression Scale; Reference Addington, Addington and Maticka-TyndaleAddington et al, 1992) is unable to distinguish between depression, negative symptoms and extrapyramidal side-effects (Reference Collins, Remington and CoulterCollins et al, 1996). Negative factor scores have been found to correlate with an independent depression rating instrument (Montgomery Åsberg Depression Rating Scale), although depression factor scores did as well (Reference Wolthaus, Dingemans and ScheneWolthaus et al, 2000). The loading of single items by multiple causes, which was suggested in another study (Reference Van den Oord, Rujescu and RobiesVan den Oord et al, 2006) was confirmed in a statistically novel analysis (Reference van der Gaag, Hoffman and Remijsenvan der Gaag et al, 2006b ).

Only if syndromes possess concurrent validity with other aspects of schizophrenia such as cognitive impairment and poor social function, and furthermore fit explanatory data, can they represent clinical reality. The implication for the rating scale is that items which load on more than one factor must be replaced by two or more items, each of which load on a single factor, which results in lengthier scales. The alternative is losing data through deletion of such items. Poor fit suggests that correlations between syndrome scores and other illness variables under investigation, including outcome, might be unreliable.

MEANING OF SYMPTOM RATING SCALE SCORES

The existence of apparently rival rating scales can be confusing when they purport to measure the same thing. Despite the caveats regarding factorial purity which have been repeatedly addressed in the case of the PANSS, there appears to be much redundancy both within and between rating scales. For example, there are high correlations between positive and negative syndrome scores on the PANSS, and Andreasen's Schedule for the Assessment of Positive Symptoms (SAPS; Reference AndreasenAndreasen, 1984a ) and Schedule for the Assessment of Negative Symptoms (SANS; Andreasen, Reference Andreasen1984a ,Reference Andreasen b ; Reference Norman, Malla and CorteseNorman et al, 1996). The negative symptoms of the PANSS and BPRS, and the SANS all measure, mostly, affective flattening rather than the full range of negative symptom phenomena (Reference Welham, Stedman and ClairWelham et al, 1999). The much shorter and quicker CGI scales were just as good as the BPRS in discriminating between the effects of antipsychotic drugs (Reference Leucht and EngelLeucht & Engel, 2006) despite having been criticised on semantic, logical and statistical grounds (Reference Beneke and RasmusBeneke & Rasmus, 1992). The development of the CGI–SCH scale suggests that investment in less complex rating instruments is gathering pace for rating severity and treatment response in routine clinical practice (Reference Haro, Kamath and OchoaHaro et al, 2003).

Even in randomised placebo-controlled trials for licensing purposes, the use of changes in rating scale scores may lack good face validity. Many trials evaluate clinical response as a percentage change in scores over the treatment period. Equating a 20% improvement in symptoms with response follows the study of Kane et al (Reference Kane, Honigfeld and Singer1988) which compared clozapine and chlorpromazine in treatment-resistant patients with severe illness. This relatively low percentage reflects the fact that in patients with severe illness even a fairly small attenuation of symptoms might be clinically valuable. The 20% definition of response might not, however, be generalisable to the majority of acute trials with non-resistant patients. Relying on percentage point change to indicate recovery ignores the importance of baseline levels. A 20% reduction of a PANSS score of 100 is double a 20% reduction of a PANSS score of 50, yet both might be recorded as a ‘clinical response’. The patient with a baseline PANSS score of 100 would, although fulfilling criteria for response with a score of 80, remain severely ill, (albeit noticeably less so), whereas the patient with a baseline score of 50 would remain mildly ill with a score of 40 and perhaps not even be noticeably different.

Concurrent validity

Reference Leucht, Kane and KisslingLeucht et al, 2005a addressed the issue of what rating scale scores mean in clinical terms. They used an equating procedure to anchor BPRS scores to CGI categories (both severity and improvement) across seven drug trials which used both scales in patients with acute schizophrenia. Clinician-rated ‘minimal improvement’ on the CGI equated to a 30% improvement on the BPRS (substantially greater than the generally accepted standard for response). ‘Much improvement’ after 4 weeks of treatment equated to a fall in the BPRS score of almost 58% (Table 1). In addition they found that clinicians used only a small part of the BPRS score range of 18–126: patients with minimum illness on the CGI scored 31, those with moderate illnesss scored 41 and those with severe illness 53. This is probably because patients are only assessed on a minority of the items and upon most they are scored zero.

Table 1 Clinical implications of BPRS scores

Severity of illness Corresponding BPRS score CGI Global Improvement Corresponding BPRS reduction at 1, 2 and 4 weeks, %
Mildly ill 31 Minimally improved 24, 27 and 30
Moderately ill 41 Much improved 40, 53 and 58
Markedly ill 53 Very much improved 71, 79 and 85

BPRS, Brief Psychiatric Rating Scale; CGI, Clinical Global Impression

Using the same approach with the PANSS (Reference Leucht, Kane and KisslingLeucht et al, 2005b ) they found that ‘mildly ill’, ‘moderately ill’, ‘markedly ill’ and ‘severely ill’ according to the CGI equated to total PANSS scores of 58, 75, 95 and 116 respectively (Table 2). At 6 weeks, to achieve CGI ratings of ‘minimally improved’ and ‘much improved’ the PANSS decrements were 28% and 53%. The authors suggested that response ought to be defined as a 50% improvement in PANSS score, although in treatment-resistant groups a decrement of 25% might suffice.

Table 2 Clinical implications of PANSS scores

CGI Severity of Illness Corresponding PANSS score CGI Global Improvement Corresponding PANSS reduction at 1, 2, 4 and 6 weeks, %
Mildly ill 58 Minimally improved 19, 23, 26 and 28
Moderately ill 75 Much improved 40, 45, 51 and 53
Markedly ill 95 Very much improved 71, 73, 82 and 81
Severely ill 116 - -

CGI, Clinical Global Impression; PANSS, Positive and Negative Syndrome Scale

A later study (Reference Leucht, Kane and EtschelLeucht et al, 2006) compared the PANSS and BPRS with each other and with the CGI and replicated the findings overall, emphasising that smaller absolute score reductions equated to perception of improvement in patients with severe illness compared with those with mild illness (Table 3). For a reduction of 1 point on the CGI Severity of Illness scale there were decreases of 15 and 10 on the PANSS and BPRS respectively.

Table 3 CGI Global Improvement in relation to absolute reductions in PANSS and BPRS scores

Global CGI improvement Reduction in PANSS score (range) Reduction in BPRS score (range)
Minimally improved 15 (12-18) 10 (8-11)
Much improved 33 (30-36) 20 (19-22)

BPRS, Brief Psychiatric Rating Scale; PANSS, Positive and Negative Syndrome Scale

A similar study (Reference Cramer, Rosenheck and XuCramer et al, 2001) found that clinician-rated ‘improved’ and ‘much better’ patients had PANSS scores lowered by 21 and 45% respectively. Quality of life scores were also increased by similar degrees (26 and 50%). This is consistent with the Leucht et al (Reference Leucht, Kane and Etschel2006) study, and perhaps demonstrates some concurrent validity of the PANSS with subjective quality of life as an outcome. A further report indicated that a decrement of 20% on the PANSS equated to a 1-point severity decrease on the CGI–SCH (Reference Rabinowitz, Mehnert and EerdekensRabinowitz et al, 2006).

REMISSION

These practical difficulties in the use of symptom rating scales to evaluate outcome in treatment trials have contributed to the recent development of the concept of remission in schizophrenia. Response to treatment focuses on short-term improvements and gives little guidance to clinicians regarding long-term management. In general medicine, remission implies a low level of symptoms but with functional recovery. A number of disparate definitions of remission in schizophrenia have been constructed (Reference Leucht and EngelLeucht & Lasser 2006). A standard definition, it is argued, is potentially useful: it is realistic and establishes a meaningful treatment goal. Although a useable measure will not include cognition, personal and social function because of difficulties in measurement, there is some evidence that concepts of remission based on symptoms and duration are indeed associated with such consequential aspects of patients' well-being (Reference Birsoz, Isik and YargicBirsoz et al, 2006).

The Remission in Schizophrenia Working Group was convened in April 2003 to develop a consensus definition of remission in schizophrenia (Reference Andreasen, Carpenter and KaneAndreasen et al, 2005). Taking precedents in physical medicine and affective disorder, remission should be defined as low or mild symptom levels (which by definition do not influence behaviour) and which should last for a minimum, defined duration. Such a standardised definition, unlike several previous published definitions, could be applied across treatment studies and would permit immediate, transparent comparison. This approach does, however, require attention to levels of baseline severity across studies.

The Working Group aimed to map the chosen remission symptoms, which had to be rated mild or less, onto the three best validated syndromes of schizophrenia (reality distortion, disorganisation and negative symptoms) and the five DSM–IV criteria for schizophrenia (delusions, hallucinations, disorganised speech, disorganised or catatonic behaviour, negative symptoms, American Psychiatric Association, 1994). They picked appropriate items from the BPRS, the PANSS the SAPS and the SANS (Table 4).

Table 4 Proposed items for remission criteria with cross-scale correspondence and relationship to historical constructs of psychopathology dimensions and DSM-IV criteria for schizophrenia 1

SAPS and SANS items PANSS items BPRS items
Dimension of psychopathology DSM-IV criterion Criterion Global rating item no. Criterion Item no. Criterion 2 Item no.
Reality distortion Delusions Delusions (SAPS) 20 Delusions P1 Grandiosity 8
Unusual thought content G9 Suspiciousness 11
Unusual thought content 15
Hallucinations Hallucinations (SAPS) 7 Hallucinatory behaviour P3 Hallucinatory behaviour 12
Disorganisation Disorganised speech Positive formal thought disorder (SAPS) 34 Conceptual disorganisation P2 Conceptual disorganisation 4
Grossly disorganised or catatonic behaviour Bizarre behaviour (SAPS) 25 Mannerisms/ posturing G5 Mannerisms/ posturing 7
Negative symptoms (psychomotor poverty) Negative symptoms Affective flattening (SANS) 7 Blunted affect N1 Blunted affect 16
Avolition-apathy (SANS) 17 Social withdrawal N4 No clearly related symptom
Anhedonia - asociality (SANS) 22
Alogia (SANS) 13 Lack of spontaneity N6 No clearly related symptom

BPRS, Brief Psychiatric Rating Scale; PANSS, Positive and Negative Syndrome Scale; SANS, Scale for Assessment of Negative Symptoms; SAPS, Scale for Assessment of Positive Symptoms

1. For symptomatic remission, maintenance over a 6-month period of simultaneous ratings of mild or less on all items is required

2. Use of BPRS criteria may be complemented by use of the SANS criteria for evaluating overall remission

The BPRS, with limited coverage of negative symptoms, was perhaps less useful in determining remission. The Working Group set 6 months as the minimum duration of symptoms remaining mild for the patient to qualify for remitted status.

Use of remission criteria

Remission is already being used in attempts to test efficacy of drugs in ‘head to head’ comparisons by re-analysing existing data (Reference Sethuraman, Taylor and EnersonSethuraman et al, 2005). A study of stable patients using PANSS-based remission criteria demonstrated that nearly 70% were not in remission; 20% achieved remission when switched to depot treatment and 85% of those already in remission remained so a year later on depot (Reference Lasser, Bossie and GharabawiLasser et al, 2005). Application of the criteria to data from other published studies produced similar findings (Reference Gharabawi, Rodriguez and TurkozGharabawi et al, 2005; Reference Kissling, Heres and LloydKissling et al, 2005). In all studies remission was associated with PANSS total and subtotal scores, CGI–SCH scores, functioning and quality of life. Moreover, an analysis of six clinical trials comparing two definitions, one PANSS based and the other BPRS/CGI based, found that achievement of remission using either definition was associated with better quality of life (Reference Dunayevich, Sethuraman and EnersonDunayevich et al, 2006). This was particularly so if remission was sustained. Nevertheless, total BPRS change score still contributed the greatest part of the variance in quality of life.

Two reviews of the Working Group remission criteria (Reference NasrallahNasrallah, 2006; Reference Van Os, Burns and CavalleroVan Os et al, 2006) proposed that the definition was conceptually viable and feasible in both clinical trials and clinical practice. Both reviews considered that the use of remission criteria would raise clinical expectations and drive clinical services to achieve and document better outcomes. In clinical trials, the concept should improve the quality of methodology and data reporting, while extending its relevance to cognition and functional outcomes in patients. The advantages of remission derive from adding duration to absolute symptom score thresholds, and avoiding percentage change scores (a hitherto dubious benchmark).

CONCLUSIONS

Symptom rating scales which have been designed to diagnose patients, subdivide patients, define syndromes, track clinical change or evaluate drug efficacy do not lend themselves easily to the assessment of global outcome in schizophrenia. Simply totalling the number of symptoms without reference to the consequences of what is scored, is an empty exercise. Change must be relative to baseline conditions; there are also issues of redundancy, and a lack of concurrent validity with external outcome measures. The effort expended investigating the psychometric properties of scales such as the PANSS appears to have been matched by only limited advances in their utility beyond tracking change. It has yielded little of relevance to aetiology, treatment or prognosis.

These limitations have led to interest in another perspective on outcome, remission. This is based on accepted practice in medicine and other psychiatric disorders, such as affective disorders, and goes beyond rating scale scores alone. Its utility, however, remains to be seen. There are already indications that remission may be short lived in many patients (Reference Dunayevich, Sethuraman and EnersonDunayevich et al, 2006). Until recovery can be defined accurately in schizophrenia (Reference Leucht and LasserLeucht & Lasser, 2006) symptom control, remission and quantified cognitive, personal and social functioning should be used together as measures of treatment outcome. This accepts that outcome has multiple facets, which vary in importance between patients. Symptom rating scales play an important role in overall appraisal of outcome, but should not dominate the picture, which still requires meaningful appraisals of cognition, personal and social functioning.

References

Addington, D., Addington, J., Maticka-Tyndale, E., et al (1992) Reliability and validity of a depression rating scale for schizophrenics. Schizophrenia Research, 6, 201208.Google Scholar
American Psychiatric Association (1994) Diagnostic and Statistical Manual of Mental Disorder (4th edn). APA.Google Scholar
Andreasen, N. (1982) Negative symptoms in schizophrenia: definition and reliability. Archives of General Psychiatry, 39, 784788.Google Scholar
Andreasen, N. (1984a) Scale for the Assessment of Negative Symptoms (SANS). Univeristy of Iowa.Google Scholar
Andreasen, N. (1984b) Scale for the Assessment of Positive Symptoms (SAPS). University of Iowa.Google Scholar
Andreasen, N. & Olsen, S. (1982) Negative v positive schizophrenia: definition and validation. Archives of General Psychiatry, 39, 789794.CrossRefGoogle ScholarPubMed
Andreasen, N., Carpenter, W., Kane, J., et al (2005) Remission in schizophrenia: proposed criteria and rationale for consensus. American Journal of Psychiatry, 162, 441449.Google Scholar
Andrews, G., Peters, L., & Teeson, M. (1994) The Measurement of Consumer Outcome in Mental Health. Australian Health Outcomes Collaboration.Google Scholar
Bell, M., Milstein, R., Beam-Goulet, J., et al (1992) The Positive and Negative Syndrome Scale and the Brief Psychiatric Rating Scale. Reliability, comparability and predictive validity. Journal of Nervous and Mental Disorders, 180, 723728.Google Scholar
Bell, M., Lysaker, P., Milstein, R., et al (1994) Concurrent validity of the cognitive component of schizophrenia: relationship of PANSS scores to neuropsychological assessment. Psychiatry Research, 54, 5158.CrossRefGoogle Scholar
Beneke, M. & Rasmus, W. (1992) Clinical Global Impressions (ECDEU): some critical comments. Pharmacopsychiatry, 25, 171176.CrossRefGoogle ScholarPubMed
Birsoz, S., Isik, E., Yargic, I., et al (2006) Remission in schizophrenia: a utopia or a goal? Klinik Psik of armakoloji Buelteni, 16, 128132.Google Scholar
Bozikas, V., Kosmidis, M., Gamvrula, K., et al (2004) Clock Drawing Test in patients with schizophrenia. Psychiatry Research, 121, 229238.Google Scholar
Chadwick, P. & Birchwood, M. (1995) The omnipotence of voices. II: The Beliefs About Voices Questionnaire (BAVQ). British Journal of Psychiatry, 166, 773776.Google Scholar
Collins, A., Remington, G., Coulter, K., et al (1996) Depression in schizophrenia: a comparison of three measures, Schizophrenia Research, 20, 205209.Google Scholar
Cramer, J., Rosenheck, R., Xu, W., et al (2001) Detecting improvement in quality of life and symptomatology in schizophrenia. Schizophrenia Bulletin, 27, 227234.Google Scholar
Crow, T. (1980) Positive and negative schizophrenic symptoms and the role of dopamine. British Journal of Psychiatry, 137, 383386.CrossRefGoogle ScholarPubMed
d'Amato, T., Rochet, T., Dalery, J., et al (1992) Relationship between symptoms rated with the Positive and Negative Syndrome Scale and Brain Measures in schizophrenia. Psychiatry Research, 44, 5562.Google Scholar
Delmonte, P., Gabrielli, F., Gibertie, F., et al (1970) Diagnostic classification concepts among Italian psychiatrists. Archivio di Psicologia Neurologia e Psychiatria, 6, 531553.Google Scholar
Dunayevich, E., Sethuraman, G., Enerson, M., et al (2006) Characteristics of two alternative schizophrenia remission definitions: relationship to clinical and quality of life outcomes. Schizophrenia Research, 86, 300308.Google Scholar
Eckert, S., Diamond, P., Miller, A., et al (1996) A comparison of instrument sensitivity to negative symptom change. Psychiatry Research, 63, 6775.CrossRefGoogle ScholarPubMed
Emsley, R., Oosthuizen, P., Joubert, A., et al (1999) Depressive and anxiety symptoms in patients with schizophrenia and schizophreniform disorder. Journal of Clinical Psychiatry, 60, 747751.Google Scholar
Emslie, G., Rush, A., Weinberg, W., et al (1997) A double-blind, randomized, placebo-controlled trial of fluoxetine in children and adolescents with depression. Archives of General Psychiatry, 54, 10311037.Google Scholar
Engelsmann, F. & Formankova, M. (1967) Abbreviated Psychiatric Evaluation Scale (Overall-Gorham). Ceskoslovenska Psychiatrie, 63, 297306.Google Scholar
Engelsmann, F., Finar, O., Pichot, P., et al (1970) International comparison of diagnostic patterns. Transcultural Psychiatric Research Review, 7, 130137.Google Scholar
Fresan, A., De la Fuente-Sandoval, C., Loyzaga, C., et al (2005) A forced five-dimensional factor analysis and concurrent validity of the Positive and Negative Syndrome Scalein Mexican schizophrenic patients. Schizophrenia Research, 72, 123129.Google Scholar
Gharabawi, G., Rodriguez, S., Turkoz, I., et al (2005) Exploring the evidence for a relationship between symptomatic remission and functioning in patients with schizophrenia. Neuropsychopharmacology, 30 (suppl. 1), s1s270.Google Scholar
Good, K., Rabinowitz, J., Whitehorn, D., et al (2004) The relationship of neuropsychological test performance with the PANSS in antipsychotic naive, first-episode psychosis patients. Schizophrenia Research, 68, 1119.Google Scholar
Guy, W. (1976) Clinical Global Impression. In ECDEU Assessment Manual for Psychopharmacology (revised), pp. 217221. National Institute of Mental Health.Google Scholar
Hamera, E., Schneider, J., Potocky, M., et al (1996) Validity of self-administered symptom scales in clients with schizophrenia and schizoaffective disorders. Schizophrenia Research, 19, 213219.Google Scholar
Hamilton, S., Revicki, D., Genduso, L., et al (1998) Olanzapine versus placebo and haloperidol: quality of life and efficacy results of the North American doubleblind trial. Neuropsychopharmacology, 18, 4149.CrossRefGoogle Scholar
Haro, J., Kamath, S., Ochoa, S., et al (2003) The Clinical Global Impression-Schizophrenia scale: a simple instrument to measure the diversity of symptoms present in schizophrenia. Acta Psychiatrica Scandinavica, 107 (suppl. 416), 1623.Google Scholar
Hedlund, J. & Vieweg, B. (1980) The brief psychiatric rating scale (BPRS): a comprehensive review. Journal of Operational Psychiatry, 11, 4865.Google Scholar
Kane, J., Honigfeld, G., Singer, J., et al (1988) Clozapine for the treatment-resistant schizophrenic. A double-blind comparison with chlorpromazine. Archives of General Psychiatry, 45, 789796.Google Scholar
Kay, S., Fiszbein, A., & Opler, L. (1987) The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophrenia Bulletin, 13, 262276.Google Scholar
Kay, S., Opler, L., & Lindenmayer, J. (1988) Reliability and validity of the Positive and Negative Syndrome Scale for schizophrenia. Psychiatry Research, 23, 99110.Google Scholar
Kay, S., Opler, L., & Lindenmayer, J. (1989) The Positive and Negative Syndrome Scale (PANSS): rationale and standardisation. British Journal of Psychiatry, 155 (suppl. 7), 5967.Google Scholar
Kissling, W., Heres, S., Lloyd, K., et al (2005) Direct transition tolong-acting risperidone-analysis of long-term efficacy. Journal of Psychopharmacology, 19, 1521.Google Scholar
Krauss, H., Marwinski, K., Held, T., et al (1998) Reliability and validity of the premorbid adjustment scale (PAS) in a German sample of schizophrenic and schizoaffective patients. European Archives of Psychiatry in Clinical Neuroscience, 248, 277281.Google Scholar
Lasser, R., Bossie, C., Gharabawi, G., et al (2005) Remission in schizophrenia: results from al-year study of long-acting risperidone injection. Schizophrenia Research, 77, 215227.Google Scholar
Leucht, S. & Engel, R. (2006) The relative sensitivity of the Clinical Global Impressions Scale and the Brief Psychiatric Rating Scalein antipsychoticdrug trials. Neuropsychopharmacology, 31, 406412.Google Scholar
Leucht, S. & Lasser, R. (2006) The concepts of remission and recovery in schizophrenia. Pharmacopsychiatry, 39, 161170.Google Scholar
Leucht, S., Kane, J., Kissling, W., et al (2005a) Clinical implications of Brief Psychiatric Rating Scale scores. British Journal of Psychiatry, 187, 366371.CrossRefGoogle ScholarPubMed
Leucht, S., Kane, J., Kissling, W., et al (2005b) What does the PANSS mean? Schizophrenia Research, 79, 231238.Google Scholar
Leucht, S., Kane, J., Etschel, E., et al (2006) Linking the PANSS, BPRS, and CGI: clinical implications. Neuropsychopharmacology, 18.CrossRefGoogle Scholar
Lindenmayer, J., Kay, S. & Friedman, C. (1986) Negative and positive schizophrenic syndromes after the acute phase: A prospective follow-up. Comprehensive Psychiatry, 27, 276286.Google Scholar
Lindenmayer, J., Bernstein-Hyman, R. & Grochowski, S. (1994) A new five factor model of schizophrenia. Psychiatric Quarterly, 65, 299322.Google Scholar
Lindenmayer, J., Brown, E., Baker, R., et al (2004) An excitement subscale of the Positive and Negative Syndrome Scale. Schizophrenia Research, 68, 331337.Google Scholar
Liu, S., Hwu, H. & Chen, W. (1997) Clinical sympton dimensions and deficits on the Continuous Performance Test in schizophrenia. Schizophrenia Research, 25, 211219.Google Scholar
Marshall, M., Lockwood, A., Bradley, C., et al (2000) Unpublished rating scales: a major source of bias in randomised controlled trials of treatments for schizophrenia. British Journal of Psychiatry, 176, 249252.Google Scholar
Mass, R., Schoemig, T., Hitschfeld, K., et al (2000) Psychopathological syndromes of schizophrenia: evaluation of the dimensional structure of the positive and negative syndrome scale. Schizophrenia Bulletin, 26, 167177.Google Scholar
McGorry, P., Goodwin, R. & Stuart, G. (1988) The development, use, and reliability of the brief psychiatric rating scale (nursing modification)-an assessment procedure for the nursing team in clinical and research settings. Comprehensive Psychiatry, 29, 575587.Google Scholar
Mortimer, A. & Spence, S. (2001) The Management of Negative Symptons of Schizophrenia. Science Press.Google Scholar
Murray, R. & Van Os, J. (1998) Predictors of outcome in schizophrenia. Journal of Clinical Psychopharmacology, 18, 2S4S.Google Scholar
Nasrallah, H. (2006) Improving patient outcomes in schizophrenia; achieving remission. Journal of Psychopharmacology, 20, 5761.CrossRefGoogle ScholarPubMed
Norman, R., Malla, A., Cortese, L., et al (1996) A study of the interrelationship between and comparative interrater reliability of the SAPS, SANS and PANSS. Schizophrenia Research, 19, 7385.Google Scholar
Overall, J. & Gorham, D. (1962) The Brief Psychiatric Rating Scale. Psychological Reports, 10, 799812.Google Scholar
Overall, J. & Pfefferbaum, B. (1982) The Brief Psychiatric Rating Scale for Children. Psychopharmacology Bulletin, 18, 1016.Google ScholarPubMed
Overall, J. E. & Rhoades, H. M. (1982) Refinement of phenomenological classification in clinical psychopharmacology research. Psychopharmacology, 77, 2430.Google Scholar
Overall, J. & Beller, S. (1984) The Brief Psychiatric Rating Scale (BPRS) in geropsychiatric research: I. Factor structure on an inpatient unit. Journal of Gerontology, 39, 187193.Google Scholar
Overall, J. & Gorham, D. (1988) The Brief Psychiatric Rating Scale (BPRS): recent developments in ascertainment and scaling. Psychopharmacology Bulletin, 24, 9799.Google Scholar
Peralta, V. & Cuesta, M. (1994) Psychometric properties of the Positive and Negative Syndrome Scale (PANSS) in schizophrenia. Psychiatry Research, 53, 3140.Google Scholar
Perry, P., Sanger, T. & Beasley, C. (1997) Olanzapine plasma concentrations and clinical response in acutely ill schizophrenic patients. Journal of Clinical Psychopharmacology, 17, 472477.Google Scholar
Pogue-Geile, M. & Harrow, M. (1984) Negative and positive symptoms in schizophrenia and depression: A follow up. Schizophrenia Bulletin, 10, 371387.Google Scholar
Rabinowitz, J., Mehnert, A. & Eerdekens, M. (2006) To what extent do the PANSS and CGI-S overlap? Journal of Clinical Psychopharmacology, 26, 303307.Google Scholar
Ritsner, M., Blumenkrantz, H., Dubinsky, T., et al (2006) The detection of neurocognitive decline in schizophrenia using the Mindstreams Computerized Cognitive Test Battery. Schizophrenia Research, 82, 3949.Google Scholar
Rocca, P., Bellino, S., Calvarese, P., et al (2005) Depressive and negative symptomsin schizophrenia: different effects on clinical features. Comprehensive Psychiatry, 46, 304310.Google Scholar
Schuldberg, D., Quinlan, D. & Glazer, W. (1999) Positive and negative symptomsand adjustmentin severely mentally ill outpatients. Psychiatry Research, 85, 177188.CrossRefGoogle Scholar
Sethuraman, G., Taylor, C., Enerson, M., et al (2005) A retrospective comparison of cumulative time spent in remission during treatment with olanzapine or risperidone among patients with schizophrenia. Schizophrenia Research, 79, 337340.Google Scholar
Singh, M. & Kay, S. (1975) A comparative study of haloperidol and chlorpromazine in terms of clinical effects and therapeutic reversal; with benztropine in schizophrenia: theorectical implications for potency differences among neuroleptics. Psychopharmacologia, 43, 103113.CrossRefGoogle Scholar
Spearing, M., Post, R., Leverich, G., et al (1997) Modification of the Clinical Global Impression (CGI) scale for use in bipolar illness: the CGI-BP. Psychiatry Research, 73, 159171.CrossRefGoogle ScholarPubMed
Steinert, T., Wolfle, M. & Gebhardt, R. (2000) Measurement of violence duringin-patient treatment and association with psychopathology. Acta Psychiatrica Scandinavica, 102, 107112.Google Scholar
Tiihonen, J., Wahlbeck, K., Lonnqvist, J., et al (2006) Effectiveness of antipsychotic treatments in anationwide cohort of patients in community care after first hospitalisation due to schizophrenia and schizoaffective disorder: observational follow-up study. British Medical Journal, 333, 224.Google Scholar
Van den Oord, E., Rujescu, D., Robies, J., et al (2006) Factor structure and external validity of the PANSS revisited. Schizophrenia Research, 82, 213223.Google Scholar
van der Gaag, M., Cuijpers, A., Hoffman, T., et al (2006a) The five-factor model of the Positive and Negative Syndrome Scale I: confirmatory factor analysis fails to confirm 25 published five-factor solutions. Schizophrenia Research, 85, 273279.Google Scholar
van der Gaag, M., Hoffman, T., Remijsen, M., et al (2006b) The five-factor model of the Positive and Negative Syndrome ScaleII: aten-fold cross-validation of a revised model. Schizophrenia Research, 85, 273279.Google Scholar
Van Os, J., Fahy, T., Jones, P., et al (1996) Psychopathological syndromes in the functional psychoses: associations with course and outcome. Psychological Medicine, 26, 161176.Google Scholar
Van Os, J., Burns, T., Cavallero, R., et al (2006) Standardized remission criteriain schizophrenia. Acta Psychiatrica Scandinavica, 113, 9195.Google Scholar
Ventura, J., Neuchterlein, K. S. K., Gutkind, D., et al (2000) Symptom dimensions in recent-onset schizophrenia and mania: aprincipal components analysis of the 24-item Brief Psychiatric Rating Scale. Psychiatry Research, 97, 129135.Google Scholar
Welham, J., Stedman, T. & Clair, A. (1999) Choosing negative symptom instruments: issues of representation and redundancy, Psychiatry Research, 87, 4756.Google Scholar
White, L. (2005) Interpreting the PANSS: measures, factors and models. Schizophrenia Research, 79, 349351.Google Scholar
Wolthaus, J., Dingemans, P., Schene, A., et al (2000) Component structure of the Positive and Negative Syndrome Scale (PANSS) in patients with recent-onset schizophrenia and spectrum disorders. Psychopharmacology, 150, 399403.Google Scholar
Figure 0

Table 1 Clinical implications of BPRS scores

Figure 1

Table 2 Clinical implications of PANSS scores

Figure 2

Table 3 CGI Global Improvement in relation to absolute reductions in PANSS and BPRS scores

Figure 3

Table 4 Proposed items for remission criteria with cross-scale correspondence and relationship to historical constructs of psychopathology dimensions and DSM-IV criteria for schizophrenia1

Submit a response

eLetters

No eLetters have been published for this article.