Background The regional cerebral blood flow (rCBF) response to the Wisconsin Card Sort Test (WCST) has been used to assess the functional integrity of the prefrontal cortex in patients with schizophrenia.

Aims In this study, patients were divided into two groups according to whether they had made few or many perseverative errors on a modified version of the WCST. A control group consisted of normal volunteers. The groups were then compared with respect to rCBF response to WCST activation.

Method rCBF was measured during administration of a modified version of the WCST and during a card sorting control task, using single photon emission computerised tomography (SPECT).

Results Performance of the modified WCST was associated with a widespread and substantial increase in rCBF, particularly in the frontal region. The poorly performing group of patients with schizophrenia showed only a modest increase in rCBF in the left anterior cingulate region.

Conclusion Subjects with schizophrenia are able to respond to specific neuropsychological challenge with activation of the frontal regions.

The possibility that frontal lobe mechanisms may be dysfunctional in schizophrenia has been investigated using neuropsychological (Wisconsin Card Sorting Test, WCST; Berg, 1948) and functional neuroimaging (regional cerebral blood flow, rCBF) techniques. Weinberger et al (1986) reported a failure of prefrontal rCBF activation with WCST in a group of chronic unmedicated sufferers from schizophrenia with normal resting rCBF. However, the extent to which these findings can be generalised, and the relationship between rCBF and WCST performance, remain uncertain.

In attempting to address these questions, we identified two groups of subjects with schizophrenia: one performing adequately, and one poorly, on the WCST. Normal volunteers constituted a third group. An indirect measure of rCBF was obtained using a radiotracer uptake ratio. The radiotracer 99m-technetium-labelled hexamethyl-propylene-amineoxime (99mTc-HMPAO) is used in a multidetector single photon emission computerised tomography (SPECT) scanning system during performance of the WCST and during a motor control task. The change in rCBF between the two occasions was attributed to the effects of cognitive activation.



Screening procedure

All male patients who were attending psychiatric out-patient clinics at Maidstone Hospital and at King's College Hospital, London and who met initial inclusion criteria were screened. Maidstone Hospital provides a service for a medium-sized county town and surrounding rural area; King's College Hospital lies in an inner-city area. Each clinic is part of a local community service. The initial inclusion criteria were as follows:

  1. a diagnosis of schizophrenia according to DSM-III-R criteria (American Psychiatric Association, 1987);

  2. age 18-55;

  3. right-handedness (assessed using the Annett Handedness Schedule; Annett, 1970);

  4. no history of neurological disorder, hypertension (diastolic 90 mmHg), drug or alcohol abuse according to CAGE criteria (Mayfield et al, 1974), significant physical illness, drug treatment other than antipsychotic and anticholinergic medication, or psychiatric illness other than schizophrenia; and

  5. IQ above 75 as measured by the National Adult Reading Test (NART; Nelson, 1982) and Schonell graded word reading test (Schonell, 1942).

Eighty-four subjects met the above criteria and were invited to participate in the study: 72 accepted. Each subject completed Raven's Progressive Matrices (RPM; Raven, 1988), the Nelson modification of the WCST (Nelson, 1976), the controlled oral word association test (FAS), and the SET test (Isaacs & Akhtar, 1972). The negative symptom rating scale (NSRS; Iager et al, 1985) and the Manchester scale (MS; Krawiecka et al, 1977) were employed as measures of clinical morbidity.

We wished to generate two groups of patients, each of which would perform adequately according to a measure of general intelligence, but one of which would perform adequately and the other poorly on the modified WCST.

The RPM was selected as a widely used measure of general intelligence that was not overly dependent on frontal mediation. Members of either patient group had to have a score exceeding the 50th percentile.

The WCST generates three sets of scores: the number of categories attained (CA), the number of perseverative errors (PE), and the total number of errors (TE). The perseverative error score has often been taken as the more specific measure of frontal lobe dysfunction, and a cut-off score of 4/5 was chosen, so that those patients scoring 5 and above formed the poorly performing schizophrenia (PPS) group and those scoring 4 and below formed the adequately performing schizophrenia (APS) group. All our patients were able to complete the test.

The normal control group was recruited from healthy staff volunteers. Apart from not having a diagnosis of schizophrenia, they fulfilled the same inclusion criteria as the patient groups, and were asked to perform the same cognitive tests. Only subjects who obtained a score on the RMP exceeding the 50th percentile were considered.

All subjects were assessed by the same investigator (C.I.O.)

Group characteristics

Twelve patients with schizophrenia met the criteria for the APS group and 11 for the PPS group: the remainder failed to obtain an adequate score on the RPM. Eleven healthy volunteers formed the control group. The mean ages for the APS and PPS groups were 33.7 (s.d.=4.8) and 38.1 years (s.d.=10.0) respectively. The mean age of the control group was 29.9 years (s.d.=6.2).

All 23 patients were receiving ‘typical’ antipsychotic drugs, and three were also receiving anticholinergic drugs. No other drugs were prescribed. The antipsychotic drug dose at the time of neuroimaging was recorded and converted into chlorpromazine equivalents. Age and antipsychotic medication were each entered as covariates in the statistical analysis. The mean age at onset of the illness (first medical contact) was 23.7 years, and the mean duration, 9.9 years for the APS group and 25.8 and 12.3 years for the PPS group. Members of the APS group had an average of 2.9 admissions and the PPS 4.0 admissions. These differences were insignificant.

The cognitive task

Weinberger et al (1986) used the standard form of the WCST. In a small pilot group of subjects with schizophrenia (none of whom took part in the subsequent study) we compared the standard and the modified forms. We found that subjects scored similarly on both, but were better able to tolerate the modified procedure, so we therefore adopted it for the main study. The WCST was performed twice by those subjects who entered the neuroimaging phase of the study: initially during screening, and again during imaging. In most instances several months elapsed between tests.

Image acquisition

99mTc-HMPAO, when given intravenously, crosses the blood-brain barrier at first pass: 4-5% of the injected dose enters the cerebral parenchyma and is temporarily trapped, due to a structural and conformational change that reduces its lipophilicity. The topographical distribution of HMPAO thus reflects rCBF during the 4-minute period that immediately follows injection. Due to slow wash-out time, this amount remains fairly constant for several hours after injection (Sharp et al, 1986).

While the isotope was prepared, a heparinised cannula was introduced into the left antecubital vein. The instructions were read aloud by the investigator. The subject sat at a table. The test room was sound-proofed and air-conditioned. In the WCST the subject held the pack of cards in the left hand and sorted with the right hand. During the control task, the subject held the pack in the left hand and randomly distributed the cards to form four piles. The subject used the same number of cards and was encouraged to distribute them at approximately the same pace as during the card sort. An injection of 250 MBq of the radiotracer was given 5 minutes after the card sort had commenced. The subject was not screened from the injection and was aware of the timing of the injection. Challenge and control procedures were administered in counterbalanced order on separate days.

Regional cerebral blood flow was measured using a multidetector head-dedicated tomography system, model SME 810 (Strichman Medical Equipment, MA, USA). The SME 810 has a resolution of about 10 mm full width at half maximum and an in-plane resolution of 14 mm. Total count per slice was approximately 1 000 000; typical acquisition time was 15 minutes per slice. Reconstruction was carried out using the inverse count-dependent Wiener high-resolution filters and the iterative method with the software version SME 2.66 (Strichman Medical Equipment).

Image analysis

99mTc-HMPAO SPECT studies can only provide relative rCBF data in terms of ratios because not enough is known about the kinetics of the tracer to enable absolute quantitation. Semi-quantitation in relative terms is done by ‘normalising’ the regional deposition or uptake of tracer (i.e., count density in a region of interest, ROI) to the deposition or uptake in a reference region. The choice of reference region is often based on the assumption that rCBF in that region is normal and that the region is not involved in the pathological process (Holman, 1986; Syed et al, 1992). In this study we chose the cerebellum as the reference region. The analyses were carried out by the same rater (C.I.O.), who was unaware of the group identity of the subject. Seven to eight overlapping slices (slice thickness 7.7 mm) of the brain at, and parallel to, the orbitomeatal line were acquired. Three slices were chosen for the quantification of relative rCBF. These slices and the ROIs were identified on the transverse SPECT images with the help of a computed tomographic atlas, as described by Montaldi et al (1990). The slices were: (a) a transverse slice at the level of the orbitomeatal line, to demonstrate the cerebellum; on this slice a large ROI was delineated over the whole cerebellum; (b) a midventricular slice at 50 mm and parallel to the orbitomeatal line (Fig. 1); to improve the reproducibility of the method, a template was devised so that when fitted onto the slice it divided the whole slice into three in the frontal-occipital dimension; (c) a supraventricular slice 70 mm above the orbitomeatal line (Fig. 1), which was divided into four quadrants, using a template.

Fig. 1

Percentage increases in regional cerebral blood flow following cognitive activation.

The regions thus delineated on each of these slices are as follows. The predominantly cortical areas were identified as a peripheral rim 5 pixels (7.7 mm) in width. In the midventricular slice, a frontal pole cortical segment 3 pixels in width was also identified. This corresponds approximately to the Brodmann area 10. The cortical regions in the midventricular slice thus delineated were (in medial, anterior and posterior order): frontal pole, inferior prefrontal, superior temporal, and inferior parietal-occipital cortices. Additional irregular regions were delineated to incorporate two subcortical structures, the caudate and thalamus, on each side.

The supraventricular slice was selected to display the superior frontal and parietal cortices. The slice was divided into four equal quadrants. The cortical areas were defined as in the lower slice. The frontal cortical area was further subdivided into three equal segments. The two more anterior subsegments corresponded to the superior prefrontal cortex, the third segment to the superior motor and premotor cortices. The posterior segment corresponded to the superior parietal cortex. A rectangular ROI 5 pixels long (anterior-posterior) and 3 pixels wide was placed over areas of increased activity on the mesial surface of the frontal lobe, corresponding to the anterior cingulate region.


Cognitive differences between groups: three group analyses

Group selection was determined by the performance on the RPM and by the number of perseverative errors on the WCST. Accordingly, the groups did not differ on the former, while the PPS group performed poorly on the latter (Table 1). The PPS group also attained fewer WCST concepts and a higher total error score than the other groups. Neither group of patients with schizophrenia performed as well as the normal control group on the NART, FAS, or SET.

View this table:
Table 1

Group differences in cognitive scores: mean (s.d.)

Subjects repeated the WCST as part of the SPECT cognitive activation procedure. Initial (CA1, PE1, TE1) and repeat (CA2, PE2, TE2) test performances were compared. Subjects overall showed no change, but there was a significant group-occasions interaction for preseverative error scores (F=0.986; P<0.000), which was due principally to a decrease in the PPS group score on re-testing (mean preseverative error score change for normal control group -0.36, s.d.=1.69; for APS group, 2.67, s.d.=4.62; and for PPS group -5.45, s.d.=5.77; controls v. PPS, t=2.81, P=0.016). Consequently group mean perseverative error score differences at the time of SPECT cognitive activation were no longer significant (F=2.780; P=0.078).

Regional CBF during the control condition and following activation

The rCBF relative to cerebellar CBF was measured in 26 ROIs (10 cortical regions on each side, the caudate and the thalamus on each side, and whole brain slices at ventricular and supraventricular levels).

Regional CBF during the control condition varied considerably: the lowest rate for a particular ROI was recorded in the left superior-parietal region (mean=0.72, s.d.=0.05), the highest in the right caudate (mean=0.91, s.d.=0.09). The effect of cognitive activation on rCBF was to produce an overall increase, but with substantial regional variations (Fig. 1). Percentage increase ranged from 0.09 (right caudate) to 7.47 (inferior prefrontal).

Group differences during the control condition and during activation were analysed. Effects due to age and to antipsychotic drug medication (measured in chlorpromazine equivalents) were explored using analysis of covariance (ANCOVA) and shown to be insignificant. The variance due to these effects was then removed. Group differences did not achieve significance at the 5% level for any of the 26 ROIs. The two schizophrenia groups were then merged, and a comparison of patient v. normal control group undertaken. No significant group differences were detected.

The effect of cognitive activation was then examined by subtracting rCBF in the control condition from rCBF during activation, and using the values of the change as the dependent variable. In a two-group (schizophrenia v. control) comparison, differences were apparent in the left anterior cingulate region (P=0.043; schizophrenia group, mean=0.047, s.d.=0.084; control group, -0.014, s.d.=0.071) and for whole slice 2 (P=0.028; schizophrenia group, mean=0.028, s.d.=0.036; control group, -0.005, s.d.=0.032). In a three-group comparison, group differences were only significant at the 10% level (left anterior cingulate: P=0.070; PPS group, mean=0.061, s.d.=0.107; APS group, 0.035, s.d.=0.056; normal control, -0.014, s.d.=0.071: whole slice 2: P=0.086; PPS group, mean=0.024, s.d.=0.046; APS group, 0.032, s.d.=0.026; normal control, -0.005, s.d.=0.032). Regional cerebral blood flow values (mean and s.d.) for the three groups during the control condition are shown in Table 2; change values are shown in Table 3.

View this table:
Table 2

Mean regional blood flow values (s.d.) acquired during the control task. Values are expressed as ratios to mean cerebellar regional cerebral blood flow

View this table:
Table 3

Changes in mean cerebral blood flow values (s.d.) with specific activation (regional cerebral blood flow, rCBF) during the Wisconsin Card Sorting Test less rCBF value during control task (values are expressed as ratios to mean cerebellar rCBF)

An alternative analytical approach was also used. The two-group and three-group analyses were repeated, using analysis of covariance in which the rCBF values during the WCST were used as the dependent variable and rCBF during the control task as an additional covariate. None of the differences were significant.

Relationship between regional cerebral blood flow activation and cognitive performance

Pearson correlations were calculated between the rCBF for those ROIs (right inferior frontal, left inferior frontal, left parietal-occipital, left superior frontal, lower whole slice, left superior frontal-middle segment) that showed the greatest increase in rCBF during activation and the principal measures of the activation: WCST, the CA2, PE2 and TE2. The left anterior cingulate was included among the ROIs because, although it did not show a very significant increase in activation (4.02%), it is this region that discriminates best between groups. There were thus 21 calculations. When all subjects were included, none of the correlations achieved significance. When the three groups were each studied separately, a pattern emerged: in the normal control group, rCBF for all of the ROIs correlated positively with CA2 scores, and negatively with PE2 and TE2 scores, while in the APS group, the reverse was true in 15 of the 18 calculations. The PPS group resembled the APS group. However, the only significant correlations were in the APS group between the left superior frontal (middle segment) and CA2 (Pearson correlation -0.765, P<0.01) and left superior frontal (middle segment) and TE2 (Pearson correlation 0.667, P<0.05).


The principal aim of the study was to attempt to replicate and extend the finding reported by Weinberger et al (1986). They found that subjects with schizophrenia performed poorly on the WCST (which is thought to depend, at least in part, upon the integrity of frontal lobe function), and failed to exhibit a significant increase in dorsolateral prefrontal cortical rCBF such as could be detected in normal subjects while performing the test. This failure could not be readily explained as part of a general inability to respond to cognitive challenge with appropriate regional activation, as the same group of patients did not differ from normal subjects in their rCBF response to RPM, a non-frontal cognitive challenge.

Technical and methodological limitations

Limitations of technique and methodology must be acknowledged. The radiotracer technique employed provides an estimate of rCBF relative to a common reference region so that different regions may be compared: it does not measure rCBF as such. SPECT lacks the spatial resolution of positron emission tomography (PET) and functional magnetic resonance imaging (fMRI). The cerebellum was chosen as the reference ROI. It is an easily identifiable and definable ROI, and, although it may be implicated in the schizophrenic process (see, for example, Volkow et al, 1992) the evidence is less compelling than for the cerebral hemispheres, the neocortices of which are almost certainly extensively involved. Structural image coregistration would have reduced movement artefact and improved anatomical interpretation, but was not available to us. Nor did we have access to a SPECT programme that provided a three-dimensional reconstruction. Although the performance of the normal control group was superior to that of the patient group on a measure of premorbid intelligence, the groups did not differ on the RPM, a current measure of general intelligence, and it seems unlikely that this discrepancy would have significantly influenced the outcome. Finally, the analysis involved multiple comparisons, but the variables — regional increases in blood flow — were highly correlated and a Bonferroni correction would have been excessively conservative.

Our study was designed to investigate not only those patients who performed poorly on the WCST, but also those whose performance did not differ significantly from that of normal controls. We were able to identify groups of poorly performing (PPS) and adequately performing (APS) patients with schizophrenia. All groups performed adequately on the RPM. Measurement of rCBF during the control task did not show any between-group differences. Performance on the sorting task was associated with widespread cortical activation, as judged by increase in rCBF (especially in the frontal and occipital egions). Test performance related to rCBF increase did not differ greatly between groups, but a direct comparison of the combined group of patients with the normal control group showed the former to have a greater increase in the left cingulate region and in the whole transverse slice at supraventricular level. In the normal control group we detected a tendency for the size of the rCBF performance-related increase to be directly related to the test performance scores, while in the groups of patients the reverse was the case. The PPS group showed a highly significant improvement in perseverative error scores between the two test occasions.

Differences in cohort characteristics may explain the failure to replicate

We were unable to replicate Weinberger et al's (1986) findings. Many of our patients were able to obtain respectable scores on the WCST, and many of those who failed to do so the first time showed a marked practice effect. Patients and controls alike showed a fronto-occipital performance-related increase in blood flow (in some regions this was marginally greater for patients with schizophrenia than for controls).

Why should our results differ? A clue may lie in the failure of most of Weinberger et al's patients to perform the WCST or to benefit from intense guidance and coaching (Goldberg et al, 1987). This raises the possibility that they were considerably more impaired, which is further supported by the clinical description provided. These studies drew upon a cohort of patients who had been selectively referred to a national clinical research centre and were refractory to conventional treatment. The subjects had been withdrawn from antipsychotic medication 4 weeks before participating in the study, and, although this interval would be insufficient to ensure tissue clearance, it is likely that in many cases clinical deterioration would compromise test performance. Our patients were stable, medicated out-patient attenders, drawn from local district services, to which they had been referred by general practitioners. The services in the two hospitals were provided for a provincial and for an inner-city population, respectively; they may therefore be regarded as a fairly representative sample of patients with schizophrenia.

There have been few other published attempts to replicate these results. Kawasaki et al (1993) used a similar neuro-imaging technique to that described here, but used as a control condition the subject in a resting state in the imaging position. Both patient and normal control groups performed adequately on the WCST, and both showed a performance-related rCBF increase in the left dorsolateral prefrontal cortex. Cantor-Graae et al (1991), in an uncontrolled study of seven patients with chronic schizophrenia, using the xenon inhalation method, failed to demonstrate any regional activation. However, the same group (Cantor-Graae et al, 1993) failed to show activation in normal subjects. More recent studies using fMRI have demonstrated prefrontal cortical activation with WCST.

Use of the WCST as a means of prefrontal cortex activation

Our failure to replicate Weinberger et al's findings may be due to patient selection; other factors may also play a part. Activation of a discrete area of the dominant hemisphere dorsolateral prefrontal cortex (Brodmann's area 46) during performance of the WCST in normal subjects is a consistent finding of Weinberger's group (Weinberger et al, 1986, 1988) and is central to their hypothesis.

The value of WCST as a means of localising brain dysfunction was first demonstrated in subjects with discrete frontal lobe lesions. This may not be an appropriate model for schizophrenia. Even within samples of neurological patients, the test has failed to distinguish persons with frontal lesions from those with more diffuse brain disease (Robinson et al, 1980).

However, in our study frontal activation did occur, but was widespread throughout the frontal regions in both hemispheres. This is hardly surprising. Even the simplest cognitive tasks are mediated through a parallel distributed network, as demonstrated by a multifocal activation pattern. The WCST is a complex task that makes demands on a number of resources, including, among others, focused attention, working memory and conceptual flexibility. Activation limited to a discrete cortical area is not to be expected. Occipital activation was also seen and has previously been reported during the processing of complex visual stimuli (Phelps et al, 1981).

Finally, the widely accepted view, based on early studies, that performance on the WCST is specifically impaired in schizophrenia is increasingly open to question. In a study of chronic stable medicated out-patients comparable to our own (Braff, 1991), subjects completed a comprehensive battery of 20 neuropsychological measures. The WCST ranked only 17th in terms of its sensitivity to schizophrenic deficit; however, one-third of the patients fell in the impaired range on perseverative response scores; poor performance was associated with the presence of negative symptoms. On a battery of standardised tests, untreated schizophrenia sufferers showed a global deficit, but were less impaired on the WCST than on most other tests (Saykin et al, 1991). Other studies continue to report impaired WCST performance (Stratta et al, 1993).

This lack of agreement may reflect clinical heterogeneity. It may also be due to procedural differences, in particular the use of both the standardised and the modified forms of the WCST and the increasing dependence on automated presentation.

Stability of WCST over time

Goldberg et al (1987) reported that their subjects with schizophrenia did not improve their performance on the WCST, even after they were given additional instructions while taking the tests. All of our subjects repeated the test, often after an interval of several months. On each occasion they received the same set of instructions. No attempts were made to discuss with them the principles underlying the test, or how their performance might be improved. Nevertheless, the test scores of the PPS group improved considerably, and although their performance was still inferior to that of the other groups at the time of neuroimaging, this was no longer significant. Part of the improvement could be explained as a regression towards the mean, but this would assume that the initial scores were randomly distributed and inherently lacking in constancy, whereas the strong correlations with intelligence, educational attainment, and social and occupational achievement established elsewhere suggest that performance on the WCST is a fairly stable characteristic. Our findings could be due to a practice effect, and as such would be in keeping with other reports of WCST improvement after practice (for example, Metz et al, 1994), and suggest that whatever deficiencies underlie poor performance, they are not irremediable. This much is recognised by Goldberg and Weinberger, who in a recent review (1994) acknowledged that instruction (Green et al, 1990) and even monetary reward (Summerfelt et al, 1990) might lead to improved performance, but questioned whether it would be sustained and the extent to which it might generalise.

We also wished to determine whether the groups of schizophrenia sufferers exhibited different patterns of regional activation from the control groups. Group differences were only evident in the left anterior cingulate region and in the superior transverse plane. The possible significance of the first findings may be somewhat compromised by the observation that this region showed rather less activation than other dominant hemisphere frontal lobe regions. Moreover, in a subsequent analysis of covariance in which the activation rCBF formed the dependent variable and the control condition rCBF was used as a covariate, significance was lost.

Clinical Implications and Limitations


  • The study was unable to confirm a failure of prefrontal activation in schizophrenia as previously reported.

  • The performance of a test of executive function (the Wisconsin Card Sorting Test) was accompanied by a widespread increase in frontal blood flow. Subjects with schizophrenia showed this increase regardless of whether they performed adequately or poorly on the test.

  • Poor performance on tests of executive function is not irremediable. This has important implications for rehabilitation.


  • Image co-registration would have reduced movement artefact and improved anatomical identification.

  • The use of parametric statistical mapping would have increased accuracy and precision.

  • The groups could have been more closely matched for age.

  • Received February 18, 1998.
  • Revision received March 17, 2000.
  • Accepted March 17, 2000.


View Abstract