The British Journal of Psychiatry (2008) 192: 248-257. doi: 10.1192/bjp.bp.106.029009
© 2008 The Royal College of Psychiatrists
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Data supplement
Right arrow Submit an eLetter
Right arrow View responses
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Related articles in BJP
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Szöke, A.
Right arrow Articles by Leboyer, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Szöke, A.
Right arrow Articles by Leboyer, M.

Review Article

Longitudinal studies of cognition in schizophrenia: meta-analysis

Andrei Szöke, MD, PhD and Anca Trandafir

INSERM U841, 94000, Créteil, France, Université Paris 12, Faculté de Médecine, IFR 10, 94000, Créteil, France, and AP-HP, Groupe Hospitalier `Chenevier-Mondor', Pôle de Psychiatrie, 94000, Créteil, France

Marie-Estelle Dupont

AP-HP, Groupe Hospitalier `Chenevier-Mondor', Pôle de Psychiatrie, 94000, Créteil, France

Alexandre Méary, MD, Franck Schürhoff, MD, PhD and Marion Leboyer, MD, PhD

INSERM U841, 94000, Créteil, France, Université Paris 12, Faculté de Médecine, IFR 10, 94000, Créteil, France, and AP-HP, Groupe Hospitalier `Chenevier-Mondor', Pôle de Psychiatrie, 94000, Créteil, France

Correspondence: Dr Andrei Szöke, Service de Psychiatrie Adulte, Hôpital Albert Chenevier, 40 rue de Mesly, 94000 Créteil, France. Email: andrei.szoke{at}ach.aphp.fr

Declaration of interest

None.


arrow
ABSTRACT
 
Background

A wide range of cognitive deficits have been demonstrated in schizophrenia, but their longitudinal course remains unclear.

Aims

To bring together all the available information from longitudinal studies of cognitive performance in people with schizophrenia.

Method

We carried out a meta-analysis of 53 studies. Unlike previous reviewers, we included all studies (regardless of the type of medication), analysed each variable separately and compared results with data from controls.

Results

Participants with schizophrenia showed a significant improvement in most cognitive tasks. The available data for controls showed, with one exception (the Stroop test), a similar or greater improvement. Performance in semantic verbal fluency remained stable in both individuals with schizophrenia and controls.

Conclusions

Participants with schizophrenia displayed improvement in most cognitive tasks, but practice was more likely than cognitive remediation to account for most of the improvements observed. Semantic verbal fluency may be the best candidate cognitive endophenotype.


arrow
INTRODUCTION
 
People with schizophrenia have been shown to have a wide range of cognitive deficits, but the longitudinal course of these deficits remains unclear. Some studies have suggested that cognitive function deteriorates over time,1,2 whereas others have reported stability or even an improvement in some functions.3,4 This issue is important for several reasons. First, it could help to resolve the perennial debate between those who conceptualise schizophrenia as a neurodegenerative, progressive disorder and those who view it as a stable deficit stemming from a developmental defect. Second, cognitive deficits have come to be considered as potential endophenotypes that might facilitate the identification of genetic factors involved in vulnerability to schizophrenia. For a measure to be considered a good endophenotype, it must be stable over time or the non-genetic factors influencing it must be identified and used to obtain a standardised (adjusted) value. Finally, there is growing interest in improving cognitive functions in patients with schizophrenia through pharmacological treatment or cognitive rehabilitation programmes, as a means of improving functional outcome.5 We therefore need to identify the cognitive deficits that are not fixed and the tests and variables that are most sensitive to change, to facilitate the monitoring of results.

In this study we analysed the available information by meta-analysis of all studies in which the same sample of people with schizophrenia underwent cognitive testing on two separate occasions more than 1 month apart.


arrow
Method
 
We based our search for relevant articles on three complementary procedures. We first searched the Medline database, limiting our search to: HUMAN, ADULT and PUBLICATION DATE 1978–2006. We identified relevant articles by searching for (SCHIZO* or PSYCHOTIC) and (COGNIT*) and (RETEST or LONGITUDINAL). The second term (COGNIT*) was replaced with a succession of terms describing cognitive domains (MEMORY, EXECUTIVE, ATTENTION) or the names of frequently used cognitive tests (WECHSLER MEMORY SCALE or WMS, WISCONSIN or WCST, TRAIL MAKING TEST or TMT, VERBAL FLUENCY, CONTINUOUS or CPT, STROOP, CALIFORNIA or CVLT, DIGIT SPAN). We also obtained additional references from the two practitioner's guides to evaluating change edited by McCaffrey et al.6,7 We then screened the reference lists of these articles to find other studies on the subject. Finally, we manually searched recent issues (from January 2003 to March 2006) of seven major psychiatric journals considered relevant to this study: Schizophrenia Research, Archives of General Psychiatry, American Journal of Psychiatry, British Journal of Psychiatry, Psychiatry Research, Schizophrenia Bulletin and Journal of Nervous and Mental Disease.

Selection of articles for inclusion in the meta-analysis
We selected articles satisfying the following criteria:

  1. diagnosis of schizophrenia in patients (according to Research Diagnostic Criteria, DSM–III, DSM–III–R or DSM–IV, ICD–9 or ICD–10);
  2. participants aged over 18 years;
  3. results reported separately for each task (i.e. not only as composite scores) on both occasions;
  4. sufficient data available to calculate the effect (i.e. mean and standard deviation, F or t statistics) in at least three studies for each cognitive test;
  5. data independent of the other data included in our meta-analysis (if several articles dealt with the same population, we selected only the article with the largest sample);
  6. at least 1 month between test and retest and no specific training to improve performance in the test used (to minimise practice effects).

Recorded variables
From each study we extracted the following variables, if available:

  1. name of the first author and year of publication;
  2. the cognitive tests used;
  3. diagnosis of participants (i.e. only schizophrenia, or schizophrenia and other psychotic disorders);
  4. number of participants included at each evaluation;
  5. time (months) between test and retest;
  6. type of treatment and dosage (in chlorpromazine equivalents) at the time of the first and second evaluations. Type of treatment was recorded as a dichotomous variable: typical antipsychotic drugs (neuroleptics) v. atypical (novel) antipsychotic drugs;
  7. percentage change in positive and negative scores between test and retest, measured using the Scale for the Assessment of Negative Symptoms (SANS), the Scale for the Assessment of Positive Symptoms (SAPS) and the Positive and Negative Syndrome Scale (PANSS);
  8. results of tests (mean; s.d.) from the two evaluations or statistics (F, t) and direction of change if the mean and s.d. were unavailable; if data were provided for more than two evaluations we used only data from the first two, to minimise practice effects.

The variables (c) to (g) were recorded because they were considered potential moderators of the difference between the two measures of cognitive performance.

Meta-analytical procedure
We analysed each measure from each cognitive test separately, without grouping variables from several tests into composite scores for large cognitive domains. We felt that this strategy would be the most effective way to identify longitudinal changes in specific cognitive processes and the most useful variables for genetic research (those providing stable measures) or for assessing treatment impact (those changing over time).

Using the data reported in each study, we estimated the effect size by calculating Hedges' unbiased g,8 with positive values reflecting better performances on retesting (second evaluation) than at first evaluation. We tested the homogeneity of effect sizes using the I 2 statistic, as described by Higgins & Thompson.9 As suggested by these authors, values exceeding 30% were considered to indicate significant heterogeneity.

For homogeneous data, we calculated the global effect size, using a fixed effect model as described by Hedges & Olkin.8 In the absence of significant heterogeneity, the use of a fixed effect model is legitimate and may provide greater statistical power than the random effect model. For heterogeneous studies we used the sample-adjusted meta-analytic deviancy (SAMD) and scree plots10 to identify studies with extreme values (outliers). The SAMD statistic compares the value of each study with the mean sample-weighted value calculated with that study excluded from the analysis, adjusting for the sample size of the study. A study is considered to be an outlier if its SAMD value is greater than 3.0 or if it produces a drastic break in the SAMD scree plot. When these procedures identified clear outliers (small numbers of studies isolated by a drastic break in the scree plot and with SAMD values exceeding 3), the data from these studies were removed and analyses were carried out as previously described. Data for outliers were analysed to identify, when possible, the origin of the heterogeneity. When the SAMD and scree plot procedures failed to identify outliers clearly we used a random effect model11 to calculate global effect size.

For comparison purposes we used the same analytical procedures to calculate the effects in control samples. A comprehensive evaluation of the differences between test and retest results in healthy controls was beyond the scope of this study. We therefore restricted our analysis to control samples from the studies included in our meta-analysis, together with data from studies cited by McCaffrey et al.6,7 For each variable, separate analyses were conducted for samples derived from studies included in our meta-analysis and for all samples (from our meta-analysis and from McCaffrey et al).6,7

For the tests for which more than ten samples were available, we assessed the influence of potential moderator variables with a one-factor fixed-effect model.12 The potential moderator variables tested were time between the two evaluations; diagnosis of the participants (schizophrenia only, or schizophrenia and other psychotic disorders); change of treatment type v. same type of antipsychotic treatment (typical or atypical); difference in dosage of antipsychotic medication (chlorpromazine equivalents) between test and retest; percentage change in negative symptoms; and percentage change in positive symptoms.


arrow
Results
 
We identified 131 potentially relevant studies, 53 of which met the inclusion criteria. The selection process is illustrated in Fig. 1. The tests used for each study are listed in a data supplement to the online version of this paper. In total, 2476 people with schizophrenia participated in the 53 studies selected. The mean time between test and retest was 12 months (median 4 months) and the mean age of these participants was 37 years. Only 12 of the studies included in our analysis had a healthy control group (total number of control participants 324). We analysed the data for 11 tests (see online data supplement) and 31 variables available from more than three studies.


Figure 1
View larger version (20K):
[in this window]
[in a new window]
[as a PowerPoint slide]
  		Fig. 1 Selection process for the articles included in the meta-analysis.

Analysis of effect sizes in the schizophrenia group samples
We analysed each test independently; however, for clarity the results are presented according to the categories of memory, executive function, attention and `other tests'.

Memory
The selected articles contained data for nine variables, from six tests exploring various aspects of memory. Two of these tests assessed visual memory: the Rey Complex Figure test and Visual Reproduction from the Wechsler Memory Scale (WMS). The remaining four assessed verbal memory: the California Verbal Learning Test (CVLT), Logical Memory from the WMS, the Hopkins Verbal Learning Test (HVLT) and the Rey Auditory Verbal Learning Test (RAVLT). The results are summarised in Table 1.


View this table:
[in this window]
[in a new window]

  		Table 1 Change between test and retest in variables derived from the memory tests

For three variables (RAVLT immediate recall, HVLT immediate recall and HVLT delayed recall), the data were heterogeneous. The SAMD and scree plot analyses failed to identify clear outliers for the two variables from the HVLT. Thus, for these variables the global effect was calculated by a random effect procedure. For the RAVLT, one study13 was identified as an outlier (SAMD 3.72, and a clear break in the scree plot). Following the exclusion of this study, the other data were homogeneous and the global effect was therefore calculated using a fixed effect model. Stip et al13 obtained the largest improvement in the RAVLT. They reported results for cognitive assessment at baseline and for the last observation carried forward, which was, for most participants, the third assessment. Other studies used a similar design,14,15 but the intervals between assessments were shorter in Stip's study (4 weeks), increasing the effect of practice and potentially accounting for the observed results.

The estimated effects for memory tests ranged from 0.20 for immediate recall in the Visual Reproduction test to 0.53 for immediate recall in the Rey Complex Figure test. Significant improvements were observed in all tests except HVLT delayed recall. The characteristics of the tests (visual or verbal, recall or recognition, immediate or delayed) had no clear influence on the magnitude of improvement at retest (Table 1).

Executive functions
We were able to calculate a global estimate of the difference between test and retest for ten variables from five tests of executive functions (Table 2): (lexical and semantic Verbal Fluency, the Stroop test, the Wisconsin Card Sorting Test (WCST) and the Trail Making Test part B (TMT–B).


View this table:
[in this window]
[in a new window]

  		Table 2 Change between test and retest in variables derived from the executive tests

Data were homogeneous for all but two variables: percentage perseverative error in the WCST and number of coloured words in the interference task of the Stroop test. For the percentage of perseverative errors in the WCST, the SAMD identified the study by Penades et al16 as an outlier (SAMD 3.73, and break in the scree plot). The remaining data were homogeneous once the data from this study had been excluded. Penades et al16 studied patients who underwent cognitive rehabilitation therapy between test and retest, potentially accounting for the greater improvement between test and retest observed in this study (estimated effect 1.35, 95% CI 0.72–1.98).

The results obtained for the number of coloured words in the interference task of the Stroop test were highly heterogeneous, with the effects in the various studies ranging from –0.32 to 0.99 (P=0.004). The use of different formats of this classic test in the various studies is the most likely explanation for this difference. Indeed, a 60 s format was used in one study, the 90 s format was used in two studies, a 100 s task in another study and two more studies referred to the original article by Stroop published in 1935 – which, however, did not use the number of coloured words as a response variable. Two studies did not describe the format of the Stroop task used. No clear outlier was identified through the SAMD or scree plot procedures, so global effect was calculated using the random effect procedure.

The estimated effects for the executive functions tasks ranged from 0.02 to 0.28, with slight improvements observed for certain tasks, and no significant difference for others.

Attention
In the studies included in our analysis, we identified six variables from four tests generally considered to measure attentional processes. The results for these variables are summarised below (Table 3).


View this table:
[in this window]
[in a new window]

  		Table 3 Change between test and retest in variables derived from the attention tests

The data for the Digit Span Distractibility Task were heterogeneous. We therefore carried out analyses to identify outliers. The SAMD for the study by Green et al17 was 4.07, and this study was therefore excluded from the analysis for this task. Green's study reported the greatest improvement of any of the studies using this test (estimated effect 1.01, 95% CI 0.48–1.56). No potential moderator variable that could account for the heterogeneity of the data was identified.

The estimated effects of attentional tasks ranged from 0.08 to 0.27, with only that for the Trail Making Test part A (time) being significant.

Other tests
Six other tasks that could not be grouped into any meaningful category were analysed (Table 4). Four were from the Wechsler Adult Intelligence Scale (WAIS): two verbal tasks (Similarities and Vocabulary), one task assessing psychomotor performance (Digit Symbol Substitution) and one assessing visuospatial conceptualisation (Block Design). The effects obtained for these tasks were small but (with the exception of Vocabulary) significant, showing a slight improvement between test and retest. The other two tests analysed, the Boston Naming Test and Rey Complex Figure (copy), showed a small, non-significant change between test and retest.


View this table:
[in this window]
[in a new window]

  		Table 4 Change between test and retest in variables derived from the `other' (not classified) tests

The estimated effects for all the tasks analysed are presented in graphical form to facilitate comparison (Fig. 2).


Figure 2
View larger version (15K):
[in this window]
[in a new window]
[as a PowerPoint slide]
  		Fig. 2 Change (estimated effects and confidence intervals) in the cognitive variables analysed in participants with schizophrenia. CVLT, California Verbal Learning Test; DSDT, Digit Span Distractibility Test; HVLT, Hopkins Verbal Learning Test; LM, Logical Memory; PE, perseverative errors; RAVLT, Rey Auditory Verbal Learning Test; TMT–A/B, Trail Making Test part A/B; VR, Visual Reproduction; WCST, Wisconsin Card Sorting Test; WMS, Wechsler Memory Scale.

Potential moderator factors
We analysed the impact of six potential moderator factors (time between evaluations; participants' diagnosis; change in treatment; difference in chlorpromazine equivalents; percentage change in negative symptoms; percentage change in positive symptoms) on the test–retest difference for variables for which data from at least ten samples were available – i.e. 17 variables: Visual Reproduction (immediate and delayed recall); Logical Memory (immediate and delayed recall); Verbal Fluency (Letters and Categories); WCST (number of perseverative errors, percentage perseverative errors, number of categories completed); TMT–A and TMT–B (time); RAVLT (immediate recall); HVLT (immediate recall); Digit Symbol Substitution; Block Design; Digit Span; and Similarities. The interval between the two evaluations and the participants' diagnoses were reported in all cases. Data for the other potential moderators were reported less frequently, but it was none the less possible – except for dosage of antipsychotic drugs – to analyse their influence on all 17 variables. We were able to analyse the influence of antipsychotic drug dosage on only 7 variables: Verbal Fluency (Letters), WCST (number of preservative errors, percentage of perseverative errors, number of categories completed); time for TMT–A and B; and Block Design. The results of most of these analyses were not significant. The significant results are summarised below.

For TMT–B (time), patients who changed treatment from neuroleptics to novel antipsychotic drugs showed a significantly larger improvement in performance (estimated effect 0.33, 95% CI 0.19 to 0.47) than patients who remained on the same type of treatment (either neuroleptics or atypical antipsychotic drugs) for both test and retest (estimated effect 0.12, 95% CI –0.01 to 0.25). Similar results were obtained for Visual Reproduction (delayed recall). Patients who changed treatment between the two assessments performed better on retest (estimated effect 0.45, 95% CI 0.18 to 0.72) than those who remained on the same treatment (estimated effect –0.07, 95% CI –0.42 to 0.28). For the Block Design task, patients remaining on the same dosage of antipsychotic medication (in chlorpromazine equivalents) performed better (estimated effect 0.23, 95% CI –0.11 to 0.57) than those whose dosage of antipsychotic medication was decreased (estimated effect –0.06; 95% CI –0.36 to 0.25). The time between the two trials significantly affected performance in the Logical Memory (delayed recall) and Visual Reproduction (delayed recall) tests. As expected, the improvement in performance for these variables was inversely related to the time between test and retest.

Test–retest results for control groups
The studies included in our analysis provided sufficient data for estimation of the differences between test and retest in `internal' controls for only 9 variables. With the addition of supplementary data (samples of controls from other studies: `external' controls), we had sufficient data to estimate the effects for 19 of the 31 variables. Table 5 summarises our findings for the controls. We present data for controls from studies included in our meta-analysis and for these data combined with data from the studies cited by McCaffrey et al 6,7 – `all controls'. Data for the same variables in participants with schizophrenia are provided for comparison.


View this table:
[in this window]
[in a new window]

  		Table 5 Changes in the cognitive variables in the control samples compared with changes in the schizophrenia samples

The data suggested a definite practice effect (improvement statistically different from 0) in 10 of the 19 variables, a possible practice effect (improvement between test and retest, but with a confidence interval including 0) in 6 variables and no improvement in the remaining 3 variables (with no variable significantly deteriorating). Comparisons of those data with data from the schizophrenia group may be summarised as follows. For variables showing a significant practice effect, no significant difference was observed for 6 variables and controls improved significantly more than the participants with schizophrenia for the other 4 variables. For the variables with a possible practice effect, improvement was significantly greater for controls on one measure, with no significant difference for the other five. Participants with schizophrenia showed no significant difference from controls for 2 of the 3 variables for which no improvement was observed in controls, but a significant improvement was observed in the number of words in the interference task of the Stroop test. Comparisons of data from `internal controls' and participants with schizophrenia gave similar results, with no significant difference in improvement for 4 variables and significantly higher levels of improvement in controls for the other 5 variables.

We evaluated the differences between studies assessing controls or participants with schizophrenia by comparing the testing (interval between test and retest) and demographic (age of the participants) characteristics available for all samples. The significant differences are indicated in Table 5. Similar improvements in performance were observed in controls and in participants with schizophrenia whose medication type changed, for the TMT–B (0.30, 95% CI 0.18 to 0.42) and for Visual Reproduction (delayed recall) (0.37, 95% CI 0.25 to 0.49), whereas for the same variables, controls showed a significantly larger improvement in performance than patients remaining on the same medication.


arrow
Discussion
 
Several reviews4,18 and meta-analyses19–21 have already been published on the topic of cognitive change in schizophrenia. Overall, these analyses suggest that there is no progressive impairment for most cognitive variables and that, for some cognitive domains, improvement is possible after the onset of the disorder. These previous studies were, in our view, subject to several limitations. First, with the exception of Rund's review, they aimed to examine the effects of medication on cognitive functions in schizophrenia. This resulted in the exclusion of several primary studies and over-representation of studies with short test–retest intervals. Another limitation is that the results of these studies were presented as composite scores for broad cognitive functions (e.g. executive functions, memory). This is a convenient way to summarise findings, but it combines data from tests exploring different cognitive processes (e.g. memory tests assessing immediate or delayed recall, learning or recognition), generating results of questionable theoretical relevance. Furthermore, the results obtained do not help researchers to select the most useful tests or variables based on stability or sensitivity to change. Another important methodological problem is that changes in the samples of people with schizophrenia were not compared with changes in control groups. Thus, when improvement is observed it is unclear how much is due to learning or practice effects and how much is due to a genuine improvement in cognitive abilities. We tried to overcome these limitations by including in our meta-analysis all the available studies in which the same group of people with schizophrenia underwent cognitive testing on two occasions more than 1 month apart. We analysed each variable separately and, when possible, we also calculated changes over time in the cognitive performances of normal controls.

Given the methodological differences cited above, it is interesting to compare our results with those of previous studies, especially that of Woodward et al,21 which is the most recent of these studies and used similar statistical methods. Our estimated effect sizes were smaller than those in Woodward's study and the estimated effects showed a broader distribution (from –0.02 to 0.53 v. 0.17 to 0.46 in Woodward's study). Our estimated effect sizes might be lower because we tried to limit the effect of practice by including only studies in which the test–retest interval was greater than 1 month (Woodward et al also included studies with a test–retest interval of between 1 week and 1 month), and by using only the results of the first and second evaluations from studies reporting several successive evaluations (whereas Woodward et al used the first and last evaluations). The broader distribution of the estimated effects probably results from the effects being reported separately for each variable. However, there are also some similarities in the results reported by these two meta-analyses. In both Woodward's review and our own analysis, the greatest differences in effect sizes were observed in the memory tests (Learning and Delayed Recall domains, 0.46 and 0.43 respectively), with tests of `cognitive flexibility and abstraction' (0.38) and `vigilance and attention' (0.35) showing milder improvement.

Influence of moderator factors
When enough data were available we assessed the effect of potential moderator factors on cognitive changes between test and retest. Participants with schizophrenia showed significantly greater improvements in performance if the total antipsychotic dosage was maintained (for Block Design), if the test–retest interval was shorter (delayed recall for Logical Memory and Visual Reproduction) and if treatment was changed from conventional to novel antipsychotic drugs (TMT–B time and Visual Reproduction delayed recall tests).

The two tests showing a greater improvement with shorter test–retest intervals were both memory tests. Memory measures are among the most susceptible to the effects of practice and the test–retest interval has a substantial influence on the magnitude of the practice effect.7 Thus, the pattern of results for these two tests may be accounted for by the effect of practice. For two other variables, TMT–B time and Visual Reproduction delayed recall, a significantly greater improvement was observed if the patient's medication had been switched from a conventional to a novel antipsychotic drug. These results may suggest that atypical antipsychotic drugs have more beneficial effects on cognition than typical neuroleptics. However, this difference was relatively small and limited to a few cognitive variables (significant improvements in only 2 of the 17 cognitive variables tested).

Furthermore, there are at least two potential sources of bias that might lead to these conclusions: publication bias (particularly for studies sponsored by pharmaceutical companies), and the fact that changes between the two antipsychotic drug categories were always in the same direction (conventional to novel antipsychotic drugs). Patients are generally included in such studies because of the inefficacy of their current treatment and/or the presence of adverse effects. Thus, the cognitive improvement might result from the withdrawal of an ineffective treatment or the removal of an adverse effect, rather than from a specific positive action of a new antipsychotic drug. If treatment change is itself the factor associated with improvement, then changes in medication for the same reasons (inefficacy and/or adverse effects) in the other direction (i.e. from atypical to typical antipsychotic drugs) should also result in cognitive improvement. To our knowledge, this hypothesis has not been tested. In addition, some of the observed differences may not be due to the specific action of the two classes of antipsychotic drug, and may instead be due to atypical antipsychotic drugs having fewer extrapyramidal adverse effects and, in some cases, normothymic effects. Thus, patients taking such medication require fewer prescriptions of anticholinergic and/or normothymic drugs, both of which are known to have mildly deleterious effects on cognition.

Overall, our results concerning the role of potential moderators must be regarded as exploratory and interpreted with caution for two reasons. First, not all the studies provided data, limiting our ability to assess the influence of some of these moderators. Second, the large number of statistical tests might have led to spurious findings due to type I errors.

Comparison with performances in controls: role of the practice effect
The observed improvements in the performances of participants with schizophrenia may result from real improvements in cognition, a practice (learning) effect or a combination of the two. In samples of adult controls, improvements in cognitive performance assessed on two separate occasions are mostly due to practice effects. In older control group participants, this effect may be combined with a slight deterioration of performance (especially in memory and timed tests).

We were able to estimate the test–retest effect in controls for only 19 of the 31 variables. Test variables showing a possible or definite practice effect among patients with schizophrenia fell into two categories: variables for which the schizophrenia and control groups showed similar improvement, and variables for which the improvement was smaller than expected in the schizophrenic group. In other words, for these tests, the improvement in the schizophrenia group never exceeded the practice effect. As the control groups were older than the schizophrenia groups for most of the variables (and the test–retest interval was also longer for two of the variables), differences between control and schizophrenia groups might have been underestimated. For only one variable (number of words in the interference task of the Stroop test), which showed no practice effect, improvement was greater in the schizophrenia group than in controls. However, this result should be interpreted with caution because the total control group was small and the data for the schizophrenia group were heterogeneous. These data suggest that, for most variables, the practice effect alone might account for the improvement observed in people with schizophrenia and might mask an actual deterioration in some cognitive processes.

Given the size and extensive impact of the practice effect, this effect should be taken into account in the design of future studies. The use of a control group is therefore of paramount importance, to ensure that results can correctly be interpreted as indicating improvement or deterioration in the cognitive abilities of people with schizophrenia. For example, in our meta-analysis, patients with schizophrenia showed similar improvements for delayed recall in the Logical Memory task and in the number of words in the interference condition of the Stroop test; however, when these results were compared with those for controls, conflicting interpretations were obtained (deterioration in the memory task but improvement in the Stroop test). It may also be important to match the two groups – schizophrenia and controls – not only in terms of demographic characteristics (age, gender, etc.), but also for familiarity with the tests used and, more generally, familiarity with testing situations. This is likely to be true for longitudinal studies, but is probably even more important for studies comparing the performances of different populations with a single evaluation.

Semantic verbal fluency as a potential endophenotype
Our results suggest that semantic Verbal Fluency (Categories), for which stable results were obtained in patients (estimated effect 0.02) and a slight (statistically non-significant) decrease over time was observed in controls (estimated effect –0.10), may represent the most promising potential endophenotype. The slight decrease observed in controls might have resulted from the inclusion of a large number of older people in the group (mean age 73.4 years). There are also other arguments to support the use of semantic verbal fluency as a potential endophenotype. The Categories Verbal Fluency test is one of the measures showing the highest degree of impairment in patients with schizophrenia22 and in first-degree relatives of such patients.23,24

Lexical verbal fluency, which is similar to semantic verbal fluency in the test format and, to some extent, in the cognitive processes involved (e.g. general retrieval), does not share these qualities. Lexical verbal fluency is less impaired than semantic verbal fluency in people with schizophrenia25,26 and in their relatives.23,24 Furthermore, in our analysis Verbal Fluency (Letters) scores improved significantly in both participants with schizophrenia and controls.

Keefe et al19 and Woodward et al 21 identified verbal fluency as one of the cognitive domains showing significant improvement in patients treated with novel antipsychotic drugs. Heinrichs & Zakzanis22 found a strong trend for patients taking high dosages of medication (chlorpromazine equivalents) to show lower levels of verbal fluency impairment. However, all these studies used a composite score based on data from both the Letters and Categories Verbal Fluency measures, and they therefore do not contradict our conclusion that semantic verbal fluency is stable.

The only other test showing similar, stable results in control and schizophrenia groups was the Boston Naming Test, which is also sensitive to the integrity of the semantic store.

Limitations
The results of our analysis must be interpreted bearing its limitations in mind. Most of these limitations result from the small number of primary studies available, and from heterogeneity in the tests used and in data collection and reporting. More than half the potentially relevant studies were excluded for various reasons. Some studies were excluded because of major methodological differences (e.g. inclusion of patients with diagnoses other than psychotic disorders), but 39 studies were excluded simply because data for individual tests were not provided. This clearly represents a major loss of information, although it is not clear what effect this information would have had on our results. Differences in the variables reported limited our ability to detect a significant effect of moderators. Finally, the lack of a healthy control group in most studies limited the interpretation of the results. We tried to palliate this problem by including controls from other studies, but this resulted in large differences in demographic (e.g. age) and study (e.g. time between test and retest) characteristics. Furthermore, we did not carry out a systematic review of the data for controls and we included no recent data (subsequent to the publication of two books by McCaffrey et al).6,7


arrow
ACKNOWLEDGMENTS
 
This research was supported by grants from Institut National de la Santé et de la Recherche Médicale (INSERM) and the Délégation à la Recherche Clinique de l'Assistance Publique – Hôpitaux de Paris (PHRC AOM 98152).


arrow
REFERENCES
 
    1
  1. Goldberg TE, Weinberger DR, Berman KF, Pliskin NH, Podd MH. Further evidence for dementia of the prefrontal type in schizophrenia? A controlled study of teaching the Wisconsin Card Sorting Test. Arch Gen Psychiatry 1987; 44: 1008 -14.[Abstract/Free Full Text]
    2. 2
  2. Bilder RM, Lipschutz-Broch L, Reiter G, Geisler S, Mayerhoff D, Lieberman JA. Neuropsychological deficits in the early course of first episode schizophrenia. Schiz Res 1991; 5: 198-9.[CrossRef]
    3. 3
  3. DeLisi LE, Tew W, Xie S, Hoff AL, Sakuma M, Kushner M, Lee G, Shedlack K, Smith AM, Grimson R. A prospective follow-up study of brain morphology and cognition in first-episode schizophrenic patients: preliminary findings. Biol Psychiatry 1995; 38: 349-60.[CrossRef][Medline]
    4. 4
  4. Rund BR. A review of longitudinal studies of cognitive functions in schizophrenia patients. Schiz Bull 1998; 24: 425-35.
    5. 5
  5. Gold JM. Cognitive deficits as treatment targets in schizophrenia. Schiz Res 2004; 72: 21-8.[CrossRef]
    6. 6
  6. McCaffrey RJ, Duff K, Westervelt HJ (eds). Practitioner's Guide to Evaluating Change with Intellectual Assessment Instruments. Springer, 2000.
    7. 7
  7. McCaffrey RJ, Duff K, Westervelt HJ (eds). Practitioner's Guide to Evaluating Change with Neuropsychological Assessment Instruments. Springer, 2000.
    8. 8
  8. Hedges LV, Olkin I. Statistical Methods for Meta-analysis. Academic Press, 1985.
    9. 9
  9. Higgins J, Thompson S. Quantifying heterogeneity in a meta-analysis. Stat Med 2002; 21: 1539 -58.[CrossRef][Medline]
    10. 10
  10. Arthur W, Bennett W, Huffcutt A. Conducting Meta-Analysis Using SAS. Erlbaum, 2001.
    11. 11
  11. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986; 7: 177-88.[CrossRef][Medline]
    12. 12
  12. Wang MC, Bushman BJ. Integrating Results Through Meta-analytic Review Using SAS Software. SAS Institute, 1999 .
    13. 13
  13. Stip E, Remington GJ, Dursun SM, Reiss JP, Rotstein E, MacEwan GW, Chokka PR, Jones B, Dickson RA; on behalf of the Canadian Switch Study Group. A Canadian multicenter trial assessing memory and executive functions in patients with schizophrenia spectrum disorders treated with olanzapine. J Clin Psychopharmacol 2003; 23: 400-4.[CrossRef][Medline]
    14. 14
  14. Purdon SE, Jones BDW, Stip E, Labelle A, Addington D, David SR, Breier A, Tollefson GD. Neuropsychological change in early phase schizophrenia during 12 months of treatment with olanzapine, risperidone or haloperidol. Arch Gen Psychiatry 2000; 57: 249-58.[Abstract/Free Full Text]
    15. 15
  15. Purdon SE, Malla A, Labelle A, Lit W. Neuropsychological change in patients with schizophrenia after treatment with quetiapine or haloperidol. J Psychiatry Neurosc 2001; 26: 137-49.
    16. 16
  16. Penades R, Boget T, Catalan R, Bernardo M, Gasto C, Salamero M. Cognitive mechanisms, psychosocial functioning and neurocognitive rehabilitation in schizophrenia. Schizophr Res 2003; 63: 219 -27.[CrossRef][Medline]
    17. 17
  17. Green MF, Marshall BD, Wirshing WC, Ames D, Marder SR, McGurk S, Kern RS, Mintz J. Does risperidone improves verbal working memory in treatment-resistant schizophrenia? Am J Psychiatry 1997; 154: 799 -804.[Abstract]
    18. 18
  18. Spohn HE, Strauss ME. Relation of neuroleptic and anticholinergic medication to cognitive functions in schizophrenia. J Abnorm Psychol 1989; 98: 367 -80.[CrossRef][Medline]
    19. 19
  19. Keefe RS, Silva SG, Perkins DO, Liebermann JA. The effects of atypical antipsychotic drugs on neurocognitive impairment in schizophrenia: a review and meta-analysis. Schizophr Bull 1999; 25: 201 -22.[Abstract/Free Full Text]
    20. 20
  20. Harvey PD, Keefe RS. Studies of cognitive change in patients with schizophrenia following novel antipsychotic treatment. Am J Psychiatry 2001; 158: 176 -84.[Abstract/Free Full Text]
    21. 21
  21. Woodward ND, Purdon SE, Meltzer HY, Zald DH. A meta-analysis of neuropsychological change to clozapine, olanzapine, quetiapine and risperidone in schizophrenia. Int J Neuropsychopharmacol 2005; 8: 457 -72.[CrossRef][Medline]
    22. 22
  22. Heinrichs RW, Zakzanis KK. Neurocognitive deficit in schizophrenia: a quantitative review of the evidence. Neuropsychology 1998; 12: 426 -45.[CrossRef][Medline]
    23. 23
  23. Szöke A, Schürhoff F, Mathieu F, Meary A, Ionescu S, Leboyer M. Tests of executive functions in first-degree relatives of schizophrenic patients: a meta-analysis. Psychol Med 2005; 35: 771 -82.[CrossRef][Medline]
    24. 24
  24. Snitz BE, Macdonald AW, Carter CS. Cognitive deficits in unaffected first-degree relatives of schizophrenia patients: a meta-analytic review of putative endophenotypes. Schizophr Bull 2006; 32: 179 -94.[Abstract/Free Full Text]
    25. 25
  25. Bokat CE, Goldberg TE. Letter and category fluency in schizophrenic patients: a meta-analysis. Schizophr Res 2003; 64: 73 -8.[CrossRef][Medline]
    26. 26
  26. Henry JD, Crawford JR. A meta-analytic review of verbal fluency deficits in schizophrenia relative to other neurocognitive deficits. Cognit Neuropsychiatry 2005; 10: 1-33.[Medline]
    27. 27
  27. Albus M, Hubmann W, Scherer J, Dreikorn B, Hecht S, Sobizack N, Mohr F. A prospective 2-year follow-up study of neurocognitive functioning in patients with first-episode schizophrenia. Eur Arch Psychiatry Clin Neurosci 2002; 252: 262 -7.[CrossRef][Medline]
    28. 28
  28. Bilder RM, Goldman RS, Volavka J, Czobor P, Hoptman M, Sheitman B, Lindenmayer JP, Citrome L, McEvoy J, Kunz M, Chakos M, Cooper TB, Horowitz TL, Lieberman JA. Neurocognitive effect of clozapine, olanzapine, risperidone and haloperidol in patients with chronic schizophrenia or schizoaffective disorder. Am J Psychiatry 2002; 159: 1018 -28.[Abstract/Free Full Text]
    29. 29
  29. Bryson G, Tamasine G. Longitudinal Wisconsin card sorting performance in schizophrenia patients in rehabilitation. Appl Neuropsychol 2002; 4: 203 -9.
    30. 30
  30. Buchanan RW, Holstein C, Breier A. The comparative efficacy and long-term effect of clozapine treatment on neuropsychological test performance. Biol Psychiatry 1994; 36: 717-25.[CrossRef][Medline]
    31. 31
  31. Chua L, Chong SA, Pang SA, Ng VP, Chan YH. The effect of risperidone on cognitive functioning in a sample of Asian patients with schizophrenia in Singapore. Singapore Med J 2001; 42: 243 -6.[Medline]
    32. 32
  32. Cuesta MJ, Peralta V, Zarzuela A. Effects of olanzapine and other antipsychotics on cognitive function in chronic schizophrenia: a longitudinal study. Schizophr Res 2001; 48: 17-28.[CrossRef][Medline]
    33. 33
  33. de Beaurepaire C, de Beaurepaire R, Cleau M, Borenstein P. Bromocriptine improves digit symbol substitution test scores in neuroleptic-treated chronic schizophrenic patients. Eur Psychiatry 1993; 8: 89 -93.
    34. 34
  34. Deutsch SI, Schwartz BL, Rosse RB, Mastropaolo J, Marvel CL, Drapalski AL. Adjuvant topiramate administration: a pharmacological strategy for addressing NMDA receptor hypofunction in schizophrenia. Clin Neuropharmacol 2003; 26: 199 -206.[Medline]
    35. 35
  35. Fields RB, Van Kammen DP, Peters JL, Rosen J, Van Kammen WB, Nugent A, Stipetic M, Linnoila M. Clonidine improves memory function in schizophrenia independently from change in psychosis. Schizophr Res 1988; 1: 417 -23.[CrossRef][Medline]
    36. 36
  36. Fujii DE, Ahmed I, Jokumsen M, Compton JA. The effects of clozapine on cognitive functioning in treatment-resistant schizophrenic patients. J Neuropsychiatry Clin Neurosci 1997; 9: 240-5.[Abstract/Free Full Text]
    37. 37
  37. Gold S, Arndt S, Nopoulos P, O'Leary DS, Andreasen N. Longitudinal study of cognitive function in first-episode and recent-onset schizophrenia. Am J Psychiatry 1999; 156: 1342 -8.[Abstract/Free Full Text]
    38. 38
  38. Goldberg TE, Greenberg RD, Griffin SJ, Gold JM, Kleinman JE, Pickar D, Schulz SC, Weinberger DR. The effect of clozapine on cognition and psychiatric symptoms in patients with schizophrenia. Br J Psychiatry 1993; 162: 43 -8.[Abstract/Free Full Text]
    39. 39
  39. Grawe RW, Levander S. Neuropsychological impairments in patients with schizophrenia: stability and prediction of outcome. Acta Psychiatr Scand 2001; 104: 60-4.[CrossRef]
    40. 40
  40. Green MF, Marder SR, Glynn SM, McGurk SR, Wirshing WC, Wirshing DA, Liberman RP, Mintz J. The neurocognitive effects of low-dose haloperidol: a two-year comparison with risperidone. Biol Psychiatry 2002; 51: 972 -8.[CrossRef][Medline]
    41. 41
  41. Hagger C, Buckley P, Kenny J, Friedman L, Ubogy D, Meltzer HY. Improvement in cognitive functions and psychiatric symptoms in treatment-refractory schizophrenic patients receiving clozapine. Biol Psychiatry 1993; 34: 702-12.[CrossRef][Medline]
    42. 42
  42. Harris MJ, Heaton RK, Schalz A, Bailey A, Patterson TL. Neuroleptic dose reduction in older psychotic patients. Schizophr Res 1997; 27: 241 -8.[CrossRef][Medline]
    43. 43
  43. Harvey PD, Lombardi J, Liebman M, White L, Parella M, Powchik P, Davidson M. Cognitive impairment and negative symptoms in geriatric chronic schizophrenic patients: a follow-up study. Schizophr Res 1996; 22: 223 -31.[CrossRef][Medline]
    44. 44
  44. Harvey PD, Meltzer H, Simpson GM, Potkin SG, Loebel A, Siu C, Romano SJ. Improvement in cognitive function following a switch to ziprasidone from conventional antipsychotics, olanzapine, or risperidone in outpatients with schizophrenia. Schizophr Res 2004; 66: 101-13.[CrossRef][Medline]
    45. 45
  45. Harvey PD, Palmer BW, Heaton RK, Mohamed S, Kennedy J, Brickman A. Stability of cognitive performance in older patients with schizophrenia: an 8-week test-retest study. Am J Psychiatry 2005; 162: 110 -17.[Abstract/Free Full Text]
    46. 46
  46. Hill SK, Schuepbach D, Herbener ES, Keshavan MS, Sweeney JA. Pretreatment and longitudinal studies of neuropsychological deficits in antipsychotic-naïve patients with schizophrenia. Schizophr Res 2004; 68: 49 -63.[CrossRef][Medline]
    47. 47
  47. Hoff AL, Faustman WO, Wieneke M, Espinoza S, Costa M, Wolkowitz O, Csernansky JG. The effects of clozapine on symptom reduction, neurocognitive function, and clinical management in treatment-refractory state hospital schizophrenic inpatients. Neuropsychopharmacology 1996; 15: 361 -9.[CrossRef][Medline]
    48. 48
  48. Hoff AL, Svetina C, Shields G, Stewart J, DeLisi LE. Ten year longitudinal study of neuropsychological functioning subsequent to a first episode of schizophrenia. Schizophr Res 2005; 78: 27 -34.[Medline]
    49. 49
  49. Hughes C, Kumari V, Soni W, Das M, Binneman B, Drozd S, O'Neil S, Mathew V, Sharma T. Longitudinal study of symptoms and cognitive function in chronic schizophrenia. Schizophr Res 2002; 59: 137 -46.
    50. 50
  50. Killian G, Holzman PS, Davis JM, Gibbons R. Effects of psychotic medication on selected cognitive and perceptual measures. J Abnorm Psychol 1984; 1: 58 -70.
    51. 51
  51. Ljubin T, Zakic-Milas D, Mimica N, Folnegovic-Smalc V, Makaric G. A preliminary study of the comparative effects of olanzapine and fluphenazine on cognition in schizophrenic patients. Hum Psychopharmacol 2000; 15: 513-19.[CrossRef][Medline]
    52. 52
  52. Lysaker P, Bell M. Performance on repeated administrations of the Wisconsin Card Sorting Test. J Nerv Ment Dis 1994; 182: 656 -60.[Medline]
    53. 53
  53. Manschreck TC, Redmond DA, Candela SF, Maher BA. Effects of clozapine on psychiatric symptoms, cognition and functional outcome in schizophrenia. J Neuropsychiatry Clin Neurosci 1999; 11: 481 -9.[Abstract/Free Full Text]
    54. 54
  54. McGrath J, Scheldt S, Welham J, Clair A. Performance on tests sensitive to impaired executive ability in schizophrenia and well controls: acute and subacute phases. Schizophr Res 1997; 26: 127 -37.[CrossRef][Medline]
    55. 55
  55. McGurk SR, Moriarty PJ, Harvey PD, Parrella M, White L, Davis KL. The longitudinal relationship of clinical symptoms, cognitive functioning and adaptative life in geriatric schizophrenia. Schizophr Res 2000; 42: 47 -55.[CrossRef][Medline]
    56. 56
  56. McGurk SR, Mueser KT, Harvey PD, LaPuglia R, Marder J. Cognitive and symptom predictors of work outcomes for clients with schizophrenia in supported employment. Psychiatr Serv 2003; 54: 1129 -35.[Abstract/Free Full Text]
    57. 57
  57. Nopoulos P, Flashman L, Flaum M, Arndt S, Andreasen N. Stability of cognitive functioning early in the course of schizophrenia. Schizophr Res 1994; 14: 29-37.[CrossRef][Medline]
    58. 58
  58. Prescott CA, Strauss ME, Tune LE. Test-retest reliability of information-processing measures among chronic schizophrenics. Psychiatry Res 1986; 17: 199 -202.[CrossRef][Medline]
    59. 59
  59. Purdon SE, Labelle A, Boulay L. Neuropsychological change in schizophrenia after 6 weeks of clozapine. Schizophr Res 2001; 48: 57 -67.[CrossRef][Medline]
    60. 60
  60. Rosmark B,Ösby U, Engelbrektson K, Nyman H. Stability of performance on neuropsychological tests in patients with schizophrenia. Eur Arch Psychiatry Clin Neurosci 1999; 249: 299 -304.[CrossRef][Medline]
    61. 61
  61. Rossi A, Mancini F, Stratta P, Mattei P, Gismondi R, Pozzi F, Casacchia M. Risperidone, negative symptoms and cognitive deficit in schizophrenia: an open study. Acta Psychiatr Scand 1997; 95: 40 -3.[Medline]
    62. 62
  62. Rund BR. Distractibility and recall capability in schizophrenics, a 4 year longitudinal study of stability in cognitive performance. Schizophr Res 1989; 2: 265-75.[CrossRef][Medline]
    63. 63
  63. Scottish Schizophrenia Research Group. The Scottish First Episode Schizophrenia Study v. One-year follow-up. Br J Psychiatry 1988; 152: 470 -6.[Abstract/Free Full Text]
    64. 64
  64. Seidman LJ, Pepple JR, Faraone SV, Kremen WS, Cassens G, McCarley RW, Tsuang MT. Wisconsin Card Sorting Test performance over time in schizophrenia, preliminary evidence from clinical follow-up and neuroleptic reduction studies. Schizophr Res 1991; 5: 233-42.[CrossRef][Medline]
    65. 65
  65. Seidman LJ, Pepple JR, Faraone SV, Kremen WS, Green AI, Brown WA, Tsuang MT. Neuropsychological performance in chronic schizophrenia in response to neuroleptic dose reduction. Biol Psychiatry 1993; 33: 575 -84.[CrossRef][Medline]
    66. 66
  66. Sharma T, Hughes C, Soni W, Kumari V. Cognitive effects of olanzapine and clozapine treatment in chronic schizophrenia. Psychopharmacology 2003; 169: 398 -403.[CrossRef][Medline]
    67. 67
  67. Smith TE, Hull JW, Huppert JD, Silverstein SM. Recovery from psychosis in schizophrenia and schizoaffective disorder: symptoms and neurocognitive rate-limiters for the development of social behavior skills. Schizophr Res 2002; 55: 229-37.[CrossRef][Medline]
    68. 68
  68. Stirling J, White C, Lewis S, Hopkins R, Tantam D, Huddy A, Montague L.. Neurocognitive function and outcome in first-episode schizophrenia: a 10-year follow-up of an epidemiological cohort. Schizophr Res 2003; 65: 75-86.[CrossRef][Medline]
    69. 69
  69. Sweeney JA, Hass GL, Kelip JG, Long M. Evaluation of the stability of neuropsychological functioning after acute episodes of schizophrenia: one-year follow-up study. Psychiatry Res 1991; 38: 63 -76.[CrossRef][Medline]
    70. 70
  70. Townsend L, Norman RMG, Malla AK, Rychlo AD, Ahmed RR. Changes in cognitive functioning following comprehensive treatment for first episode patients with schizophrenia spectrum disorder. Psychiatry Res 2002; 113: 69 -81.[CrossRef][Medline]
    71. 71
  71. Van der Gaag M, Kern RS, van den Bosch RJ, Liberman RP. A controlled trial of cognitive remediation in schizophrenia. Schizophr Bull 2002; 28: 167-76.[Abstract/Free Full Text]
    72. 72
  72. Velligan DI, Newcomer J, Pultz J, Csernansky J, Hoff AL, Mahurin R, Miller AL. Does cognitive function improve with quetiapine in comparison to haloperidol. Schizophr Res 2002; 53: 239-48.[CrossRef][Medline]
    73. 73
  73. Verdoux H, Magnin E, Bourgeois M. Neuroleptic effects on neuropsychological test performance in schizophrenia. Schizophr Res 1995; 14: 133 -9.[CrossRef][Medline]
    74. 74
  74. Wölwer W, Gaebel W. Impaired Trail-Making Test–B performance in patients with acute schizophrenia is related to inefficient sequencing of planning and acting. J Psychiatr Res 2002; 36: 407 -16.[CrossRef][Medline]
Received for publication July 20, 2006. Revision received March 1, 2007. Accepted for publication March 30, 2007.


Related articles in BJP:

Highlights of this issue
Kimberlie Dean
BJP 2008 192: A14. [Full Text]  



This article has been cited by other articles:


Home page
 Br. J. PsychiatryHome page
V. Balanza-Martinez, M. J. Cuesta, C. Arango, B. Crespo-Facorro, and R. Tabares-Seisdedos
Longitudinal course of cognition in schizophrenia
The British Journal of Psychiatry, July 1, 2009; 195(1): 84 - 84.
[Full Text] [PDF]

Home page
 Br. J. PsychiatryHome page
A. Szoke, F. Schurhoff, and M. Leboyer
Authors' reply:
The British Journal of Psychiatry, July 1, 2009; 195(1): 85 - 85.
[Full Text] [PDF]

Home page
 Schizophr BullHome page
J. Welham, M. Isohanni, P. Jones, and J. McGrath
The Antecedents of Schizophrenia: A Review of Birth Cohort Studies
Schizophr Bull, May 1, 2009; 35(3): 603 - 623.
[Abstract] [Full Text] [PDF]

eLetters:

Read all eLetters

How long is longitudinal
Ahmed S huda
BJP Online, 25 Apr 2008 [Full text]
Longitudinal course of cognition in schizophrenia - the jury is still out!
Vicent Balanzá-Martínez, et al.
BJP Online, 19 Mar 2009 [Full text]
The jury is still out – waiting for new data not new analyses!
Andrei Szöke, et al.
BJP Online, 17 Apr 2009 [Full text]
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Data supplement
Right arrow Submit an eLetter
Right arrow View responses
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Related articles in BJP
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Szöke, A.
Right arrow Articles by Leboyer, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Szöke, A.
Right arrow Articles by Leboyer, M.