Hostname: page-component-7c8c6479df-nwzlb Total loading time: 0 Render date: 2024-03-28T16:27:53.672Z Has data issue: false hasContentIssue false

Diagnostic stability in a Dutch psychosis incidence cohort

Published online by Cambridge University Press:  02 January 2018

Natalie D. Veen*
Affiliation:
Rudolf Magnus Institute of Neuroscience, Department of Psychiatry, University Medical Centre, Utrecht, The Netherlands
Jean-Paul Selten
Affiliation:
Rudolf Magnus Institute of Neuroscience, Department of Psychiatry, University Medical Centre, Utrecht, The Netherlands
Diede Schols
Affiliation:
Parnassia Psycho Medical Centre, The Hague
Winfried Laan
Affiliation:
Parnassia Psycho Medical Centre, The Hague
Hans W. Hoek
Affiliation:
Parnassia Psycho Medical Centre, The Hague
Ingeborg van der Tweel
Affiliation:
Centre for Biostatistics, Utrecht University
René S. Kahn
Affiliation:
Rudolf Magnus Institute of Neuroscience, Department of Psychiatry, University Medical Centre, Utrecht, The Netherlands
*
Dr Natalie D. Veen, Department of Psychiatry (A 00.241), University Medical Centre Utrecht, PO Box 85500, 3508 GA Utrecht, The Netherlands. Tel: +31 30 250 8180; e-mail: n.veen@psych.azu.nl
Rights & Permissions [Opens in a new window]

Abstract

Background

No study outside the UK has examined the diagnostic stability of psychotic disorders in a population-based sample.

Aims

To determine diagnostic stability in a Dutch population-based psychosis incidence cohort, to examine the frequencies of diagnostic shifts to and from schizophrenic disorders and to report the revised relative risks of schizophrenic disorders for immigrants.

Method

A 30-month follow-up study assessed the cohort (n=181) by means of face-to-face diagnostic interviews.

Results

Diagnostic stability of schizophrenic disorders was high (91%), but lower for other psychotic disorders. At follow-up, the initial diagnosis was adjusted to schizophrenic disorder more often than that the reverse occurred. Almost half (49%) of the patients who were not initially diagnosed as having a schizophrenic disorder received this diagnosis at follow-up. The relative risks for most immigrant groups were stable.

Conclusions

Schizophrenic disorders are underdiagnosed, rather than overdiagnosed, at first presentation.

Type
Papers
Copyright
Copyright © 2004 The Royal College of Psychiatrists 

Although stability of diagnosis over time is an important issue in psychotic disorders, there have been only two studies of population-based samples, both conducted in the UK (Reference Amin, Singh and BrewinAmin et al, 1999; Reference Goater, King and ColeGoater et al, 1999). We therefore conducted a follow-up study in The Netherlands of a population-based incidence cohort recruited in The Hague (Reference Selten, Veen and FellerSelten et al, 2001) and re-diagnosed all cohort members 30 months after their first contact. The primary aim of our study was to report diagnostic stability, defined as the proportion of patients who received a follow-up diagnosis in the same main category as in the incidence study. Second, we examined the frequencies of two particular diagnostic shifts, namely the shift from schizophrenic disorder (DSM–IV categories schizophrenia, schizophreniform or schizoaffective disorder; American Psychiatric Association, 1994) to any other category, and the shift the other way round. Third, we report the revised incidence rates of schizophrenic disorders and the revised relative risks for immigrant groups.

METHOD

Incidence study

Full details of the recruitment of the incidence cohort have been described by Selten et al (Reference Selten, Veen and Feller2001). Briefly, all people aged 15–54 years living in The Hague who consulted a physician for the first time about a (suspected) psychotic disorder during the period April 1997 to April 1999 were referred to the study. Physicians and psychiatrists in the psychiatric hospitals and out-patient clinics were informed repeatedly about the study, as were those working in the prison, the addiction treatment centres and the general hospitals and more than 200 general practitioners. Patients with a substance-induced psychotic disorder were excluded. A resident in psychiatry conducted a diagnostic interview, the Comprehensive Assessment of Symptoms and History (CASH; Reference Andreasen, Flaum and ArndtAndreasen et al, 1992), and a research psychiatric nurse interviewed a key informant for each patient, using the Instrument for the Retrospective Assessment of the Onset of Schizophrenia (IRAOS; Reference Häfner, Riecher-Rössler and HambrechtHäfner et al, 1992). An official interpreter was asked to help in the administration of the CASH or IRAOS, if necessary. Additional information was obtained from the treating physician or retrieved from the patient's medical file. The researchers wrote a history of the patient's illness, omitting any clue to the patient's ethnicity. This history was discussed during a diagnostic meeting, which included the researchers and two psychiatrists. The latter made a DSM–IV diagnosis. The incidence cohort consisted of 181 patients.

Follow-up study

Two and a half years (mean 30.2 months, s.d.=3.7) after the first contact the patients were approached for a repetition of the diagnostic assessments. The resident in psychiatry (N.D.V.) interviewed the patients using a follow-up version of the CASH (CASH–UP; Reference Ho, Nopoulos and FlaumHo et al, 1998) and obtained information from the treating physician and the patient's medical file. The research nurse collected key data from informants using the IRAOS–UP, a modified version of the IRAOS. If necessary, an interpreter assisted in the administration of interviews to participants who were not native Dutch speakers. As in the earlier study, the researchers used all available information to compile a history, omitting the initial diagnosis and the patient's ethnicity. The procedure of the diagnostic meeting was identical to that of the incidence study. J.-P.S. participated in all of the meetings of both the incidence and follow-up studies.

Three members of the original cohort could not be traced, two had died, seven refused to participate in the follow-up study, and one had insufficient information in her medical file. Thus, for 168 participants there was sufficient information available on which to base a diagnosis at the second assessment. For 99 patients information was available from three sources (CASH–UP, IRAOS–UP and the medical file), for 40 patients information was available from CASH–UP and the medical file, for 5 patients information was available from IRAOS–UP and the medical file, and for 24 patients information was available from the medical file and the treating physician. It was not possible to obtain key-informant data for 64 patients; in 25 of these patients this was due to lack of family or friends. There was no association between the number of data sources used and diagnostic stability (χ2-test, P=0.39).

Definition of immigrant groups

Four groups of immigrants were delineated: those from Morocco, Surinam, Turkey and other countries. First-generation (i.e. those not born in The Netherlands) and second-generation (Dutch-born) immigrants were combined into one group. People born in The Netherlands and whose parents were born in The Netherlands are referred to as native Dutch.

Data analysis

Diagnostic stability

Diagnostic stability was defined as the proportion of patients whose diagnosis at follow-up was in the same main category as in the incidence study. Four main categories were delineated:

  1. (a) schizophrenic disorders (including DSM–IV categories schizophrenia, schizophreniform disorder and schizoaffective disorder);

  2. (b) major depressive disorder and bipolar disorder with psychotic features;

  3. (c) other non-organic psychotic disorders (delusional disorder, brief psychotic disorder and psychotic disorder not otherwise specified);

  4. (d) organic psychotic disorders (psychotic disorder due to a general medical condition and substance-induced psychotic disorders).

The diagnostic stabilities of brief psychotic disorders and schizophreniform disorders were evaluated separately.

Diagnostic shift towards and away from schizophrenic disorders

The diagnostic shift away from schizophrenic disorders to any of the other diagnostic main categories was evaluated and compared with the shift in the reverse direction, using McNemar's test for paired proportions. These diagnostic shifts were also evaluated for different sections of the population.

Incidence and relative risks of schizophrenic disorders

To calculate the incidence of schizophrenic disorders and the relative risks for immigrant groups, data were combined for the patients who had received this diagnosis at follow-up (n=125) and for the 8 patients who had received this diagnosis at the initial assessment but could not be assessed in the follow-up. The incidence after exclusion of the 36 patients who were not admitted to hospital early in the course of their disorder was also calculated. For the crude incidence rate, the number of cases was divided by the number of person-years at risk (same denominator as in the incidence study). This rate was standardised by direct standardisation for age and gender to the Dutch population on 1 January 1998. In order to compute 95% confidence intervals a Poisson distribution was assumed (Reference MacMahon and TrichopoulousMacMahon & Trichopoulous, 1996). Age-adjusted relative risks for schizophrenic disorders in immigrant groups, by gender and generation, were computed with Poisson regression analysis using EGRET (Cytel Software, Cambridge, MA, USA).

RESULTS

Diagnostic stability

Table 1 shows the diagnostic stability of the main diagnostic categories. In 120 of 168 patients (71%), the follow-up diagnosis was in the same main category as the diagnosis made during the incidence study. The diagnostic stability of schizophrenic disorders was 91%, compared with 67% for psychotic mood disorders and 30% for other non-organic psychotic disorder. As for specific diagnostic categories, the diagnosis of brief psychotic disorder (DSM–IV code 298.8) was stable in 5 of 13 patients (38%). At follow-up, 6 of the 13 patients were given a diagnosis of schizophrenic disorder and 2 a psychotic disorder not otherwise specified. The diagnosis schizophreniform disorder (DSM–IV 295.40) was stable in 5 of 29 patients (17%). As expected, most of the 29 patients (n=19; 65.5%) received the diagnosis schizophrenia or schizoaffective disorder at follow-up and thus remained within the main category of schizophrenic disorders. Four of the 29 were diagnosed with psychotic disorder not otherwise specified and one was diagnosed with amphetamine-induced psychotic disorder.

Table 1 Stability of diagnosis across 30-month interval

Diagnosis at incidence study Diagnosis at follow-up study
Schizophrenic disorder1 n Psychotic mood disorder2 n Other non-organic psychotic disorder3 n Organic psychotic disorder4 n Total n
Schizophrenic disorder1 92 2 6 1 101
Psychotic mood disorder2 5 14 1 1 21
Other non-organic psychotic disorder3 28 1 14 3 46
Total 125 17 21 5 168

Diagnostic shifts towards and away from schizophrenic disorders

In Table 2 the diagnostic shifts to and from schizophrenic disorders is shown for the native Dutch and immigrant groups. Of the 67 patients who were initially not diagnosed with a schizophrenic disorder about half (n=33) received this diagnosis at the follow-up assessment. The diagnostic shift from any other diagnosis to the main category of schizophrenic disorders occurred significantly more often than the shift from schizophrenic disorders to any other diagnosis (33 v. 9 patients; McNemar's test Z=12.6, P<0.001). In all sections of the population there was an increase in schizophrenic disorders, except in the Surinamese group, where the diagnostic shift to and from schizophrenic disorder was the same (n=3 each way). For Turkish immigrants the increase was especially marked, with the diagnosis of 6 of 10 patients being changed to a schizophrenic disorder at follow-up and none of the previous diagnoses of schizophrenic disorder being changed to another diagnosis. Owing to the small size of the groups, it was not appropriate to test for differences between the groups.

Table 2 Shifts from and to the diagnosis of schizophrenic disorder after 30 months' follow-up, categorised by immigrant group

Diagnostic shift Origin of population
Native Dutch2 n Moroccan3 n Surinamese3 n Turkish3 n Other3 n Total n
Shift to schizophrenic disorder1 9 7 3 6 8 33
Shift away from schizophrenic disorder1 3 2 3 0 1 9
Stable diagnosis 52 19 22 4 29 126
Total 64 28 28 10 38 168

Incidence rates of schizophrenic disorders

The revised crude annual incidence rate of schizophrenic disorders in The Hague was 2.6 (95% CI 1.8–3.7) per 10 000. The difference between the crude and the standardised incidence rates was minimal. The annual crude incidence rate after exclusion of the 36 patients who were not hospitallised early in the course of their disorder was 1.9 (95% CI 1.5–2.3) per 10 000.

Relative risks for immigrant groups

Table 3 shows the (5-year) age-adjusted relative risks for schizophrenic disorders in immigrant groups, by gender and generation. For almost all groups there was little difference from the risks reported in our earlier study. An exception is the revised relative risk for Turkish-born men, which was found to be significantly increased.

Table 3 Age-adjusted relative risks of schizophrenic disorder for immigrant group, diagnosed after 30 months' follow-up, by gender

Males Females
Relative risk (95% CI) Relative risk (95% CI)
First generation, aged 15–54 years
    Native Dutch1 1.0 1.0
    Surinamese 2.3 (1.2–4.6) 4.1 (1.6–10.9)
    Dutch Antillean 4.8 (1.7–13.6) NA
    Turkish 2.5 (1.2–5.5) 1.2 (0.1–9.2)
    Moroccan 6.3 (3.4–1.6) 1.6 (0.2–12.9)
    Other (Western or Westernised)2 0.7 (0.2–3.1) 3.4 (0.9–12.3)
    Other (non-Western)3 1.8 (0.8–3.9) 4.5 (1.6–12.5)
Second generation, aged 15–29 years
    Native Dutch1 1.0 1.0
    Surinamese 3.0 (1.1–8.3) 11.2 (2.9–43.2)
    Dutch Antillean NA NA
    Turkish NA NA
    Moroccan 10.9 (3.8–31.0) 10.8 (1.2–97.3)
    Other 1.9 (0.8–4.7) NA

DISCUSSION

This study showed a high diagnostic stability for the main category of schizophrenic disorders. Furthermore, almost half of the patients in this cohort who were initially not diagnosed as having a schizophrenic disorder were found to have this disorder at follow-up. There were only minor changes in the relative risks for immigrant groups.

Interpretation of diagnostic shifts

There are different sources of diagnostic instability, which include subject variance (true changes in the patient), information variance (e.g. more information available at the follow-up assessment), observation variance (different interpretations of same stimuli) and criterion variance (e.g. two observers use different criteria for diagnosing a delusion) (Reference Spitzer, Endicott and RobinsSpitzer et al, 1975). In order to reduce observation and criterion variance, we used similar diagnostic instruments at both assessments, the same procedures at the diagnostic meetings and the same criteria for classification. However, a limitation of the study was that the diagnosticians at the follow-up assessment were not masked to the purpose of the study. Most ‘new’ cases of schizophrenic disorder at follow-up had received the diagnosis ‘psychotic disorder not otherwise specified’ at baseline, a diagnosis that was often made because the information was insufficient for a specific diagnosis. Consequently, a likely explanation for many diagnostic shifts is that the patient (or a relative) disclosed more information pertinent to the schizophrenia syndrome after the initial assessment. This might also explain the relatively high rates of diagnostic shift to schizophrenic disorder for Turkish and Moroccan immigrants. At the initial assessment the researchers sometimes had difficulties in gathering sufficient information from those who did not speak Dutch.

A second explanation for diagnostic changes is that they were necessitated by true changes in the clinical picture. One patient, for example, was initially diagnosed with a bipolar disorder on account of a depressive and a manic episode with mood-congruent psychotic symptoms. During the follow-up period, however, his mood was normal but he suffered from acoustic hallucinations and negative symptoms.

Implications

One clinical implication of this study is that the use of an extensive diagnostic protocol makes it possible to diagnose schizophrenic disorders reliably at their first presentation. This is important because early treatment and psycho-education of patients and their families may improve the course of the disorder (Reference Lieberman and FentonLieberman & Fenton, 2000; Reference Malla, Norman and MachandaMalla et al, 2002). Moreover, physicians should be aware that even if a patient with a first episode of psychosis is diagnosed as having a disorder other than a schizophrenic disorder, there is a distinct possibility that this diagnosis will be adjusted to a schizophrenic disorder at a later date. It is therefore important that these patients are not lost from sight.

There are also implications for research. First, studies on risk factors and course of schizophrenic disorders should include all patients with a first psychotic episode and not only those initially given a diagnosis of schizophrenic disorder. Second, first-contact rates constitute an underestimation of the true incidence rates. The revised annual incidence rate of schizophrenic disorders was 2.6 per 10 000, compared with 2.1 (95% CI 1.7–2.5) per 10 000 obtained in the incidence study. The changes in relative risks for immigrant groups were small.

Comparison with earlier reports

We replicated the main results of the Nottingham study. Amin et al (Reference Amin, Singh and Brewin1999) and Harrison et al (Reference Harrison, Amin and Singh1999) used similar methods and found a diagnostic stability of 83% for DSM–III–R schizophrenia after 3 years, with no significant differences between natives and immigrants from the Caribbean. Goater et al (Reference Goater, King and Cole1999) carried out similar research in London and also reported no significant association between ethnicity and diagnostic stability. Other studies in this field included only hospitalised patients, and none compared natives with immigrants (e.g. Reference Tsuang, Woolson and WinokurTsuang et al, 1981; Reference Fennig, Kovasznay and RichFennig et al, 1994; Reference Rabinowitz, Slyuzberg and RitsnerRabinowitz et al, 1994; Reference Chen, Swann and BurtChen et al, 1996; Reference Schwartz, Fennig and Tanenberg-KarantSchwartz et al, 2000; Reference Forrester, Owens and JohnstoneForrester et al, 2001).

Strengths of the study

The strengths of this study lie in its population-based design and the extensive diagnostic procedures, including direct patient interviews and direct key-informant interviews at initial and follow-up evaluations. The cohort was large, and enough information was available to enable a reliable follow-up diagnosis to be made for 93% of the original cohort. Finally, the diagnosis was made by psychiatrists who were masked to ethnicity and the previous diagnosis.

In conclusion, the study's findings indicate that at first presentation, underdiagnosis of schizophrenic disorders is more frequent than overdiagnosis.

Clinical Implications and Limitations

CLINICAL IMPLICATIONS

  1. The stability of the diagnosis of schizophrenic disorder is high when a detailed diagnostic protocol is used.

  2. Underdiagnosis of schizophrenic disorders at first contact is more frequent than overdiagnosis.

  3. The incidence of schizophrenic disorders among some immigrant groups to The Netherlands is greater than in the native Dutch population.

LIMITATIONS

  1. At follow-up a face-to-face diagnostic interview was administered to only 139 of the original cohort of 181 patients (77%).

  2. In 13 cases (7%) there was insufficient information for a diagnosis at follow-up.

  3. The diagnostic stability of substance-induced psychotic disorders could not be examined, because this diagnosis was an exclusion criterion in the incidence study.

Acknowledgements

We thank Wilma Feller, psychiatric nurse, and Jan-Dirk Blom, psychiatrist, for their cooperation with this study.

Footnotes

Declaration of interest

None.

References

American Psychiatric Association (1994) Diagnostic and Statistical Manual of Mental Disorders (4th edn) (DSM-IV). Washington, DC: APA.Google Scholar
Amin, S., Singh, S. P., Brewin, J., et al (1999) Diagnostic stability of first-episode psychosis. Comparison of ICD-10 and DSM-III-R systems. British Journal of Psychiatry, 175, 537543.CrossRefGoogle ScholarPubMed
Andreasen, N., Flaum, M. & Arndt, S. (1992) The Comprehensive Assessment of Symptoms and History (CASH): an instrument for assessing psychopathology and diagnosis. Archives of General Psychiatry, 49, 615623.CrossRefGoogle Scholar
Chen, Y. R., Swann, A. C. & Burt, D. B. (1996) Stability of diagnosis in schizophrenia. American Journal of Psychiatry, 153, 682686.Google ScholarPubMed
Fennig, S., Kovasznay, B., Rich, C., et al (1994) Six-month stability of psychiatric diagnoses in first-admission patients with psychosis. American Journal of Psychiatry, 151, 12001208.Google ScholarPubMed
Forrester, A., Owens, D. G. & Johnstone, E. C. (2001) Diagnostic stability in subjects with multiple admissions for psychotic illness. Psychological Medicine, 31, 151158.CrossRefGoogle ScholarPubMed
Goater, N., King, M., Cole, E., et al (1999) Ethnicity and outcome of psychosis. British Journal of Psychiatry, 175, 3442.CrossRefGoogle ScholarPubMed
Häfner, H., Riecher-Rössler, A., Hambrecht, M., et al (1992) IRAOS: an instrument for the assessment of onset and early course of schizophrenia. Schizophrenia Research, 6, 209223.CrossRefGoogle ScholarPubMed
Harrison, G., Amin, S., Singh, S. P., et al (1999) Outcome of psychosis in people of African–Caribbean family origin. Population-based first-episode study. British Journal of Psychiatry, 175, 4349.CrossRefGoogle ScholarPubMed
Ho, B. C., Nopoulos, P., Flaum, M., et al (1998) Two-year outcome in first-episode schizophrenia: predictive value of symptoms for quality of life. American Journal of Psychiatry, 155, 11961201.CrossRefGoogle ScholarPubMed
Lieberman, J. A. & Fenton, W. S. (2000) Delayed detection of psychosis: causes, consequences, and effect on public health (editorial). American Journal of Psychiatry, 157, 17271730.CrossRefGoogle Scholar
MacMahon, B. & Trichopoulous, D. (1996) Epidemiology. Principles and Method, pp. 202203. Boston, MA; Little, Brown.Google Scholar
Malla, A. K., Norman, R. M. G., Machanda, R., et al (2002) One year outcome in first episode psychosis: influence of DUP and other predictors. Schizophrenia Research, 54, 231242.CrossRefGoogle ScholarPubMed
Rabinowitz, J., Slyuzberg, M., Ritsner, M., et al (1994) Changes in diagnosis in a 9-year longitudinal sample. Comprehensive Psychiatry, 35, 361365.CrossRefGoogle Scholar
Schwartz, J. E., Fennig, S., Tanenberg-Karant, M., et al (2000) Congruence of diagnoses 2 years after a first-admission diagnosis of psychosis. Archives of General Psychiatry, 57, 593600.CrossRefGoogle ScholarPubMed
Selten, J. P., Veen, N., Feller, W., et al (2001) Incidence of psychotic disorders in immigrant groups to The Netherlands. British Journal of Psychiatry, 178, 367372.CrossRefGoogle ScholarPubMed
Spitzer, R. L., Endicott, J. & Robins, E. (1975) Clinical criteria for psychiatric diagnosis and DSM-III. American Journal of Psychiatry, 132, 11871192.Google ScholarPubMed
Tsuang, M. T., Woolson, R. F., Winokur, G., et al (1981) Stability of psychiatric diagnosis. Schizophrenia and affective disorders followed up over a 30- to 40-year period. Archives of General Psychiatry, 38, 535539.CrossRefGoogle Scholar
Figure 0

Table 1 Stability of diagnosis across 30-month interval

Figure 1

Table 2 Shifts from and to the diagnosis of schizophrenic disorder after 30 months' follow-up, categorised by immigrant group

Figure 2

Table 3 Age-adjusted relative risks of schizophrenic disorder for immigrant group, diagnosed after 30 months' follow-up, by gender

Submit a response

eLetters

No eLetters have been published for this article.