Hostname: page-component-7c8c6479df-r7xzm Total loading time: 0 Render date: 2024-03-29T05:31:48.097Z Has data issue: false hasContentIssue false

Dropping out of care: inappropriate terminations of contact with community-based psychiatric services

Published online by Cambridge University Press:  02 January 2018

Alberto Rossi*
Affiliation:
Department of Medicine and Public Health, Section of Psychiatry, University of Verona, Italy
Francesco Amaddeo
Affiliation:
Department of Medicine and Public Health, Section of Psychiatry, University of Verona, Italy
Giulia Bisoffi
Affiliation:
Department of Medicine and Public Health, Section of Psychiatry, University of Verona, Italy
Mirella Ruggeri
Affiliation:
Department of Medicine and Public Health, Section of Psychiatry, University of Verona, Italy
Graham Thornicroft
Affiliation:
Health Services Research Department, Institute of Psychiatry, King's College London, UK
Michele Tansella
Affiliation:
Department of Medicine and Public Health, Section of Psychiatry, University of Verona, Italy
*
Dr Alberto Rossi, Department of Medicine and Public Health, Section of Psychiatry, Ospedale Policlinico, Piazzale L.A. Scuro 10, 37134 Verona, Italy
Rights & Permissions [Opens in a new window]

Abstract

Background

Few studies have investigated factors which predict inappropriate terminations (drop-out) of clinical contact with mental health services.

Aims

To identify patient and treatment characteristics associated with dropping out of contact with community-based psychiatric services (CPS).

Method

A 3-month cohort of patients attending the CPS was followed up for 2 years, to identify drop-outs.

Results

We identified 495 patients who had had at least one psychiatric contact of whom 261 had complete ratings for the Global Assessment of Functioning and the Verona Service Satisfaction Scale. In the year after the index contact, 70 terminated contact with the CPS; of these, 44 were rated as having inappropriate terminations (the ‘drop-out’ group) and 26 had appropriate terminations of contact. Drop-outs were younger, less likely to be married and their previous length of contact with services was shorter. No drop-outs had a diagnosis of schizophrenia. Multivariate analysis revealed predictors of dropping out.

Conclusions

In a CPS targeted to patients with severe mental illnesses, those who drop out of care are younger patients without psychoses who are generally satisfied with their treatment.

Type
Papers
Copyright
Copyright © Royal College of Psychiatrists, 2002 

It is reasonable to assume that an episode of care should usually end when an episode of illness finishes. When these two end-points do not coincide, we need to understand why there has been an end to a period of treatment, although the illness has not yet been resolved. To clarify this, it is necessary first to define both types of episode and then to operationalise such definitions.

An ‘episode of care’ can be simply defined as the time interval between a first service contact for a mental health problem and a ‘last’ contact with the services. The most useful definition of last contact in the field of mental health care, which has been tested using case register data, is ‘a contact, after which there is a gap of 90 days or more without any further contact’ (Reference Tansella, Micciolo and BiggeriTansella et al, 1995). This has been applied to the end of a single episode of care, but may not be a sufficiently long period of time without contact to establish that treatment has truly been terminated. By contrast, in this paper we define an ‘illness episode’ as ‘the time interval between the onset or recurrence of a mental health problem and its resolution or remission’.

This perspective can be developed by considering the nature of terminations to service contact, where these can be seen as either appropriate or inappropriate. By ‘appropriate terminations’ of contact, we mean those which occur when a clinical resolution or remission has taken place, or those cases when, for some other reason, staff and patient agree that treatment should be stopped. Inappropriate terminations are those which occur when there has not been a clinical resolution or an agreed termination, and they are referred to, in this paper, as ‘drop-out cases’. They are identified after excluding those patients who died or moved away from the local catchment area.

Previous research has shown that socio-demographic factors, such as age, marital status and living situation, may be important to predict such drop-outs (Reference TrepkaTrepka, 1986; Reference Tehrani, Krussel and BorgTehrani et al, 1996; Reference Young, Grusky and JordanYoung et al, 2000). Other predictors of dropping out identified previously are: clinical setting, patient satisfaction (Reference PekarikPekarik, 1983; Reference Tehrani, Krussel and BorgTehrani et al, 1996; Reference Young, Grusky and JordanYoung et al, 2000) and severity of clinical status (Reference RobinRobin, 1976).

Although it has been estimated, for example, that between 26% and 40% of patients may inappropriately leave out-patient follow-up care in a 1-year period (Reference PekarikPekarik, 1983; Reference Tehrani, Krussel and BorgTehrani et al, 1996; Reference Young, Grusky and JordanYoung et al, 2000) and that this event is considered as an indicator of low quality of care (Reference GrassiGrassi, 2000), until now, no studies have investigated those dropping out of care from an integrated community mental health service which aims to optimise continuity of care (Reference Thornicroft and TansellaThornicroft & Tansella, 1999), nor have any used a comprehensive catchment area case register to ascertain cases and to evaluate their patterns of care.

The aim of this study is to identify patient and treatment characteristics associated with the likelihood of dropping out of contact with local community-based psychiatric services, so that services can identify the measures necessary to reduce inappropriate terminations of clinical contact.

METHOD

Setting

The study was conducted in South Verona (about 75 000 inhabitants), an area that includes part of the city of Verona and two small neighbouring towns. The main agency providing psychiatric care for the adult population is the South Verona Community Psychiatric Service (CPS), which is run by the Section of Psychiatry, Department of Medicine and Public Health, University of Verona.

The CPS supplies a wide range of well-integrated hospital and community services. With the exception of hospital nurses, all staff work both within and outside the hospital. This ensures continuity of care through the different phases of treatment and across the various components of service provision (Reference Sytema, Micciolo and TansellaSytema et al, 1997). Two private in-patient units (with a total of 220 beds), an out-patient service for children and adolescents, an out-patient service for those with addictions and a small number of general hospital neurological wards also provide psychiatric care to the residents in the Province of Verona, a wider area that includes South Verona (Reference Tansella, Amaddeo, Burti, Goldberg and ThornicroftTansella et al, 1998).

The South Verona Psychiatric Case Register

The South Verona Psychiatric Case Register (PCR), which began in 1979, records socio-demographic characteristics, past psychiatric and medical history, clinical data, and contacts with psychiatrists, psychologists, social workers and psychiatric nurses. The PCR collects information not only from the South Verona CPS but also from all public and private psychiatric services of the Province of Verona. Contacts with general practitioners (GPs), psychiatrists and psychologists in private practice are not reported to the PCR. Each attendance at an out-patient clinic and each home visit is counted as a contact. The PCR also routinely records details of patients who leave the catchment area and those who die. Estimates of time spent for each out-patient contact and each domiciliary visit are routinely recorded by the professionals providing care (Reference Tansella, Amaddeo, Burti, Goldberg and ThornicroftTansella et al, 1998), as are the types and numbers of professionals involved. This information forms the basis for calculating costs of specialist mental health care (Reference Amaddeo, Beecham and BonizzatoAmaddeo et al, 1997).

Patients

This study is part of the South Verona Outcome Project, in which cross-sectional standardised assessments of patients in contact with the South Verona CPS have been made each year since 1994. Both first-ever patients and patients already in contact with the service are assessed, using several outcome measures, but in this study we report only the use of the Global Assessment of Functioning Scale (GAF) and the Verona Service Satisfaction Scale (VSSS) for all those seen by a psychiatrist or a psychologist. The Outcome Project study excludes contacts which take place in the casualty department or in the liaison psychiatry department because of logistical difficulties in assessing patients in these settings. Full details of the design of the Outcome Project are given in Ruggeri et al (Reference Ruggeri, Biggeri and Rucci1998).

The official Italian versions of GAF and VSSS were used. The GAF is a measure of individual well-being in the previous month on a continuous scale, where 0 denotes extremely severe dysfunction and 90 extremely good function (Reference Endicott, Spitzer and FleissEndicott et al, 1976). The VSSS consists of 54 items covering 7 dimensions of the patient's experience of mental health services in the previous year: overall satisfaction, the skills and behaviour of professionals, information, access, efficacy, type of intervention and involvement of relatives items are rated on a 5-point Likert scale (1=terrible; 5=excellent) (Reference Ruggeri and Dall'AgnolaRuggeri & Dall'Agnola, 1993; Reference Ruggeri, Dall'Agnola and AgostiniRuggeri et al, 1994).

All key professionals were trained in the correct use of these standardised instruments. Interrater reliability for GAF scores was assessed during the project and was always higher than 0.70 (intraclass correlation coefficient). If necessary, the research team helped the patients to complete the VSSS and assessed their understanding of items and coherence of assessments; confidentiality was fully preserved. The test-retest reliability and the validity of the VSSS have been assessed previously and proved to be good (Reference Ruggeri and Dall'AgnolaRuggeri & Dall'Agnola, 1993; Reference Ruggeri, Leese and ThornicroftRuggeri et al, 2000).

This study includes all first-ever and all previously treated patients who were seen in the cross-sectional assessment period between October and December 1994, and for whom both GAF and VSSS were completed. Using the PCR, each patient was followed-up for 2 years after his/her first contact during the 3-month assessment period. Patients who died or moved away from the catchment area during the first year after the index contact were excluded from the study.

Drop-out patients were defined as those who (a) had a period without psychiatric contacts lasting at least 365 consecutive days, either immediately after the index contact or after further occasional contacts occurring in the following year and (b) those whose termination of treatment was not rated as appropriate.

To rate appropriateness of termination of contact, we considered the reason. This was independently assessed from the case notes of the last recorded contact and rated by a psychiatrist. From these case records, a rating was made for each patient in the following categories who terminated contact: (a) clinical resolution of the episode, (b) termination agreed between patient and clinician for other reasons, (c) termination not agreed, or (d) referral to the GP. When the reason for termination of contact could not be assessed from the case notes, the psychiatrist used the case notes to make a GAF rating of the overall functional level of each patient during the month preceding the date of the last recorded contact. This rating was blind to all previous GAF ratings and to the status of the patient in terms of contact termination. This retrospective method of rating the GAF from case records has been shown to be highly reliable (Reference Mirandola, Baldassari and BeneduceMirandola et al, 2000).

Using the information gathered in the steps outlined above, an appropriate termination of contact with services was defined as applying to: (i) those patients for whom the recorded reason of termination referred to categories (a), (b) or (d) above or (ii) those patients in which the clinical condition at termination showed only a minor degree of disability/symptom severity, as shown by a GAF score of 70, for the month preceding the date of termination of contact, indicating only a mild degree of disability.

Measures used

For each patient, the following data were collected in relation to the index contact.

  1. (a) Socio-demographic and diagnostic information (ICD-10 clinical descriptions, case register diagnosis; World Health Organization, 1992), which is reported in the following groups: schizophrenia and related disorders, affective disorders, anxiety-related and somatoform disorders, personality disorders and other disorders.

  2. (b) Presence of severe mental illness, defined using the criteria in Ruggeri et al (Reference Ruggeri, Leese and Thornicroft2000): (a) GAF score ≤ 50 and (b) over 2 years of contact with mental health services.

  3. (c) Length of contact with services, before entry into the study.

  4. (d) GAF score at entry into the study.

  5. (e) VSSS score at entry into the study.

  6. (f) Psychiatric care received in the 365 days before entry into the study (date on which the GAF and VSSS were rated): admitted or not admitted to hospital, number of day care contacts, number of out-patient contacts, number of domiciliary visits (data from the PCR).

  7. (g) Direct costs in the year preceding entry into the study. Costs were attached to each service contact recorded on the PCR so as to give the best local estimates of long-run marginal opportunity costs. Direct costs included are those concerning contacts with public and private specialist mental health services; costs of care provided by GPs, private psychiatrists and psychologists, and medication payments by patients were excluded. As we decided to use the most recent and more comprehensive list of unit costs, costs are expressed in Italian lire at 1999 price levels. All indirect costs were excluded from this study. The cost of out-patient contacts was calculated by taking the cost of a working minute for the different professionals (psychiatrists, psychologists, social workers, nurses, etc.) and multiplying this value by the estimated time spent in each contact. For the in-patient services, the cost per day was calculated, and for the rehabilitation groups and day care, an estimate was made of the cost per contact (taking into account the contact duration). The costs of private in-patient clinics were based on the prices paid by the Italian National Health Service. The support and treatment services listed here are mainly delivered, coordinated and funded by the public sector health service. Full details on the preparation of the unit cost list and the cost calculation have been reported elsewhere (Amaddeo et al, Reference Amaddeo, Beecham and Bonizzato1997, Reference Amaddeo, Beecham and Bonizzato1998).

Statistical analysis

The probability of being a drop-out was assessed by logistical regression. Since the study only included subjects (‘respondents’) for whom complete GAF and VSSS data were available, weights were applied to make the sample representative of all the eligible patients (patients who had been seen in the cross-sectional assessment in October—December 1994). The dependent variable was patient status (drop-out or not drop-out). The independent variables were: socio-demographic characteristics (gender, age, marital status, living situation, education and employment status); clinical characteristics (diagnosis and whether the patient had a severe mental illness or not); length of contact with services before entry into the study; service utilisation characteristics of the patients in the year preceding entry into the study (days of admission to hospital, days of contact with day care, number of contacts with out-patients or domiciliary care and total service costs in the previous year); patient overall functioning at entry into the study as rated by GAF score; and patient satisfaction characteristics at entry into the study, as rated by the VSSS total score and the scores in the seven VSSS dimensions.

Weights for non-response were proportional to the inverse probability of responding, estimated from a logistical regression on the whole group of eligible patients. The weights are greater for respondents with a lower response probability, who are therefore underrepresented in the analysed sample (Reference Iannacchione, Milne and FolsomIannacchione et al, 1991). The independent variables were socio-demographic and clinical information available both for respondents and non-respondents, and the dependent variable was the response status. A ‘missing at random’ mechanism for non-response is assumed, given the characteristics included in the logistical regression model (Reference Brick and KaltonBrick & Kalton, 1996). All statistical analyses were performed using STATA Release 7.0 (STATA Corporation, 2000).

RESULTS

A total of 495 patients were identified as having had at least one contact with a psychiatrist or a psychologist between October and December 1994. This 3-month cohort can be considered as representative of all patients who receive care locally from our community-based mental health service. Of those, 354 completed GAF and 261 completed both GAF and VSSS. Table 1 shows the number of patients who, in the 365 days after the index contact: moved away from the South Verona area (n=8), died (n=4), terminated contact with the South Verona CPS (n=70) and were still in contact (n=179). Of the 70 patients who terminated contact with services, 44 (17% of those who completed both the GAF and the VSSS) were rated as having in-appropriate terminations (and are therefore defined as the drop-out group) and 26 were rated as having appropriate terminations.

Table 1 Patient selection (of which first-ever patients are shown in parentheses)

Patients Died Moved away Terminated contact1,2 Remained in contact1
n % n % n % n %
All (n=495) 8 1.6 14 2.8 161 (35) 32.5 312 (17) 63
GAF (n=354) 6 1.7 10 2.8 106 (17) 29.9 232 (9) 65.5
GAF+VSSS (n=261) 4 1.5 8 3.1 70 (4)3 26.8 179 (4) 68.6

Table 2 presents the comparison of socio-demographic, clinical and psychiatric history data between drop-out and other patients (univariate analysis). Significant demographic and clinical differences were found between patients who remained in treatment and the drop-out group. Compared with the other patients, drop-outs were younger (F=4.88, P=0.002), and were less likely to be married, (F=3.32, P=0.037). The length of contact with services before entry into the study was greater for patients who remained in contact (F=7.72, P=0.0005). No significant differences between groups were found for gender, living condition, educational level or employment status. There were significant differences between groups for diagnosis (F=5.58, P=0.0002). Compared with drop-outs, patients who stayed in care were more likely to have severe mental illnesses and less likely to suffer from anxiety and somatoform disorders. Of the 44 patients who left care inappropriately, none had schizophrenia and only 4 were classified as having severe mental illness.

Table 2 Socio-demographic, clinical and psychiatric history data for drop-out patients and patients remaining in contact who have complete Global Assessment of Functioning Scale (GAF) and Verona Service Satisfaction Scale (VSSS) scores (percentage of weighted data in parentheses)

Drop-out patients Patients remaining in contact F 1 P
n % n %
Gender
Male 15 34.1 (39.0) 61 34.1 (38.1) 0.01 0.919
Female 29 65.9 (61.0) 118 65.9 (61.9)
Age (years)
14-24 8 18.1 (17.9) 7 3.9 (4.4) 4.88 0.002
25-44 22 50.0 (52.1) 69 38.5 (41.1)
45-64 8 18.1 (18.5) 74 41.3 (40.1)
> 65 6 13.6 (11.5) 29 16.2 (14.3)
Marital status
Married 19 43.1 (39.8) 72 40.7 (38.8) 3.32 0.037
Unmarried 22 50.0 (53.8) 62 35.0 (38.7)
Widowed/separated/divorced 3 6.8 (6.4) 43 24.3 (22.4)
Living condition
Alone/other 4 9.1 (7.8) 25 15.4 (14.2) 1.43 0.233
With family 40 90.9 (92.2) 137 84.6 (85.8)
Educational level
Up to primary 16 37.2 (37.0) 66 42.3 (43.3) 0.25 0.778
Secondary 17 39.5 (37.5) 56 35.9 (34.7)
Diploma/graduate 10 23.3 (25.5) 34 21.8 (22.3)
Working status
Employed 20 46.5 (43.4) 52 31.7 (32.0) 0.95 0.386
Unemployed 4 9.3 (11.7) 26 15.8 (17.2)
Other 19 44.1 (44.9) 86 52.4 (50.8)
Diagnostic group
Schizophrenia 0 0.0 (0) 46 25.7 (28.6) 5.58 < 0.001
Affective disorders 15 34.1 (29.6) 69 38.5 (33.6)
Anxiety and somatoform disorders 14 31.8 (30.1) 26 14.5 (13.7)
Personality disorders 6 13.6 (13.3) 20 11.1 (10.8)
Other 9 20.4 (27.0) 18 10.1 (13.4)
Severe mental illness
Yes 4 9.1 (10.4) 40 22.3 (22.9) 2.82 0.095
No 40 90.9 (89.6) 139 77.7 (77.1)
Length of contact (years)
< 2 18 40.9 (37.9) 33 18.4 (18.4) 7.72 < 0.001
3-4 8 18.2 (18.4) 12 6.7 (6.9)
> 4 18 40.9 (43.7) 134 74.9 (74.7)

Table 3 shows the comparison of GAF and VSSS scores between drop-out patients and patients remaining in contact. Since there were no patients with a diagnosis of schizophrenia among the drop-outs, we divided those who remained in care into those suffering from schizophrenia and those who were not. Using a one-way analysis of variance (ANOVA), significant differences between these three groups were found for mean GAF scores (F=6.39, P=0.0002). Patients with schizophrenia remaining in contact had a lower mean score (52.5), whereas those without schizophrenia and drop-out patients had similar mean scores (62.1 v. 62.5). These differences are also clinically relevant because in the GAF, the range score from 50 to 60 is used to describe a moderate-to-severe level of impairment of symptoms and functioning, and the range from 60 to 70 is used to describe a mild-to-moderate level. For the VSSS total score and sub-scale scores, a trend was found only for lower satisfaction scores in drop-out patients.

Table 3 Comparisons of Global Assessment of Functioning (GAF) scale and Verona Service Satisfaction Scale (VSSS) scores between drop-out patients and patients remaining in contact who have complete GAF and VSSS scores (one-way analysis of variance weighted data)

Drop-out patients (n=44) Patients remaining in contact (n=179) F P
Mean Median 95% CI Patients without schizophrenia (n=133) Patients with schizophrenia (n=46)
Mean Median 95% CI Mean Median 95% CI
GAF 62.5 65 58.0-67.1 62.1 64 59.4-64.8 52.5 54 47.7-57.3 6.39 0.002
VSSS sub-scales
Satisfaction with:
Professionals' skills and behaviour 4.1 4.2 4.0-4.3 4.2 4.4 4.1-4.3 4.2 4.3 4.0-4.3 0.38 0.687
Information 3.6 4.0 3.4-3.9 3.7 3.7 3.6-3.9 3.8 4.0 3.5-4.0 0.29 0.751
Access 3.6 4.0 3.3-3.8 3.6 4.0 3.5-3.8 3.8 4.0 3.5-4.0 0.61 0.546
Efficacy 3.8 4.0 3.5-4.1 4.0 4.1 3.8-4.1 3.8 3.8 3.6-4.0 0.77 0.464
Involvement of the relatives 3.5 3.5 3.2-3.8 3.7 4.0 3.5-3.9 3.8 3.8 3.4-4.1 0.82 0.444
Type of intervention 3.8 3.9 3.7-3.9 3.7 3.8 3.6-3.8 3.8 3.8 3.7-3.9 1.10 0.334
Overall satisfaction 4.0 4.3 3.8-4.3 4.3 4.3 4.1-4.4 4.2 4.3 4.0-4.4 0.77 0.464
VSSS total score 3.9 3.9 3.7-4.0 3.9 4.1 3.8-4.0 3.9 3.8 3.8-4.1 0.28 0.754

Table 4 compares service utilisation during the previous year by drop-out patients, patients without schizophrenia who remained in care and those with schizophrenia who remained in care (excluding first-ever patients who, by definition, had received no contact in the previous year).

Table 4 Comparisons of service use during the previous year between drop-out patients and patients remaining in contact who have complete Global Assessment of Functioning (GAF) scale and Verona Service Satisfaction Scale (VSSS) scores. The values refer only to patients with at least one contact for each type of care (weighted data)

Drop-out patients (n=44) Patients remaining in contact (n=179)
n Mean Median Range Patients without schizophrenia (n=133) Patients with schizophrenia (n=46)
n Mean Median Range n Mean Median Range
In-patient care (days) 2 13.0 12 1-23 28 30.9 26 1-208 11 46.9 28 8-223
Day care (days) 3 6.8 3 1-26 51 50.6 19 1-431 31 63.1 33 1-398
Out-patient care (contacts) 32 8.4 6 1-35 128 13.7 12 1-52 44 17.2 13 1-108
Community care (contacts) 2 4.2 2 1-11 51 14.7 3 1-124 29 22.2 11 1-154

Table 5 shows the direct costs (Italian lire at 1999 prices) of care provided in the year preceding the entry into the study (weighted data). The drop-out group had received a much lower level of in-patient, sheltered residential, day and community care than those patients remaining in contact with services. The total costs for the drop-out group for the year preceding the index contact were much less than for patients with and without schizophrenia who continued contact over the follow-up period. Differences were statistically significant for day care, community care and total costs. Table 5 also strongly suggests that the clinical service is successfully targeted to patients with schizophrenia in terms of the balance of expenditure and clinical interventions.

Table 5 Direct costs (Italian lire at 1999 prices) of care provided in the year preceding entry into the study (one-way analysis of variance weighted data)

Cost items Drop-out patients (n=46) Patients remaining in contact (n=179) F 1 P
Mean Median s.e. Patients without schizophrenia (n=133) Patients with schizophrenia (n=46)
Mean Median s.e. Mean Median s.e.
In-patient care 959 030 0 400 906 3 381 591 0 873 142 5 606 154 0 2 209 330 1.08 0.342
Sheltered residential care 0 0 0 515 907 0 495 190 1 060 841 0 866 111 2
Day care 163 794 0 103 189 3 311 278 0 786 738 6 817 850 802 051 1 630 243 22.36 0.000
Out-patient care 850 810 600 370 141 418 1 164 015 1 109 360 99 830 1 448 678 970 060 396 164 0.99 0.372
Community care 92 202 0 51 029 590 749 11 890 157 136 2 163 578 400 050 684 374 18.90 0.000
Total costs 2 065 837 636 900 520 050 8 963 578 1 720 229 1 547 965 17 097 100 6 329 156 3 873 355 18.04 0.000

Predicting drop-out

All patients with schizophrenia remained in contact with services during the study period, so the diagnosis of schizophrenia was a perfect predictor for not dropping out. Table 6 shows the final logistic regression model calculated for the remaining 177 patients (excluding those with a diagnosis of schizophrenia, n=46). A backward selection was performed, and in the initial model, socio-demographic characteristics (living condition, working status, educational level, marital status), clinical variables (diagnosis, GAF, length of contact, number of contacts in the previous year), total costs and satisfaction with services were introduced. The prediction formula used in Table 6 and an example of a prediction for a typical patient are shown in the Appendix.

Table 6 Predictors of the probability of dropping out (n=177, excluding those with a diagnosis of schizophrenia (for example of prediction analysis, see Appendix)

Odds ratio1 s.e. P 95% Cl
Satisfaction with professionals' skills and behaviour 0.403 0.187 0.05 0.2-1.0
Satisfaction with type of intervention 5.973 4.538 0.02 1.3-26.7
Age 0.952 0.0158 0.01 0.92-0.98
Day care contacts in the previous year 0.917 0.0379 0.04 0.8-0.9
Out-patient contacts in the previous year 0.931 0.0323 0.04 0.9-1

It was found that lower age, less use of day care, and less use of out-patient care in the previous year all increased the risk of dropping out of treatment. Premature termination of treatment was not associated with the other socio-demographic characteristics, psychiatric history or diagnosis (except schizophrenia), in-patient days or community care contact in the previous year.

No significant effect on dropping out was found for GAF score, VSSS total score and for total costs. Instead, associations were found between some aspects of patient satisfaction with services and dropping out: patients with greater satisfaction with the skill and behaviour of professionals had a greater probability of staying in contact, whereas those who were more satisfied with the type of intervention received were 5.9 times more likely to drop out.

DISCUSSION

This study, combining data from a PCR with data from other sources, aimed to identify characteristics associated with inappropriate termination of care which could be used in practice to reduce the numbers of such drop-outs within a community mental health service. As the study was conducted in a case register area, it was possible to operationalise termination of care over a relatively long period of time, and to relate these PCR data with standardised patient outcome measures of disability and service satisfaction, collected in routine clinical care. To ensure that the patients included in the drop-out group were only those who had discontinued ongoing contact with services, we adopted a very stringent criterion for eligibility, i.e. that no contact had taken place with any public or private service reporting to the case register for at least 365 consecutive days. In addition, we were able to identify (among those individuals who had lost service contact) those who had died, or who had moved out of the catchment area (in this study, 2.8% of patients, a proportion which is no different from the overall rate of emigration for the whole resident South Verona population). Those patients who terminated episodes of treatment for appropriate reasons were also identified. After this detailed, multi-stage procedure, the remainder who lost contact with services for more than the year following entry to the study were therefore the ‘drop-out’ group.

The decision to include information on disability/symptomatology and satisfaction with services as possible predictors of drop-out reduced the size of our sample from 495 (all 3-month period prevalent treated cases) to 261 (those for whom both GAF and VSSS were complete). However, a well-established weighting procedure (see ‘Statistical analysis’ above) was used to ensure that the patient data included in the study were adjusted to be representative of all treated prevalent cases. This study extends previous work by drawing on case register data, using the types, amounts and costs of care received in the year prior to the index contact as potential predictor variables. This approach has the advantage of realistically categorising patients who end contact with care and who are relatively well (GAF > 70) as appropriate discontinuations, even if no formal agreement to discharge has been reached between clinician and patient, as in the study by Percudani et al (Reference Percudani, Belloni and Contini2002).

A limitation of our study was that it did not include follow-up details of patients who came under the treatment of private psychiatrists or private psychologists, or those who sought care from GPs without a transfer from the CPS. These limits are common to all studies using case registers, which do not usually include data from these sources.

Rate of inappropriate termination of contact (drop-out)

Among the 261 patients included in the cross-sectional South Verona Outcome Project we found that 17% (44) had an inappropriate termination of contact during the year after the index contact. Our findings are not consistent with the results of other studies (Reference PekarikPekarik, 1983; Reference Tehrani, Krussel and BorgTehrani et al, 1996; Reference Young, Grusky and JordanYoung et al, 2000), which estimated that between 26% and 40% of patients may inappropriately leave out-patient care in a 1-year period. The lower drop-out found in our study may be explained by several factors. First, the South Verona service is designed to promote continuity of care, especially for people with severe mental illness (none of the patients with schizophrenia dropped out), which explains why only 27% (70 out of 261) of the total group discontinued contact during the year after the index contact. Second, previous studies have defined the concept of inappropriate termination of treatment less stringently (Reference Baekeland and LundwallBaekeland & Lundwall, 1975; Reference Louks, Mason and BackusLouks et al, 1989; Reference Koch and GillisKoch & Gillis, 1991; Reference Mohl, Martinez and TicknorMohl et al, 1991), relating dropping out to the number of out-patient visits made or to the length of time in treatment (Reference Atwood and BeckAtwood & Beck, 1985; Reference Dworkin, Adams and TelshowDworkin et al, 1986; Reference Axelrod and WetzlerAxelrod & Wetzler, 1989; Reference Mohl, Martinez and TicknorMohl et al, 1991). In these investigations, a patient was considered to be a drop-out if he or she terminated treatment before an arbitrary cut-off point, whether the clinician agreed with the termination or not. By contrast, our definition distinguished between appropriate and inappropriate termination. In addition, the possibility that some of our drop-out patients did not, in fact, drop out of contact with services, but rather transferred care to other providers not reporting to the case register, would further reduce the proportion of cases dropping out of care, and would increase the difference between our findings and those of previous studies. In these respects, the South Verona CPS acts more as an assertive outreach team than as a general adult mental health service within the UK context (Department of Health, 2001). This is because it has relatively fewer referrals of patients with lesser disability than catchment area teams in Britain (which often combine both consultation assessments at the request of primary care practitioners and the treatment of a longer-term case-load of patients with greater disability), as shown by previous UK—Italian comparative studies (Reference Amaddeo, Gater and GoldbergAmaddeo et al, 1995; Reference Gater, Amaddeo and TansellaGater et al, 1995).

Variables associated with dropping out of care

Our findings relating drop-out to younger age are consistent with the results of Kline & King (Reference Kline and King1973), Molnar & Pinchoff (Reference Molnar and Pinchoff1993), Tehrani et al (Reference Tehrani, Krussel and Borg1996) and Young et al (Reference Young, Grusky and Jordan2000), although the finding from the univariate analysis that drop-outs are more likely both to be younger and unmarried must be interpreted with caution, as these two variables are often associated in psychiatric datasets. In terms of clinical status, our results show that there was a significant difference in the level of disability between drop-out patients and patients who remained in contact. These results are consistent with those of Robin (Reference Robin1976). However, a recent controlled prospective study at a psychiatric out-patient service in London (without an outreach service) showed that those who missed appointments were more unwell and had higher levels of disability than those who did attend (Reference Killaspy, Banerjee and KingKillaspy et al, 2000). This study, however, referred only to loss of contact with the out-patient component of the service, rather than with any part of the service, and therefore addressed a more restricted issue. In addition, our results show that direct costs of patients who dropped out of treatment in the previous year were significantly lower than those of patients both with and without schizophrenia, who remained in contact.

Predictors of dropping out of care

For the multivariate analysis, we excluded the 46 patients with schizophrenia because none of them dropped out of care in the year following the index contact; the diagnosis of schizophrenia thus might be considered a perfect predictor of non-drop-out. This is because the South Verona CPS is deliberately targeted at those with severe mental illness and if such a patient fails to attend for an appointment, the staff actively arrange to visit them at home to ensure continuity of clinical contact.

Termination of treatment might be assumed to represent a behavioural sign of dissatisfaction, so a strong inverse relationship between inappropriate termination of treatment and satisfaction with care might be expected. Our use of a detailed service satisfaction scale allowed us to differentiate between different aspects of satisfaction. In terms of the bivariate analysis, we found a trend, but no significant differences, for lower satisfaction in drop-out patients (Table 3). However, when multivariate analyses were performed to identify predictors of dropping out, after excluding patients with a diagnosis of schizophrenia, satisfaction with type of intervention received became the most significant predictor. This sub-scale summarises ratings made on 17 items of the VSSS referring to patients' perceptions of a wide range of treatment and care received, from medication to sheltered work and advice on welfare benefits. This suggests that, for a group of patients predominantly without psychoses, dropping out of contact with services is strongly associated with being more satisfied with the interventions received in the period prior to the index contact and this implies that, from the perspective of these patients, the termination of contact was appropriate.

These results indicate that different criteria may be used by staff and by patients not suffering from schizophrenia when judging at which point to discontinue clinical contact, and that these different priorities may well warrant a more detailed investigation. This leads us to the tentative conclusion that a basis for planning a mutually agreed termination of treatment by clinicians should be open discussion with patients as to whether they are satisfied with the type and amount of treatment received, and when they feel that they have had sufficient care.

At the same time, as expected, patients who are less satisfied with the professional skills and behaviour (rating professionalism, competence and thoroughness of staff) are also more likely to drop out of care. Therefore, these aspects of satisfaction may also have important consequences for whether patients without a diagnosis of schizophrenia allow continuing clinical contact, and therefore potentially effective treatment, to take place at all. This also indicates a further avenue for research, namely the interrelationships between the processes and the outcomes of care, in this case where the processes are rated from a patient perspective.

CLINICAL IMPLICATIONS

  1. Only 17% of patients seeking care from a community-based psychiatric service (none with a diagnosis of schizophrenia) had inappropriate terminations of contact (drop-out).

  2. Self-rated satisfaction with treatment using a standardised scale, for patients not diagnosed with schizophrenia, is highly predictive of patients dropping out of care in the subsequent year.

  3. Patients who are less satisfied with the professional skills and behaviour of staff are also more likely to drop out of care. This also indicates important interrelationships between the processes and the outcomes of care, in this case where the processes are rated from a patient perspective.

LIMITATIONS

  1. This study did not include follow-up details of patients who came under the treatment of private psychiatrists, private psychologists or general practitioners. This would further reduce the already low proportion of cases dropping out of care.

  2. Generalisability may be limited since this study was conducted on a single site.

  3. Self-assessments by patients of their reasons for dropping out, and their own ratings of their disability or symptom severity, are not included.

APPENDIX

An example of a prediction for a typical patient could be made using the following formula:

\batchmode \documentclass[fleqn,10pt,legalpaper]{article} \usepackage{amssymb} \usepackage{amsfonts} \usepackage{amsmath} \pagestyle{empty} \begin{document} \[\ \mathrm{log}(\frac{P}{1-P})=a+b_{1}x_{1}+b_{2}x_{2}+...+b_{n}x_{n}\ \] \end{document}

where: a is the constant value of the regression

\batchmode \documentclass[fleqn,10pt,legalpaper]{article} \usepackage{amssymb} \usepackage{amsfonts} \usepackage{amsmath} \pagestyle{empty} \begin{document} \[\ \mathrm{b}_{1}=\mathrm{ln}(\mathrm{odds\ ratio}_{1})\ \] \end{document}

So, for a patient with:

  • Satisfaction with professionals' skills and behaviour=4

  • Satisfaction with type of intervention=3

  • Age=40 years

  • Day care contacts in the previous year=40

  • Out-patient contacts in the previous year=10

and considering that the constant value of the logistic regression is equal to -0.704:

\batchmode \documentclass[fleqn,10pt,legalpaper]{article} \usepackage{amssymb} \usepackage{amsfonts} \usepackage{amsmath} \pagestyle{empty} \begin{document} \[\ P=\frac{\{\mathrm{exp}[-0.704+\mathrm{ln}(0.403)^{*}4+\mathrm{ln}(5.973)^{*}3+\mathrm{ln}(0.952)^{*}40+\mathrm{ln}(0.917)^{*}40+\mathrm{ln}(0.931)^{*}10]\}}{\{1+\mathrm{exp}[-0.704+\mathrm{ln}(0.403)^{*}4+\mathrm{ln}(5.973)^{*}3+\mathrm{ln}(0.952)^{*}40+\mathrm{ln}(0.917)^{*}40+\mathrm{ln}(0.931)^{*}10]\}}=0.006\ \] \end{document}

Thus, P<0.5. As P=0 is not ‘drop-out’ and P=1 is ‘drop-out’, then the patient with these characteristics has a high probability of not dropping out of care.

Acknowledgements

We acknowledge the contributions to this study by Dr Rossella Beneduce, who made the GAF assessments from case records, and Dr Morven Leese, who gave very helpful statistical advice.

Footnotes

Declaration of interest

Funding was received from the Fondazione Cassa di Risparmio di Verona Vicenza Belluno e Ancona, Progetto Sanità 1996–1997.

References

Amaddeo, F., Gater, R., Goldberg, D., et al (1995) Affective and neurotic disorders in community-based services: a comparative study in South Verona and South Manchester. Acta Psychiatrica Scandinavica, 91, 386395.CrossRefGoogle ScholarPubMed
Amaddeo, F., Beecham, J., Bonizzato, P., et al (1997) The use of a case register to evaluate the costs of psychiatric care. Acta Psychiatrica Scandinavica, 95, 189198.CrossRefGoogle ScholarPubMed
Amaddeo, F., Beecham, J., Bonizzato, P., et al (1998) The costs of community-based psychiatric care for first-ever patients. A case register study. Psychological Medicine, 28, 173183.CrossRefGoogle ScholarPubMed
Atwood, N. & Beck, J. (1985) Service and patient predictors of continuation in clinic-based treatment. Hospital and Community Psychiatry, 36, 865869.Google ScholarPubMed
Axelrod, S. & Wetzler, S. (1989) Factors associated with better compliance with psychiatric aftercare. Hospital and Community Psychiatry, 40, 397401.Google ScholarPubMed
Baekeland, F. & Lundwall, L. (1975) Dropping out of treatment: a critical review. Psychological Bulletin, 82, 738783.CrossRefGoogle ScholarPubMed
Brick, J. M. & Kalton, G. (1996) Handling missing data in survey research. Statistical Methods in Medical Research, 5, 215238.CrossRefGoogle ScholarPubMed
Department of Health (2001) Policy Implementation Guidelines. London: Department of Health.Google Scholar
Dworkin, R., Adams, G. & Telshow, R. (1986) Cue of disability and treatment continuation of chronic schizophrenics. Social Science and Medicine, 22, 521526.CrossRefGoogle Scholar
Endicott, J., Spitzer, R. L., Fleiss, I. L., et al (1976) The Global Assessment Scale. A procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33, 766771.CrossRefGoogle Scholar
Gater, R., Amaddeo, F., Tansella, M., et al (1995) A comparison of community-based care for schizophrenia in South Verona and South Manchester. British Journal of Psychiatry, 166, 344352.CrossRefGoogle ScholarPubMed
Grassi, G. (2000) Output standard in the mental health service of Reggio Emilia, Italy. Methodological issues. Epidemiologia e Psichiatria Sociale, 9, 5669.CrossRefGoogle Scholar
Iannacchione, V. G., Milne, J. G. & Folsom, R. (1991) Response probability weight in adjustments using logistic regression. In Proceedings of the American Statistical Association, Section on Survey Research Methods, pp. 637642. Alexandria, VA: American Statistical Association.Google Scholar
Killaspy, H., Banerjee, S., King, M., et al (2000) Prospective controlled study of psychiatric out-patient non-attendance. British Journal of Psychiatry, 176, 160165.CrossRefGoogle ScholarPubMed
Kline, J. & King, M. (1973) Treatment dropouts from a community mental health centre. Community Mental Health Journal, 9, 354360.CrossRefGoogle Scholar
Koch, A. & Gillis, L. (1991) Non-attendance of psychiatry out-patients. South African Medical Journal, 80, 289291.Google Scholar
Louks, J., Mason, J. & Backus, F. (1989) AMA discharges: prediction and treatment outcome. Hospital and Community Psychiatry, 40, 299301.Google ScholarPubMed
Mohl, P., Martinez, D., Ticknor, C., et al (1991) Early dropouts from psychotherapy. Journal of Nervous and Mental Disease, 179, 478481.CrossRefGoogle ScholarPubMed
Mirandola, M., Baldassari, E., Beneduce, R., et al (2000) A standardised and reliable method to apply the Global Assessment of Functioning (GAF) scale to psychiatric case records. International Journal of Methods in Psychiatric Research, 9, 7986.CrossRefGoogle Scholar
Molnar, G. & Pinchoff, D. (1993) Factors in patient elopements from an urban state hospital and strategies for prevention. Hospital and Community Psychiatry, 44, 791792.Google ScholarPubMed
Pekarik, G. (1983) Improvement in clients who have given different reasons for dropping out of treatment. Journal of Clinical Psychology, 39, 909913.3.0.CO;2-4>CrossRefGoogle ScholarPubMed
Percudani, M., Belloni, G., Contini, A., et al (2002) Monitoring community psychiatric services in Italy: differences between patients who leave care and those who stay in treatment. British Journal of Psychiatry, 180, 254259.CrossRefGoogle ScholarPubMed
Robin, A. (1976) Rationing out-patients: a defence of the waiting list. British Journal of Psychiatry, 129, 138141.CrossRefGoogle ScholarPubMed
Ruggeri, M. & Dall'Agnola, R. (1993) The development and use of Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS). Psychological Medicine, 23, 511524.CrossRefGoogle ScholarPubMed
Ruggeri, M. & Dall'Agnola, R. Agostini, C., et al (1994) Acceptability, sensitivity and content validity of VECS and VSSS in measuring expectations and satisfaction in psychiatric patients and their relatives. Social Psychiatry and Psychiatric Epidemiology, 29, 65276.CrossRefGoogle ScholarPubMed
Ruggeri, M., Biggeri, A., Rucci, P., et al (1998) Multivariate analysis of outcome of mental health care using graphical chain models. Psychological Medicine, 28, 14211431.CrossRefGoogle ScholarPubMed
Ruggeri, M., Leese, M., Thornicroft, G., et al (2000) Definition and prevalence of severe and persistent mental illness. British Journal of Psychiatry, 177, 149155.CrossRefGoogle ScholarPubMed
STATA Corporation (2000) STATA Statistical Software. Release 7.0. College Station, TX: Stata Corporation.Google Scholar
Sytema, S., Micciolo, R. & Tansella, M. (1997) Continuity of care for patients with schizophrenia and related disorders: a comparative South-Verona and Groningen case register study. Psychological Medicine, 27, 13551362.CrossRefGoogle ScholarPubMed
Tansella, M., Micciolo, R., Biggeri, A., et al (1995) Episodes of care for first-ever psychiatric patients. A long-term case-register evaluation in a mainly urban area. British Journal of Psychiatry, 167, 220227.CrossRefGoogle Scholar
Tansella, M., Amaddeo, F., Burti, L., et al (1998) Community-based mental health care in Verona, Italy. In Mental Health in our Future Cities (eds Goldberg, D. & Thornicroft, G.), pp. 239262. Hove: Psychological Press.Google Scholar
Tehrani, E., Krussel, J., Borg, L., et al (1996) Dropping out of psychiatric treatment: a prospective study of a first admission cohort. Acta Psychiatrica Scandinavica, 94, 266271.CrossRefGoogle ScholarPubMed
Thornicroft, G. & Tansella, M. (1999) The Mental Health Matrix. A Manual to Improve Services. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Trepka, C. (1986) Attrition from an out-patient psychology clinic. British Journal of Medical Psychology, 59, 181186.CrossRefGoogle ScholarPubMed
World Health Organization (1992) The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines. Geneva: WHO.Google Scholar
Young, A., Grusky, O., Jordan, D., et al (2000) Routine outcome monitoring in a public mental health system: the impact of patients who leave care. Psychiatric Services, 51, 8591.CrossRefGoogle Scholar
Figure 0

Table 1 Patient selection (of which first-ever patients are shown in parentheses)

Figure 1

Table 2 Socio-demographic, clinical and psychiatric history data for drop-out patients and patients remaining in contact who have complete Global Assessment of Functioning Scale (GAF) and Verona Service Satisfaction Scale (VSSS) scores (percentage of weighted data in parentheses)

Figure 2

Table 3 Comparisons of Global Assessment of Functioning (GAF) scale and Verona Service Satisfaction Scale (VSSS) scores between drop-out patients and patients remaining in contact who have complete GAF and VSSS scores (one-way analysis of variance weighted data)

Figure 3

Table 4 Comparisons of service use during the previous year between drop-out patients and patients remaining in contact who have complete Global Assessment of Functioning (GAF) scale and Verona Service Satisfaction Scale (VSSS) scores. The values refer only to patients with at least one contact for each type of care (weighted data)

Figure 4

Table 5 Direct costs (Italian lire at 1999 prices) of care provided in the year preceding entry into the study (one-way analysis of variance weighted data)

Figure 5

Table 6 Predictors of the probability of dropping out (n=177, excluding those with a diagnosis of schizophrenia (for example of prediction analysis, see Appendix)

Submit a response

eLetters

No eLetters have been published for this article.