Hostname: page-component-7c8c6479df-7qhmt Total loading time: 0 Render date: 2024-03-27T18:01:18.828Z Has data issue: false hasContentIssue false

International differences in home treatment for mental health problems

Results of a systematic review

Published online by Cambridge University Press:  02 January 2018

Tom Burns
Affiliation:
St George's Hospital Medical School, London, UK
Jocelyn Catty*
Affiliation:
St George's Hospital Medical School, London, UK
Hilary Watt
Affiliation:
St George's Hospital Medical School, London, UK
Christine Wright
Affiliation:
St George's Hospital Medical School, London, UK
Martin Knapp
Affiliation:
London School of Economics and Institute of Psychiatry, London, UK
Juliet Henderson
Affiliation:
London School of Economics, London, UK
*
Jocelyn Catty, Research Fellow, Social and Community Psychiatry, St George's Hospital Medical School, Jenner Wing, Cranmer Terrace, London SW17 0RE, UK. Tel: 020 8725 3489; fax: 020 8725 3538; e-mail: jcatty@sghms.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Background

It is perceived that North American home treatment studies reveal greater success in reducing days in hospital than do European studies. There are difficulties in extrapolating findings internationally.

Aims

We aimed to determine whether North American studies find greater reductions in days in hospital and whether experimental service patients in North American studies spend less time in hospital.

Method

The results of a systematic review were analysed with respect to study location. Service components ascertained through follow-up were utilised to interpret the meta-analyses conducted.

Results

Most of the 91 studies found were from the USA and UK. North American studies found a difference of one hospital day (per patient per month) more than European studies but there was no difference in experimental data between the two locations.

Conclusions

North American studies demonstrate greater differences in days in hospital but patients in their experimental services seem to spend no fewer days in hospital, implying a disparity in control services.

Type
Review article
Copyright
Copyright © Royal College of Psychiatrists, 2002 

European studies of ‘home treatment’ mental health services are perceived not to find the same reduction in days in hospital as North American and Australian studies. Various explanations are offered, such as poor implementation of home treatment services by European practitioners or low programme fidelity (Reference TyrerTyrer, 2000), or ‘standard’ care in Europe already containing many elements of home-based practice (Reference Burns, Fahy and ThompsonBurns et al, 1999a ). Whereas care in the UK is delivered routinely by community-based multi-disciplinary teams, conformity of US standard care to treatment recommendations was recently found to be ‘modest at best’ (Reference Lehman and SteinwachsLehman & Steinwachs, 1998). Differences in organisational and financing structures, however, also contribute to differences in cost outcomes (Reference Mueser, Bond and DrakeMueser et al, 1998). Different methods of providing psychiatric and social care in different countries could thus limit the generalisability of research findings (Reference Holloway, Oliver and CollinsHolloway et al, 1995). Local and international contexts therefore affect the extrapolation of findings to different settings (Reference Burns and PriebeBurns & Priebe, 1996).

Aims

We aimed to identify international differences in home treatment services for mental health problems through a systematic review of studies using Cochrane methodology. We aimed to answer the question, ‘Does the effectiveness of home treatment services vary internationally in terms of reducing days in hospital?’ This analysis was an a priori aim of the review.

Specific hypotheses, focused on Europe compared with North America, were that:

  1. (a) North American home treatment studies find greater reductions in days in hospital than European studies (difference between experimental and control arm days in hospital greater for North American than European studies);

  2. (b) patients in the experimental arms of North American home treatment studies spend fewer days in hospital than do those in the experimental arms of European studies;

  3. (c) North American home treatment studies are more likely than European studies to use in-patient treatment as the control service.

METHOD

We conducted a systematic review of home treatment for mental health problems. ‘Home treatment’ was defined as any non-residential service that aimed to treat patients outside hospital as far as possible and to enable them to stay in their usual place of residence. This definition was deliberately broad, designed to cover a wide range of services, so that they could be analysed by their components (ascertained through follow-up to authors) rather than the labels given to the services. In practice, the majority of services studied visited patients in their homes ‘regularly’, thus providing home treatment in a narrower sense, although the proportion of contacts delivered at home varied greatly (Reference Catty, Burns and KnappCatty et al, 2002a ). The analysis of studies in terms of their location, an a priori aim of the project, is the sole focus of this paper.

Literature search

Five databases — CINAHL (1982 to October 1999), the Cochrane Schizophrenia Group Register (up to September, 1999), EMBASE (1980 to October 1999), MEDLINE (1966 to December 1999) and PsychLIT (1887 to September 1999) — were searched systematically using terms for mental health problems and home treatment (defined above). Studies of day, foster and residential care were excluded. Studies were included as randomised controlled trials (RCTs) if they met Cochrane standards (Reference Mulrow, Oxman, Clarke and OxmanMulrow & Oxman, 1997). Non-randomised studies (non-RCTs) comparing two or more services were also included. RCTs with flawed randomisation were relegated to the non-randomised study group. Non-RCTs were only included in the meta-analysis if they were prospective and provided evidence for baseline comparability of groups. The outcome measure was days in hospital per patient per month. Full details of the search strategy and methodology for the whole review are reported elsewhere (Reference Catty, Burns and KnappCatty et al, 2002a ).

Follow-up

A questionnaire was sent to each author, asking about 20 possible components of home treatment, derived from a Delphi exercise with leading psychiatrists (Reference Burns, Knapp and CattyBurns et al, 2001). This was to ascertain the components of the experimental service and of the control service, if the latter was described as a community mental health team (CMHT). Missing data were supplemented from the papers where possible. The components were all considered item by item in the subsequent analyses, rather than as a scale score.

In response to the perception that North American studies are more likely than European studies to find significant differences in hospitalisation in favour of the experimental services, we noted the numbers of studies in each location finding significant results and tested these proportions using χ -squared tests. We used days in hospital where they had used this measure; if they had not, we used another hospitalisation measure if reported. This was a crude measure of differences in study findings, reflecting both the number of patients in the study and the size of any differences found. It is intended merely as a description, to shed some light on the common perception.

Meta-analysis

Studies were divided into ‘North American’, ‘European’ and ‘Other’ and their service components, study design and hospitalisation findings compared. In practice, there were insufficient studies from the ‘Other’ locations to include them, so the results focus only on North American and European studies. Studies were designated either in-patient control (where the control service was an initial period of in-patient treatment, with discharge when appropriate) or community control (control service not in-patient treatment).

Studies were only included in the outcome meta-analysis if data were available in the form of mean hospital days. The primary outcome measure was mean monthly hospital days for the entire study. Studies of less than a year's duration were excluded.

Two analytical strategies were used:

  1. (a) comparative analysis: this addressed hypothesis (a) by measuring the difference in hospital days between the experimental and control groups for the North American and European studies. The location of the study (Europe/North America) was tested for association with the difference in hospital days, using a weighted unpaired t-test. In-patient-control and community-control studies were analysed separately. The analysis was performed on RCTs initially and then repeated including non-RCTs. It was weighted by the total number of patients in the study with hospital days data.

  2. (b) Experimental services analysis: this addressed hypothesis (b) by including only experimental arm data and testing the location of the study for association with the overall days in hospital for experimental patients. This ascertained whether patients in North American studies' experimental services spend fewer days in hospital than patients in European studies' experimental services. Because no control service data were used, all studies could be analysed together, regardless of whether they were inpatient control or community control. This was not a randomised comparison; its validity was based on the methodological rigour of the study data and for this reason, only RCTs were included. We attempted to control for illness severity by adjusting for ‘high service use’ (using studies' inclusion criteria). The analysis was weighted by the number of patients in the experimental arm with hospital days data (Reference Burns, Knapp and CattyBurns et al, 2001).

In the main analyses for the review, key service components were tested for association with the outcome measure, using weighted regression analyses (Reference Catty, Burns and KnappCatty et al, 2002a ). These analyses were not repeated for each location but their results will be used to illuminate the findings of the meta-analyses reported here.

RESULTS

Studies

We found 91 studies, 59 (65%) of which were conducted in North America, 25 (28%) in Europe and 7 (8%) elsewhere (for full details, see Reference Burns, Knapp and CattyBurns et al, 2001). Most North American studies were from the USA (four were Canadian). Of the 25 European studies, 21 were British, 3 were Scandinavian and 1 was German. Four of the other studies were Australian, one was from New Zealand, one was from India and one from China.

There were no significant differences between European and North American studies in the proportion of studies using in-patient treatment as the control service, refuting hypothesis (c). There were also no differences in the control service being a CMHT, or in the year of publication (Table 1).

Table 1 Study characteristics

North American European Other P 1
All studies, n (%) n=59 n=25 n=7
RCTs 38 (64) 16 (64) 2 (29) 1.0
In-patient-control 9 (15) 6 (24) 3 (43) 0.36
CMHT control service 20 (34) 7 (28) 2 (29) 0.73
Median year of publication 1993 1995 1995 0.14
All/predominately psychotic 56 (95) 21 (84) 7 (100) 0.19
Author responded 35 (59) 18 (72) 2 (29) 0.33
RCTs included in meta-analyses n=19 n=9 - -
In-patient-control 3 (16) 1 (11) N/A N/A 0.74
CMHT control service 6 (32) 5 (56) N/A N/A 0.67
Median year of publication 1995 1995 N/A N/A 0.96
All/predominately psychotic 18 (95) 7 (78) N/A N/A 0.29
Author responded 13 (68) 9 (100) N/A N/A 0.06

Study findings

More North American studies (18 studies: 31%) than European ones (5 studies: 19%) found significant reductions in hospitalisation, but this difference was non-significant (Table 2). It was still non-significant when RCTs and non-randomised studies were treated separately. European studies had larger mean sample sizes (224 compared with 160), but this was non-significant.

Table 2 Studies' reported hospitalisation findings1

North American n=58 European n=26 Other n=7
Sample size, mean (s.d.) 160 (145) 224 (292) 172 (173)
Significance favours experimental service, n (%) 18 (31) 5 (19) 4 (57)
Significance favours control service, n (%) 2 (3) 1 (4) 0 (0)
Non-significant, n (%) 24 (41) 10 (38) 2 (29)
Not applicable/significance not reported, n (%) 14 (24) 10 (38) 1 (14)

Follow-up

Authors of 55 studies (60%) responded to follow-up: 18 European (15 UK, 2 Scandinavian and 1 German), 35 North American (33 US and 2 Canadian) and 2 ‘Other’ (both Australian). Responders were more commonly European than were non-responders and less likely to be from ‘Other’ countries, but this was non-significant. The response rate was higher from authors of RCTs (77%).

Service characterisation

The findings below are for all studies for which we had information. For differences in components when only considering those studies in the meta-analyses, see below.

Experimental services

As Table 3 shows, significantly more European teams had occupational therapists. All the North American services had ‘in-service training’, compared with 62% of the European services (Fisher's exact P < 0.001). The mean ‘average’ contact frequency for the North American teams was 2.5 times the European mean contact frequency (P=0.003).

Table 3 Experimental team characteristics1

North American European P
Staff, n (%)
Multi-disciplinary teams 31 (80) 19 (86) 0.70
Psychiatrist on the team 30 (88) 12 (67) 0.554
Psychiatric nurse on the team 24 (83) 17 (94) 0.43
Occupational therapist on the team 9 (32) 13 (72) 0.002
[3] [27] [5] [63] [0.092]
Social worker on the team 26 (86) 11 (61) 0.097
[12] [92] [4] [50] [0.047]
Psychologist on the team 7 (18) 7 (35) 0.209
Psychiatrist an integrated member of team (% of services with a psychiatrist) 21 (70) 10 (83) 0.464
In-service training 33 (100) 11 (61) <0.001
[14] [100] [7] [88] [0.36]
Psychiatrist hours per week, mean (s.d.) 18.9 (11.8) 34.6 (43.0) 0.234
Number of staff on team, mean (s.d.) 7.2 (3.2) 9.6 (6.6) 0.540
Patients and contacts, mean (s.d.)
Target number of patients 82.3 (73.6) 117.2 (114.4) 0.314
Target individual case-load size 14.3 (7.7) 18.1 (11.2) 0.271
Maximum contact frequency/month 32.5 (32.8) 17.3 (11.9) 0.245
Average contact frequency/month 11.0 (12.8) 4.5 (4.7) 0.003
[6.6] [3.6] [2.7] [2.0] [0.018]
Proportion of visits made at home 55.2 (26.6) 63.1 (22.3) 0.552
Home treatment function, n (%) 33 (97) 16 (94) 0.84
Regularly visit patients at home, n (%) 32 (94) 17 (94) 0.94
Service procedures, n (%)
Responsibility for health and social care 34 (87) 14 (78) 0.442
Crisis element to the team 22 (76) 9 (53) 0.124
Multi-disciplinary review at least weekly 33 (97) 13 (72) 0.022
[11] [100] [5] [63] [0.058]
Protocol for meeting carers' needs 13 (41) 3 (18) 0.143
Days per week, mean (s.d.) 5.6 (1.1) 5 (0.5) 0.01
[6.2] [1.0] [5.0] [0.0] [0.009]
Hours per weekday, mean (s.d.) 11.4 (5.4) 8.7 (1.5) 0.013
[13.9] [7.4] [8.1] [0.4] [0.10]

Table 4 Community Mental Health Team (CMHT) control team characteristics1

North American European P
Staff, n (%)
Multi-disciplinary teams 10 (83) 6 (86) 0.82
Psychiatrist on the team 11 (55) 7 (100) 0.226
Psychiatric nurse on the team 8 (57) 7 (100) 0.239
Occupational therapist on the team 3 (20) 6 (86) 0.017
[3] [100] [3] [75] [0.143]
Social worker on the team 13 (77) 4 (57) 0.255
Psychiatrist integrated member of team (services with psychiatrist) 8 (67) 6 (86) 0.110
In-service training 6 (32) 5 (71) 0.205
Psychiatrist hours per week, mean (s.d.) 19.5 (25.3) 31.4 (32.0) 0.354
Number of staff on team, mean (s.d.) 6.4 (2.4) 9.7 (2.6) 0.033
[6.3] [2.5] [9.0] [3.6] [0.24]
Patients and contacts, mean (s.d.)
Target number of patients 98.1 (60.3) 247.8 (199.1) 0.212
Target individual case-load size 33.9 (26.3) 21.5 (15.5) 0.559
Maximum contact frequency/month 21.2 (22.9) 8.4 (7.5) 0.298
Average contact frequency/month 8.0 (10.7) 1.5 (0.4) 0.018
[3] [1.0] [1.5] [0.5] [0.68]
Proportion of visits made at home 29.5 (25.7) 48.8 (19.3) 0.185
n (%) n (%)
Home treatment function, n (%) 9 (53) 7 (100) 0.121
Regularly visit patients at home, n (%) 8 (47) 7 (100) 0.052
[4] [80] [4] [100] [1.0]
Service procedures, n (%)
Responsibility for health and social care functions 7 (47) 5 (71) 0.381
Crisis element to the team 8 (50) 2 (29) 0.320
Multi-disciplinary review at least weekly 5 (33) 5 (71) 0.314
Protocol for meeting carers' needs 3 (19) 1 (14) 0.73
Days per week, mean (s.d.) 5.3 (0.8) 5.0 (0) 0.16
Hours per weekday, mean (s.d.) 9.5 (4.4) 8.0 (0) 0.27

Table 5 Meta-analyses: comparative (difference in mean hospital days) and experimental (mean hospital days)

North American1 (n) Days per patient per month European (n) Days per patient per month Test statistics
Comparative analysis: mean difference in days (control—experimental)
Randomised controlled trials (RCTs)2 16 0.78 8 -0.303 t=2.79, d.f. 22, P=0.014
RCTs and non-RCTs 18 0.57 9 -0.283 t=0.63, d.f. 25, P=0.0564
Experimental services analysis: mean days5
RCTs only 19 1.57 9 1.75 t=1.93, d.f. 26, P=0.0646

Having a ‘home treatment function’, ‘regularly’ visiting patients at home and the proportion of contacts made at home did not differ between groups. North American services operated significantly longer hours (per weekday) than European ones (11.4 compared with 8.7 hours; U=250.5, P=0.01) and more days, although the difference was small. More North American services had weekly multi-disciplinary review (P=0.022; Table 3).

Control services

Twenty North American services (57% of responders) and seven European (39%) described themselves as CMHTs. The following findings pertain only to them.

More European control services had an occupational therapist (P=0.017). More European control services had in-service training, but this was not statistically significant. North American control services had a significantly higher average contact frequency, with eight contacts per month compared with 1.5 for European control services (U=11.0, P=0.018).

All seven of the responding European control services that were CMHTs visited patients at home, compared with under half of the North American services (Fisher's exact P=0.052; Table 4).

Meta-analyses

Despite the extensive follow-up, only 28 studies could be used in the meta-analyses by location because of insufficient mean hospital days data for a minimum of 1 year's follow-up. Characteristics of these studies are shown in Table 1.

Comparative analysis

There were insufficient in-patient-control studies with available data to test for differences in location (only one out of the four eligible studies was European). For the 24 community-control RCTs for which we had appropriate available data, the results were significantly different for North American compared with European studies. North American RCTs found an overall reduction of 0.8 hospital days per patient per month in favour of the experimental services, whereas the European studies found an increase of 0.3 days. We were unable to put confidence intervals on the within-group overall mean differences because of lack of standard deviation data. The difference between the two locations (1.1 days), however, was significant (t=2.79, d.f. 22, P=0.01). When we included the three community-control non-RCTs for which we had data, the difference between the two locations became smaller and failed to reach significance (Table 5).

Experimental services analysis

This included both in-patient-control and community-control RCTs (28 studies). The difference between North America and Europe in mean days spent in hospital by experimental patients was only 0.2 per patient per month and non-significant (Table 5). The difference between locations became even smaller after adjusting for whether or not the study stated that it was specifically for patients with ‘high service use’.

Service characteristics of meta-analysed studies

To explore possible reasons for the difference in hospital days reduction found between locations, we considered again the service characteristics of the 24 RCTs included in this analysis. For their experimental services, having an occupational therapist on the team, in-service training and hours of operation were no longer significant. Average contact frequency was still significantly different, and weekly multi-disciplinary review approached significance. The days of operation for this group were significantly higher for North American services, and more North American services had a social worker (Table 3).

Only 10 of these RCTs said that their control service had been a CMHT. For these studies, there was no significant difference in having an occupational therapist. The difference in average contact frequency was no longer statistically significant; furthermore, regular visits at home and the number of staff on the team also ceased to be significant, possibly because of the small number of studies tested here.

DISCUSSION

The controversy over the relative success of North American and European home treatment services has generated much debate, usually focused on assertive community treatment. This debate is rarely evidence-based. The present project sheds some light on this contentious area by using the results of a wide-ranging systematic review and extensive follow-up to authors to examine international differences in hospitalisation reduction. Fewer studies could be meta-analysed than we had component data for. We utilised component data for all the studies followed up, to ascertain trends in service characterisation and how they differ between locations. To interpret the meta-analyses, we also considered the components of only those studies meta-analysed. Inevitably, with this smaller group, differences were harder to detect. Both sets of findings are helpful in gaining a picture of home treatment services and their variations internationally.

Limitations

There were very few studies from outside North America and Europe, and for this reason they could not be included. Moreover, US and UK studies dominated the two groups. The meagre number of studies from other areas could have been a result of an English-language bias in our search strategy, although several non-English-language studies were found but did not meet our inclusion criteria (Reference Kluiter, Giel and NienhuisKluiter et al, 1992; Reference Otero and RebolledoOtero & Rebolledo, 1993; Reference De CangasDe Cangas, 1994; Reference Hu, Xiong and FeiHu et al, 1994; Reference Van Minnen, Hoogduin and Broekmanvan Minnen et al, 1997).

The availability of hospital days data limited the analysis. We also attempted to collect service utilisation data to ascertain cost differences (Reference Burns, Knapp and CattyBurns et al, 2001; Reference Catty, Burns and KnappCatty et al, 2002b ), but insufficient data were available.

The controversy about relative effectiveness has focused on assertive community treatment. Although studies of assertive community treatment form a substantial proportion of the studies included and meta-analysed here, our definition of home treatment was deliberately broad and not limited to such treatment. It should also be noted that we could not include in-patient-control studies in the comparative meta-analysis of hospitalisation reduction, and this group of course includes the original Madison study (Reference Stein and TestStein & Test, 1980); they were, however, included in the experimental services analysis. Exclusion of studies from elsewhere than North America and Europe, moreover, meant that the findings of another study that has featured in the controversy (Reference Hoult, Reynolds and Charbonneau PowisHoult et al, 1983) could not be included.

Study design and services

The North American studies were no more likely than the European studies to have used in-patient treatment as the control service, so this could not in itself account for their perceived greater success rate. Despite the perception that North American services work with smaller case-loads, the difference in case-load size between locations was not significant. European CMHT control services were more likely to visit patients at home ‘regularly’, although the difference compared with the North American services just failed to reach significance. This difference would seem in line with the finding of the UK700 study of intensive case management that 76.5% of control service (standard CMHT case management) contacts were delivered in non-service settings (Reference Burns, Fiander and KentBurns et al, 2000).

Perceptions of difference

Although more North American than European studies have demonstrated significant reductions in hospitalisation, this is at least partly because of the relatively low number of European studies conducted at all (25 compared with 59). The difference in proportions here was not significant, although the proportions of studies reporting an advantage to the control service were actually the same. European studies had larger sample sizes than North American studies, which might imply that they had greater power to detect significant differences, but the difference in average sample sizes was non-significant. It could be that a few high-profile studies on either side of the Atlantic have given rise to the impression that North American studies find greater differences. A basic comparison of hospitalisation results does not support this idea.

Reducing hospitalisation

There was clear evidence to support the hypothesis that North American studies are more successful at reducing hospitalisation than are European ones. This finding could have been affected by the heterogeneity of the studies included. North American studies seem, nevertheless, to find a greater difference between experimental and control patients than European ones do.

One explanation offered for this disparity has been that European services have implemented home treatment poorly (Reference TyrerTyrer, 2000). Our analysis of experimental service components yields inconclusive results in this respect. Six components differed between the two locations, of which three (having an occupational therapist, in-service training and hours of operation) became non-significant when we analysed only the 24 RCTs used in the meta-analysis. Average contact frequency, however, remained significantly higher for North American teams, even when only these 24 RCTs were analysed. It is possible that this difference might account for some of the difference in reduction in hospitalisation. The difference between experimental and control North American services in this respect, however, was small; this makes this interpretation less plausible. Having a social worker on the team was significantly more common for the North American teams in the meta-analysis, but this seems unlikely to account for the difference found. Finally, North American teams operated 6-day weeks, on average, compared with the European 5-day week and also compared with the average 5-day weeks of North American control services. This might seem a more plausible explanation. None of these components, however, was associated with reduction in hospital days in our meta-analysis of service components across all studies (Reference Catty, Burns and KnappCatty et al, 2002a ).

European control services: too close to the experimental services?

An alternative suggestion has been that European control services might be more effective than North American ones, that is, closer to the experimental services (Reference Burns, Fahy and ThompsonBurns et al, 1999a ). Our experimental services analysis suggests that this could indeed be the case. This analysis found that patients in North American experimental services spent no fewer days in hospital than those in European services. Differences in hospitalisation policies would have a potential influence on this finding, as well as differences in severity of illness of patients included. We made some adjustment for the latter, but it might not have adjusted fully for differences in severity. Nevertheless, the lack of a difference found between experimental services is consistent with the hypothesis that it is the control services that differ between North America and Europe.

Our analysis of components yields contradictory evidence to support this conclusion. North American control services had significantly higher contact frequencies than European ones across the board: a difference which would seem to be in their favour. This difference was not statistically significant for the studies in the meta-analysis, however, possibly because of the small number of studies. European control services were significantly more likely to visit their patients at home ‘regularly’, although this only approached significance across all studies and was non-significant within the 24 RCTs used in the meta-analysis. Although these findings are thus equivocal, it is possible that the tendency for European control services to visit patients at home could have at least partially accounted for their studies' failure to demonstrate differences in hospitalisation relative to North American studies. ‘Regularly visiting at home’ was associated with reducing hospital days across all the studies (Reference Catty, Burns and KnappCatty et al, 2002a ), so this component could be particularly meaningful.

For the two-thirds of control services that were not CMHTs, we have scant information. For the 24 RCTs meta-analysed, only 10 used CMHTs as their control services. We cannot therefore rule out substantial differences in the control services of these studies between North America and Europe. It is plausible that such differences too could account for the differences in the overall mean reductions in hospital days between North American and European studies.

The conundrum

Although it seems clear that North American studies find greater reductions in hospitalisation than do European ones, determining the cause of this difference is difficult. Our evidence is that patients in North American experimental services were spending no fewer days in hospital than were patients in European services; that is, that experimental and control services differ in North America to a greater extent than in Europe. Our interpretation of this is necessarily tentative, given the difficulties of obtaining full data and methodological limitations. Nevertheless, it seems plausible to suggest that European control services are close to their experimental counter-parts — perhaps particularly in home visiting — and that this, or other unknown control service features, could account for the failure of European studies to replicate the findings of certain North American studies. The implications of this are farreaching and should be an important check on current European service initiatives. Future research is likely to need greater design sophistication and power than that of many of the studies included in this review if it is to yield convincing answers to the questions raised here.

CLINICAL IMPLICATIONS

  1. Little is known about home treatment outside the UK and USA.

  2. North American studies demonstrate greater reductions in days in hospital than European studies, but patients in their experimental services spend no less time in hospital than those in European studies' experimental services.

  3. The disparity in study results might result from control services in Europe being closer to their experimental counterparts, possibly in their emphasis on visiting patients at home.

LIMITATIONS

  1. The effect of location could not be tested for areas outside North America and Europe.

  2. There might have been an English-language bias in the literature search.

  3. The inclusion criteria were broad, producing a wide range of studies.

Acknowledgements

This project was commissioned by the UK National Health Service (NHS. National Co-ordinating Centre for Health Technology Assessment. Views and opinions expressed here do not necessarily reflect those of the NHS Executive. We thank Clive Adams of the Cochrane Schizophrenia Group for advice on the design of this review and for training researchers in Cochrane methodology, Martin Bland for statistical advice, Rachel Churchill and Steve Milan for advice on methodology and Sarajane Bhattachary and Adelina Comas for research support.

Footnotes

Declaration of interest None.

References

Bond, G. R., Witheridge, T. F., Dincin, J., et al (1990) Assertive community treatment for frequent users of psychiatric hospitals in a large city: a controlled study. American Journal of Community Psychology, 18, 865891.CrossRefGoogle Scholar
Burns, T. & Priebe, S. (1996) Mental health care systems and their characteristics: a proposal. Acta Psychiatrica Scandinavica, 94, 381385.CrossRefGoogle ScholarPubMed
Burns, T., Beadsmoore, A., Bhat, A. V., et al (1993) A controlled trial of home-based acute psychiatric services. I: Clinical and social outcome. British Journal of Psychiatry, 163, 4954.Google Scholar
Burns, T., Fahy, T., Thompson, S., et al (1999a) Intensive case management for severe psychotic illness: Authors' reply. Lancet, 354, 13851386.Google Scholar
Burns, T., Creed, F., Fahy, T., et al (1999b) Intensive versus standard case management for severe psychotic illness: a randomised trial. Lancet, 353, 21852189.Google Scholar
Burns, T., Fiander, M., Kent, A., et al (2000) Effects of case-load size on the process of care of patients with severe psychotic illness. Report from the UK700 trial. British Journal of Psychiatry, 177, 427433.Google Scholar
Burns, T., Knapp, M., Catty, J., et al (2001) Home treatment for mental health problems: a systematic review. Health Technology Assessment, 5 (15), 1139.Google Scholar
Bush, C. T., Langford, M. W., Rosen, P., et al (1990) Operation outreach: intensive case management for severely psychiatrically disabled adults. Hospital and Community Psychiatry, 41, 647649.Google Scholar
Catty, J., Burns, T., Knapp, M., et al (2002a) Home treatment for mental health problems: a systematic review. Psychological Medicine, 32, 383401.Google Scholar
Catty, J., Burns, T., & Knapp, M. (2002b) Evaluating innovative mental health services: lessons from a systematic review of home treatment. euro health, 8, 3436.Google Scholar
Chandler, D., Meisel, J., Hu, T. W., et al (1996) Client outcomes in a three-year controlled study of an integrated service agency model. Psychiatric Services, 47, 13371343.Google Scholar
Chandler, D., Spicer, G., Wagner, M., et al (1999) Cost-effectiveness of a capitated assertive community treatment program. Psychiatric Rehabilitation Journal, 22, 327336.Google Scholar
Curtis, J. L., Millman, E. J., Struening, E., et al (1992) Effect of case management on rehospitalization and utilization of ambulatory care services. Hospital and Community Psychiatry, 43, 895899.Google Scholar
De Cangas, J. P. C. (1994) Le ‘case management’ affirmatif: une évaluation complète d'un programme du genre en milieu hospitalier. Santé Mentale au Québec, 19, 7592.Google Scholar
Drake, R. E., McHugo, G. J., Clark, R. E., et al (1998) Assertive community treatment for patients with co-occurring severe mental illness and substance use disorder: a clinical trial. American Journal of Orthopsychiatry, 68, 201215.Google Scholar
Essock, S. M., Frisman, L. K. & Kontos, N.J. (1998) Cost-effectiveness of assertive community treatment teams. American Journal of Orthopsychiatry, 68, 179190.Google Scholar
Fenton, F. R., Tessier, L., Struening, E. L., et al (1984) A two-year follow-up of a comparative trial of the cost-effectiveness of home and hospital psychiatric treatment. Canadian Journal of Psychiatry, 29, 205211.Google Scholar
Ford, R., Beadsmoore, A., Ryan, P., et al (1995) Providing the safety net: case management for people with a serious mental illness. Journal of Mental Health, 4, 9197.Google Scholar
Godley, S. H., Sabin, M. C., McClure, C., et al (1988) Paid friends for frequent recidivists: an evaluation of a multifaceted community aide program. Psychosocial Rehabilitation Journal, 11, 2939.Google Scholar
Holloway, F. & Carson, J. (1998) Intensive case management for the severely mentally ill. Controlled trial. British Journal of Psychiatry, 172, 1922.Google Scholar
Holloway, F., Oliver, N., Collins, E., et al (1995) Case management: a critical review of the outcome literature. European Psychiatry, 10, 113128.CrossRefGoogle ScholarPubMed
Hoult, J., Reynolds, I., Charbonneau Powis, M., et al (1983) Psychiatric hospital versus community treatment: the results of a randomised trial. Australia and New Zealand Journal of Psychiatry, 101, 160167.Google Scholar
Hu, X., Xiong, W., Fei, L., et al (1994) Comprehensive family treatment for schizophrenic patients: a prospective, randomised, single-blind control trial of 63 patients. Chinese Mental Health Journal, 8, 210215.Google Scholar
Jerrell, J. M. (1995) Towards managed care for persons with severe mental illness: implications from a cost-effectiveness study. Health Affairs, 14, 197207.Google Scholar
Jerrell, J. M. & Hu, T. (1989) Cost-effectiveness of intensive clinical and case management compared with an existing system of care. Inquiry, 26, 224234.Google Scholar
Jerrell, J. M. & Ridgely, M. S. (1995) Comparative effectiveness of three approaches to serving people with severe mental illness and substance abuse disorders. Journal of Nervous and Mental Disease, 183, 566576.Google Scholar
Kluiter, H., Giel, R., Nienhuis, F. J., et al (1992) Predicting feasibility of day treatment for unselected patients referred for inpatient psychiatric treatment. Results of a randomized trial. American Journal of Psychiatry, 149, 11991205.Google Scholar
Lafave, H. G., de Souza, H. R., Gerber, G. J. (1996) Assertive community treatment of severe mental illness: a Canadian experience. Psychiatric Services, 47, 757759.Google Scholar
Lehman, A. F. & Steinwachs, D. M. (1998) Survey co-investigators of the PORT project: patterns of usual care for schizophrenia: initial results from the schizophrenia patient outcomes research team (PORT) client survey. Schizophrenia Bulletin, 24, 1120.Google Scholar
Lehman, A. F., Dixon, L. B., Kernan, E., et al (1997) A randomized trial of assertive community treatment for homeless persons with severe mental illness. Archives of General Psychiatry, 54, 10381043.Google Scholar
Marshall, M., Lockwood, A. & Gath, D. (1995) Social services case-management for long-term mental disorders: a randomised controlled trial. Lancet, 345, 409412.CrossRefGoogle ScholarPubMed
Mueser, K. T., Bond, G. R., Drake, R. E., et al (1998) Models of community care for severe mental illness: a review of research on case management. Schizophrenia Bulletin, 24, 3773.CrossRefGoogle ScholarPubMed
Muijen, M., Marks, I. & Connolly, J. (1992) Home-based care and standard hospital care for patients with severe mental illness: a randomised control trial. BMJ, 304, 749754.CrossRefGoogle Scholar
Muijen, M., Cooney, M., Strathdee, G., et al (1994) Community psychiatric nurse teams: intensive support versus generic care. British Journal of Psychiatry, 165, 211217.Google Scholar
Mulrow, C. D. & Oxman, A., (eds) (1997) How to Conduct a Cochrane Systematic Review, Version 3.0.2. San Antonio, FL. Cochrane Collaboration. Updated as Cochrane Reviewers Handbook 4.1.5 (eds Clarke, M. & Oxman, A. D.) Cochrane Library, issue 2. Oxford: Update Software. http://www.cochrane.org/cochrane/hbook.Google Scholar
Otero, V. & Rebolledo, S. (1993) Evaluación de un programa de rehabilitación psiquiatrica. Psiquis, 14, 273280.Google Scholar
Paykel, E. S., Mangen, S. P., Griffith, J. H., et al (1982) Community psychiatric nursing for neurotic patients: a controlled trial. British Journal of Psychiatry, 140, 573581.Google Scholar
Quinlivan, R., Hough, R., Crowell, A., et al (1995) Service utilization and costs of care for severely mentally ill clients in an intensive case management program. Psychiatric Services, 46, 365371.Google Scholar
Rosenheck, R., Neale, M., Leaf, P., et al (1995) Multisite experimental cost study of intensive psychiatric community care. Schizophrenia Bulletin, 21, 129140.Google Scholar
Salkever, D., Domino, M. E., Burns, B. J., et al (1999) Assertive community treatment for people with severe mental illness: the effect on hospital use and costs. Health Services Research, 34, 577601.Google ScholarPubMed
Solomon, P. & Draine, J. (1995) The efficacy of a consumer case management team: 2-year outcomes of a randomized trial. Journal of Mental Health Administration, 22, 135146.Google Scholar
Stein, L. I. & Test, M. A. (1980) Alternative to mental hospital treatment: I. Conceptual model, treatment program, and clinical evaluation. Archives of General Psychiatry, 37, 392397.Google Scholar
Tyrer, P. (2000) Are small case-loads beautiful in severe mental illness? British Journal of Psychiatry, 177, 386387.Google Scholar
Tyrer, P., Morgan, J., Van Horn, E., et al (1995) A randomised controlled study of close monitoring of vulnerable psychiatric patients. Lancet, 345, 756759.Google Scholar
Van Minnen, A., Hoogduin, C. A. & Broekman, T. G. (1997) Hospital vs. outreach treatment for patients with mental retardation and psychiatric disorders: a controlled study. Acta Psychiatric Scandinavica, 95, 515522.CrossRefGoogle ScholarPubMed
Wood, P. A., Hurlburt, M. S., Hough, R. L., et al (1998) Longitudinal assessment of family support among homeless mentally ill participants in a supported housing program. Journal of Community Psychology, 26, 327344.3.0.CO;2-Q>CrossRefGoogle Scholar
Figure 0

Table 1 Study characteristics

Figure 1

Table 2 Studies' reported hospitalisation findings1

Figure 2

Table 3 Experimental team characteristics1

Figure 3

Table 4 Community Mental Health Team (CMHT) control team characteristics1

Figure 4

Table 5 Meta-analyses: comparative (difference in mean hospital days) and experimental (mean hospital days)

Submit a response

eLetters

No eLetters have been published for this article.