Following widespread deinstitutionalisation of psychiatric services, community treatment orders (CTOs, also known as mandated out-patient treatment, out-patient commitment, assisted out-patient treatment and supervised community treatment) have been introduced in many Western jurisdictions to authorise extended periods of compulsory community care. This has shifted compulsion in hospital away from the centre of mental health law. A CTO requires the patient to adhere to out-patient treatment. The aim is to help patients achieve stability, to control risk and to provide less restrictive alternatives to (repeated) involuntary admission to hospital. Reference Churchill, Owen, Hotopf and Singh1 The main mechanism of enforcement is swift recall to hospital for treatment when required. We reflect on current evidence for CTO effectiveness and implications for practice.
The spread and use of CTOs
Community treatment orders are established in over 70 jurisdictions. They have existed since the 1980s or early 1990s in most parts of North America and Australasia. Reference Churchill, Owen, Hotopf and Singh1,Reference Dawson2 More recently they have been introduced in England and Wales, Norway, Israel, Scotland, Sweden and Switzerland. The legal regimes vary significantly in detail, including whether patients with capacity who object can go on a CTO, the need for prior hospital admissions and the scope of powers conferred over out-patients.
The rate of use of CTOs varies widely between and within jurisdictions. They tend to be used more frequently in Australasia than in North America, with European jurisdictions falling in-between. Within a single jurisdiction, use often varies considerably between regions and individual psychiatrists. It has been suggested that when CTOs are introduced they increase the overall level of coercion in psychiatry. Reference Dawson2
Community treatment orders are often contentious. They generally garner support from families of those with a serious mental illness but meet strong opposition from patient advocates. The views among clinicians are often divided. Reference Burns and Dawson3 Opposition has commonly focused on the patient's right not to have their autonomy restricted rather than on their right to receive adequate care. Recently, the focus of debate has shifted to evidence of CTO effectiveness. Reference Burns and Dawson3,Reference O'Reilly, Vingilis and State4
What does the current evidence say?
Community treatment order laws do not explicitly state the standards to be used to measure their effectiveness. Various measures of hospital use are the most common outcomes applied in published studies. Frequency of contact with out-patient services, victimisation, arrest, mortality and quality of life measures have been investigated in some studies. Literature reviews have not established that CTOs confer advantages for patients. Reference Churchill, Owen, Hotopf and Singh1,Reference Dawson2,Reference Kisely, Campbell and Preston5 The research provides three broad levels of evidence: descriptive studies; case-control studies, involving matched pairs or ‘before and after’ designs; and randomised controlled trials (RCTs).
Descriptive studies
Descriptive studies consist largely of local investigations of CTO patient populations or stakeholder views and include qualitative studies of personal experiences. Many report reductions in readmission rates and improved stability after a number of months. However, the study designs used mean the changes observed cannot confidently be attributed to CTOs. The studies do indicate that the groups of patients on CTOs are remarkably similar across jurisdictions. Patients on CTOs tend to be male, in middle age, diagnosed with schizophrenia, with several prior hospital admissions and a history of non-adherence. Many misuse substances, are single, self-neglecting and relatively isolated. Reference Churchill, Owen, Hotopf and Singh1 This shows that clinicians who use CTOs have similar ideas about whom they think will benefit.
Case-control studies
A number of case-control studies have been conducted, using either matched controls (in controlled before and after (CBA) studies) or patients serving as their own controls (uncontrolled before and after (UBA) studies). These studies report discrepant results regarding outcomes relating to admissions to hospital and community tenure. Most report increases in follow-up with out-patient services and shorter readmissions for patients on CTOs.
Studies of this kind are vulnerable to confounding influences, such as changes that may occur over time in the availability of beds, specialist teams or case management. Reference O'Reilly, Vingilis and State4 Moreover, CBA studies may be confounded by difficulties in matching key patient characteristics such as lack of insight or adherence. The benefits reported by UBA studies may be affected by regression to the mean as the patient may recover regardless of being on a CTO because of the naturally fluctuating course of their condition. Reference O'Reilly, Vingilis and State4 Studies using large available data-sets commonly test numerous hypothesised associations, which increases the likelihood of false positives. Reference Ioannis6 It is often unclear whether any measures (for example Bonferroni corrections or data splitting Reference Dahl, Grotle, Benth and Natvig7 ) have been applied to avoid such problems.
Two large data-sets, one in Victoria, Australia, and another in New York, USA, have been used in a number of studies. The Victoria studies largely report increases in readmission rates, Reference Burgess, Bindman, Leese, Henderson and Szmukler8,Reference Segal and Burgess9 whereas the New York studies generally find reductions. Reference Swartz, Wilder, Swanson, Van Dorn, Robbins and Steadman10 A possible explanation for reduction in readmissions, where observed, is deliberate focusing of extra mental health services on patients on CTOs. If more intensive treatment is offered to patients on CTOs, these studies cannot distinguish with confidence whether the element of compulsion has an independent effect. In the service system recently studied in New York, for instance, assertive outreach, including case management (known to increase patient engagement) Reference Killaspy, Kingett, Bebbington, Blizard, Johnson and Nolan11 was prioritised to those on CTOs. Reference Swartz, Wilder, Swanson, Van Dorn, Robbins and Steadman10 In one Toronto-based study, however, where equal access was provided to case management, better outcomes were found for patients on CTOs. Reference Hunt, da Silva, Lurie and Goldbloom12
A number of studies report improved outcomes when CTOs are sustained for more than 6 months. Reference Swartz, Wilder, Swanson, Van Dorn, Robbins and Steadman10,Reference Hunt, da Silva, Lurie and Goldbloom12-Reference Van Dorn, Swanson, Swartz, Wilder, Moser and Gilbert14 However, selection bias may affect the outcome of these studies if only patients for whom the CTO seems to be working are kept on the order long term. Reference Szmukler and Hotopf15
In brief, the conflicting results and methodological limitations of the case-control studies make it difficult to draw conclusions about CTO effectiveness from this body of evidence as a whole.
RCTs
Randomised controlled trials provide the most rigorous test of treatment effect. They reduce the possible effects of sample bias and regression to the mean and they identify in advance both the hypothesis and the outcome measures to be used. Conducting RCTs of CTOs is challenging for ethical and legal reasons. Reference Dawson, Burns and Rugkåsa16 Only three have been conducted, two in the USA 15 years ago Reference Swartz, Swanson, Wagner, Burns, Hiday and Borum17,Reference Steadman, Gounis, Dennis, Hopper, Roche and Swartz18 and one recently in England (the Oxford Community Treatment Order Evaluation Trial, OCTET). Reference Burns, Rugkåsa, Molodynksi, Dawson, Yeeles and Vazquez-Montes19 Treatment under the CTO was compared with voluntary status (in the trials in the USA) and with discharge via a brief period of hospital leave in preparation for voluntary status (in OCTET) in England. All three trials report that CTOs did not reduce readmission rates over 11-12 months compared with the control condition. Moreover, on time to readmission, total days in hospital, psychiatric symptoms or global functioning, no difference was found in these trials. Patients received case management and close clinical monitoring in both arms of all three trials.
Randomised controlled trials have their own potential limitations, including refusal, attrition and protocol violations. The New York trial experienced considerable problems including a smaller than expected sample size (n = 142), high attrition and lack of adherence to the protocol, making it difficult to draw firm conclusions. The North Carolina trial (n = 264) had a refusal rate of 12% and an 18.2% attrition rate. The control group was ‘immunised’ from placement on a CTO during the follow-up year, and released if inadvertently placed on one. Patients with a history of violence were not randomised. In England, OCTET did not exclude participants on the basis of dangerousness. It had a refusal rate of 20%. Only one of 336 patients withdrew and primary outcome data were obtained for all. It was impossible to control for protocol violations, Reference Dawson, Burns and Rugkåsa16,Reference Burns, Rugkåsa, Molodynksi, Dawson, Yeeles and Vazquez-Montes19 and the treatment of around a quarter of the patients did not follow the randomised condition. A sensitivity analysis removing these patients did not alter the OCTET study findings. Reference Burns, Rugkåsa, Molodynksi, Dawson, Yeeles and Vazquez-Montes19
Aspects of each trial and differences between them may affect their generalisability. The US studies examined court-ordered CTOs and randomised between CTO and voluntary status. OCTET studied clinician-initiated CTOs and randomised between discharge via CTO and via Section 17 leave under the Mental Health Act 1983 (the latter leading to significantly shorter periods under compulsion). The US studies actively excluded a proportion of patients, and OCTET and the New York trials experienced more protocol violations than expected. However, the clear differences in the length of coercion imposed on patients and the comparability of the treatment otherwise received in the two arms of these trials indicate that their common findings - no advantage to CTOs in readmission rates - are comparable and noteworthy. There remains a suggestion (echoing the findings in the CBA studies) that the duration of readmissions may be reduced by CTOs, although this seems variable and requires further testing.
What are the implications?
The current evidence from RCTs suggests that CTOs do not reduce readmission rates over 12 months. Seen in conjunction with the results of case-control studies, this may suggest it is intensive community services, not coercion, that positively affects hospital outcomes. When CTOs restrict patients' autonomy, however, and there is a duty to provide the least restrictive form of treatment, the results of the RCTs must give pause for thought. Settling uncertainties around CTOs will require further high-quality RCTs. Optimum trials need mechanisms under which all eligible patients are randomised, a sufficient sample size, few protocol violations and a study period of sufficient duration to measure longer-term effects. It would be best to measure a wider range of outcomes, including the impact on the quality of life of some of our most vulnerable citizens.
eLetters
No eLetters have been published for this article.