Skip to main page content

• HOME
• Current
• Archive
• Feedback
• Subscribe
• Help

The British Journal of Psychiatry (2006) 189: 65-73. doi: 10.1192/bjp.bp.105.012641
© 2006 The Royal College of Psychiatrists

This Article Abstract Full Text (PDF) A corrigendum has been published Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Related articles in BJP Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via CrossRef Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Latimer, E. A. Articles by Xie, H. Search for Related Content PubMed PubMed Citation Articles by Latimer, E. A. Articles by Xie, H.

Generalisability of the individual placement and support model of supported employment: results of a Canadian randomised controlled trial

Eric A. Latimer, PhD

Douglas Hospital Research Centre and McGill University

Tania Lecomte, PhD

University of British Columbia, Canada

Deborah R. Becker, MEd and Robert E. Drake, MD, PhD

New Hampshire-Dartmouth Psychiatric Research Center, USA

Isabelle Duclos, PsEd

Douglas Hospital Research Centre

Myra Piat, PhD

Douglas Hospital Research Centre and McGill University

Nicole Lahaie, MSc, Marie-Sylvie St-Pierre, MA and Claude Therrien, BSc

Douglas Hospital, Canada

Haiyi Xie

New Hampshire-Dartmouth Psychiatric Research Centre, USA

Correspondence: Eric A. Latimer, PhD, Director, Services, Policy and Population Health Research Theme, Douglas Hospital Research Centre, Assistant Professor, Department of Psychiatry, McGill University, 6875 LaSalle Blvd, Verdun, Québec, Canada H4H1R3. Tel: +1 514 761 6131 x2351; Fax: +1 514 762 3049; email: eric.latimer{at}douglas.mcgill.can

Declaration of interest None.

Funding detailed in Acknowledgements.

TOP ABSTRACT INTRODUCTION METHOD RESULTS DISCUSSION ACKNOWLEDGMENTS REFERENCES

 
Background Studies conducted in the USA have found the individual placement and support model of supported employment to be more effective than traditional vocational rehabilitation at helping people with severe mental illness to find and maintain competitive employment.

Aims To determine the effectiveness of the individual placement and support (supported employment) model in a Canadian setting.

Method A total of 150 adults with severe mental illness, who were not currently employed and who desired competitive employment, were randomly assigned to receive either supported employment (n=75) or traditional vocational services (n=75).

Results Over the 12 months of followup, 47% of clients in the supported employment group obtained at least some competitive employment, v. 18% of the control group (P < 0.001). They averaged 126 h of competitive work, v. 72 in the control group (P < 0.001).

Conclusions Supported employment proved more effective than traditional vocational servicesin a setting significantly different from settings in the USA, and may therefore be generalised to settings in other countries.

TOP ABSTRACT INTRODUCTION METHOD RESULTS DISCUSSION ACKNOWLEDGMENTS REFERENCES

 
Surveys indicate that most people with severe mental illness would like to work (Hatfield et al, 1992; Lehman, 1995), but only about 10-20% actually do so, at least in Europe (Marwaha et al, 2004). Individual placement and support, a form of supported employment for people with severe mental illness (Becker & Drake, 2003), has been shown in several experimental studies to be more effective than traditional approaches at enabling people with severe mental illness to work in competitive settings (Drake et al, 1999; Crowther et al, 2001; Lehman et al, 2002; Twamley et al, 2003; Mueser et al, 2004). Randomised trials published to date, however, have all been carried out in the USA. Cross-country differences in rules governing income and benefits for people with disabilities, employment opportunities and other factors could influence the relative effectiveness of supported employment.

This article reports on a randomised controlled trial of supported employment conducted in Montreal, Canada. Our main hypothesis was that supported employment would remain more effective than standard vocational rehabilitation services in terms of competitive employment outcomes. We also hypothesised that competitive employment might improve symptoms, quality of life, self-esteem, social support, client functioning and substance misuse outcomes.

TOP ABSTRACT INTRODUCTION METHOD RESULTS DISCUSSION ACKNOWLEDGMENTS REFERENCES

 
Study setting
The study was carried out at the Douglas Hospital, a teaching psychiatric hospital in Montreal, Canada. The hospital provides psychiatric treatment and rehabilitation services to people who live within a geographical sector in the south-west of Montreal. In addition to one central facility, which provides in-patient as well as various out-patient services, the hospital operates seven satellite out-patient clinics and a vocational rehabilitation centre located about 1 mile from the main facility.

Planned interventions
Supported employment
Participants allotted to the supported employment condition were assigned an employment specialist attached to their clinical service. The employment specialist helped the client to:

1. define a competitive job corresponding to his or her interests and capabilities;
   
2. obtain such a job;
   
3. continue in employment, once a job was obtained;
   
4. recover from job loss, identifying what went wrong and looking for a new employment opportunity.
   

Employment specialists were integrated into their client's clinical team and thus could easily communicate with the client's case manager or psychiatrist to coordinate services. Each of the four employment specialists was assigned to two out-patient services, among a set of eight: four of the seven satellite out-patient clinics, an assertive community treatment team, a programme to support clients living in foster homes, the hospital's general out-patient department and a case management programme for people who had been discharged from a residential programme. Each had a case-load of about 20. Employment specialists met weekly as a team with their supervisor to discuss challenges with particular people on their case-loads, help each other through exchanging job leads, etc.

Employment specialists received initial training in the model, in some cases including on-site visits to successful USA programmes in Hartford, Connecticut, and Lebanon, New Hampshire. For approximately the first 1.5 years of operation, employment specialists also received ongoing telephone and in-person consultation with one of the authors (D.B.).

The decision to implement a supported employment programme was made by the hospital administration. The research team was assembled subsequently, and had no influence over engagement and retention of supported employment staff, decisions which were in any event constrained by union rules.

Usual vocational services
Clients assigned to the control group were invited to an interview at the hospital's vocational rehabilitation centre. There they were given an opportunity to sign up for one of the many vocational services normally available. These included sheltered workshops, creative workshops, a client-run boutique and horticultural programmes. Job-finding-skills training, as well as psychosocial interventions administered through two day-treatment centres, were also available. None of these programmes had competitive employment as their immediate goal.

In addition, clients could be offered a social integration measure, that is a Québec government programme that offers clients part-time work in competitive settings, in exchange for a Can$120 top-up to their monthly welfare cheque and a free public transport pass. Finally, clients could also be referred to a non-profit community agency that sought to place clients either in competitive jobs or in government-subsidised adapted businesses, in which wages equal or exceed the legal minimum wage but where the majority of jobs are reserved for people who have disabilities. This agency was not integrated with clinical services, nor did it provide ongoing support to clients, two hallmarks of supported employment.

After their initial interview at the hospital's vocational centre, clients assigned to the control condition were left to avail themselves of this array of services as they chose, reflecting usual practice at the hospital.

Study participants
Study recruitment methods were based on those suggested by Drake et al (1994). To participate in the study, clients had to attend two introductory meetings, offered at various times and locations each week between January 2001 and February 2003. The meetings were advertised through clients' case managers, flyers posted on bulletin boards and pizza parties targeting all eligible clients at specific sites. Thus, any individuals interested in working could enter the study, regardless of their case managers' beliefs concerning their suitability for work. At the conclusion of the first introductory meeting, clients who were potentially interested in participating in the study were asked to sign a consent form allowing the research team to check their eligibility. Individuals who met study inclusion and exclusion criteria (see below), and who were able to answer a set of questions concerning the study, were invited to sign the consent form indicating their willingness to participate at the conclusion of their second introductory meeting. Clients who agreed that their eligibility could be checked, but who did not proceed to sign up for the study, did not differ from study participants on any of the variables used as inclusion or exclusion criteria.

Inclusion and exclusion criteria
To be included in the study, individuals had to:

1. be between 18 and 64 years of age;
   
2. have a diagnosis of schizophrenia-spectrum disorder (schizophrenia, schizoaffective disorder, schizophreniform disorder, psychosis not otherwise specified), bipolar disorder, or major depression;
   
3. if their principal diagnosis was one of major depression, be classified as disabled due to mental illness by the provincial welfare system;
   
4. express interest in competitive employment; and
   
5. be unemployed at the time of signing the consent form.
   

Individuals were excluded who:

1. had a learning disability (IQ<70);
   
2. had a physical or organic handicap that seriously impeded work; or
   
3. did not have a case manager willing to see them at least once per month.
   

Randomisation procedure
Stratified randomisation was used, with two factors that were expected to influence vocational outcomes: previous work history (1 year of continuous work experience at some point in the past, or less) and clinical site. Earlier studies suggested that previous work history could influence success in finding work (Drake et al, 1996a; Bond et al, 2001). The varying intensities of different clinical teams (from multiple contacts per week at the assertive community treatment team to as few as one per month at the satellite out-patient teams), and the fact that different employment specialists were assigned to different clinical teams, were thought likely to influence outcomes. The biostatistician associated with the study (H.X.) generated 16 random assignment sequences (one for each study site x work history combination) and emailed them to the project secretary. The secretary who kept the 16 sequences indicated to the project coordinator (I.D.) the group to which a new study participant was to be assigned, according to that person's clinical site and work history. The project coordinator then prepared an opaque envelope containing the assignment and gave it to the interviewer before the baseline interview. Assignment was revealed (to both interviewer and participant) at the conclusion of the baseline interview.

Masking
Because of the nature of the intervention and of some of the questions asked, we did not attempt to mask interviewers to group assignment. Interviewers were not, however, reminded or told (in the case of a change in interviewer subsequent to the baseline interview) of a client's group assignment. Interviewers were aware of the main hypotheses the trial was intended to test, but they had no stake in the outcome of the study.

Contamination
No preliminary results were released, including to supported employment staff, until data collection had been completed, in order to minimise the risk of contamination. Supported employment staff did, however, keep track of their own employment outcomes.

Measures
Comprehensive measures were obtained, from clients and staff, concerning vocational and non-vocational domains. Face-to-face interviews were conducted with clients and staff at baseline, 6 months and 12 months. In addition, telephone interviews to assess vocational outcomes were conducted at 2-month intervals.

Diagnostic and background information
All study clients had one or more psychiatric diagnosis in their hospital records. Trained research assistants reviewed patient charts using the Structured Clinical Interview for DSM-IV Disorders checklist (SCID; First et al, 1997) to validate the principal diagnosis. Other background data (demographics, work experience during the 5 years before study entry) were obtained during the baseline interview.

Employment outcomes
Clients were interviewed at 2-month intervals to ascertain job start and end dates, hours per week, salary conditions and type of work. Corroborating information that could have been obtained from supported employment staff was not used, so as to render data collection procedures the same for the two groups - there was no equivalent corroborating source of information for control participants. Jobs were categorised as competitive if:

1. they paid the minimum wage or better, or on a commission basis (e.g. sales);
   
2. they were not reserved for people with disabilities; and
   
3. fewer than 50% of the person's coworkers had disabilities (information ascertained by contacting the employer directly).
   

Self-employment (one client in the usual-services group attempted to start a bicycle repair shop) was also classified as competitive. Other jobs were classified as non-competitive. Job type was coded according to the Dictionary of Occupational Titles (US Department of Labor and Employment and Training Administration Affairs, 1991).

Non-vocational outcomes
Quality of life, social network, self-esteem and psychiatric symptoms were assessed by means of interviews with clients conducted at baseline, 6 months and 12 months. The Canadian version of the Wisconsin Quality-of-Life scale contains 58 items grouped into 8 subscales: general life satisfaction, activities and occupations, psychological well-being, symptoms, physical health, social support, finances and activities of daily living (Becker et al, 1993; Diaz & Mercier, 1996; Caron et al, 2003). The total score is scaled between -3 and 3, a higher number indicating better self-perceived quality of life. Social network information was assessed using a standard 24-item scale, the Social Provision Scale (Cutrona & Russell, 1987), the items of which fall into 6 subscales: attachment, social integration, reassurance of worth, material support, advice and information, and need to feel useful. The Self-Esteem Rating Scale (Nugent & Thomas, 1993; Lecomte et al, 2006) contains 40 items each on a 7-point scale. The total score can be positive or negative, with a higher score indicating greater self-esteem. Interviewers (eight in total over the course of the study) were trained to carry out the 24-item Brief Psychiatric Rating Scale (BPRS; Ventura et al, 1993; Miller & Faustman, 1996). Twenty-five BPRS interviews were carried out jointly between interviewers and the project coordinator to assess interrater reliability. Interrater reliability was very good, with intraclass correlation coefficients ranging between 0.96 for the negative symptom subscale and 0.98 for the positive symptom and depression anxiety subscales, and reaching 0.99 for the total score.

Overall functioning was evaluated through interviews with clinicians rather than clients, using the Global Assessment of Functioning (GAF) scale (American Psychiatric Association, 1994) as well as the Multnomah Community Ability Scale (MCAS; Barker & Barran, 1997; Corbiére et al, 2002). The GAF is a one-dimensional scale ranging between 0 and 100, with higher scores reflecting better adjustment. The MCAS has 17 items, which yield 4 subscales: interference with functioning, adjustment to living, social competence and behavioural problems. To assess substance misuse, clinicians also completed with the interviewer two one-dimensional rating scales: the Alcohol Use Scale (AUS) and Drug Use Scale (DUS) (Drake et al, 1996b). Each of these scales has five levels, based on the DSM criteria for alcohol and drug use disorders, ranging from abstinence to severe dependence (dependence with institutionalisation) (Drake et al, 1996b).

Programme fidelity
This was assessed on two occasions using the Supported Employment Fidelity Scale (Bond, 1997), 11 months and 2.5 years after the programme was initiated. The two ratings were consensus ratings between two different pairs of investigators (D.B. and E.L.; N.L. and E.L.), and were based on information from the programme manager and direct observation of programme functioning. Both ratings indicated good implementation of individual placement and support (72 and 70.5, out of 75).

Research attrition, programme exposure and programme retention
Figure 1 shows the flow of study participants through the trial. Interview completion rates were not significantly different at either 6 months or 12 months.

View larger version (36K): [in this window] [in a new window] [as a PowerPoint slide]

Fig. 1 Progress through stages of the trial. R, indicates randomisation. Estimate for introductory session was based on numbers collected during recruitment of one-third of participants.

We assessed programme exposure using administrative hospital data. Individuals were considered to have received supported employment services (or usual services) if they were recorded as having had at least one contact with supported employment staff (or usual services staff) over the first and the second 3-month follow-up periods. Using this criterion, 68 study participants were exposed to supported employment (91%), and only 22 (30%) to usual services.

Retention in supported employment was determined according to whether clients received any services from their employment specialist during a 6-month period. Retention in supported employment was 100% during the first 6 months, and 92% during the final 6 months. Since usual vocational services consisted of people accessing whatever services they were interested in, we considered that all individuals who were assigned to usual services remained in them until the end, unless they moved from the geographical area served by the Douglas hospital. Using this criterion, retention in usual services was 97% over the first year.

Statistical analyses
Baseline comparisons
In order to assess baseline equivalence of the groups, proportions of categorical variables at baseline were compared according to initial group assignment using ²-tests. Values of continuous measures were compared using either the t-test or, for non-normally distributed variables, the (non-parametric) Mann-Whitney U-test.

Vocational outcomes
Intention-to-treat analyses were conducted first, including all individuals and time periods for which we had data. Groups were compared on measures pertaining to any paid work (competitive or not) and competitive work only.

In order to compare employment trends, we estimated generalised linear mixed models, treating employment as a dichotomous variable (either some paid employment or none during successive 1-month periods, either some competitive employment or none), using a logit link function with a binomial distribution. These models were estimated using maximum likelihood methods, with the likelihood based on available data. Observations with one or more missing values were then kept in the analysis, but there was no imputation of missing values (Vonesh, 1992; Littel et al, 1996).

The models were estimated with and without a set of adjusters, including standard demographic variables, diagnosis, the two stratification variables and self-esteem at baseline. The latter variable was included because, as indicated below, it differed significantly between the two groups.

Although research attrition was not significantly different between the two groups, it was somewhat greater in the supported employment group (Fig. 1). It is reasonable to suppose that individuals who left supported employment during the course of the study had relatively poor subsequent employment experiences. Accordingly, as a sensitivity analysis, we re-estimated the models assuming that missing values for employment status were all zero.

The models were then re-estimated, including only individuals who had some exposure (as described above) to the supported employment model or usual services.

Because of the large number of zeroes and the positive skews of the distributions, we used Mann-Whitney U-tests to compare total hours worked in employment (paid or competitive), and total earnings (paid or competitive). Finally, we used a ²-test to compare the distributions of jobs according to type of job, as classified using the first digit of the Dictionary of Occupational Titles codes, and Mann-Whitney U-tests to compare job duration by job type.

Non-vocational outcomes
We also estimated mixed effects regression models to evaluate the effect of group assignment on non-vocational outcomes. Group assignment, time (treated as a continuous variable) and a time x group interaction term were used to predict repeated measures of the non-vocational variables. These variables enabled us to estimate, respectively, the average effect over time of group assignment on each vocational variable, the time trend for each group following baseline, and any difference in the time trends between the two groups. These models were also estimated with and without adjusters, using the same set of adjusters as before, plus the baseline value of the dependent variable.

Analyses were carried out using the Statistical Package for the Social Sciences for Windows, version 11.5, except for estimation of mixed-effects models, which relied on the PROC GLINMIX routine in, SAS for Windows, version 9.1.

Ethical approval
The research protocol and consent forms were approved by the Douglas Hospital Research Ethics Board.

TOP ABSTRACT INTRODUCTION METHOD RESULTS DISCUSSION ACKNOWLEDGMENTS REFERENCES

 
Table 1 compares the two groups at baseline in terms of sociodemographic and other measures. Using Simes' correction for comparisons of multiple outcomes, which is less conservative but more accurate than the Bonferroni correction (Simes, 1986; Samuel-Cahn, 1996), only self-esteem emerges as statistically different between the two groups: it is markedly lower in the experimental group. Results not shown indicate that this difference arose from many observations, not a few outliers, and that the difference continued to manifest itself throughout the recruitment period.

View this table: [in this window] [in a new window]

Table 1 Baseline comparability of the supported employment (n=75) and control (n=74) groups

Figure 2a shows actual percentages of clients in each group who had at least some paid employment during each successive month of the study, and Fig. 2b illustrates the same for competitive employment only. The figures also show 95% confidence intervals, calculated independently for each month, using the method of Agresti & Coull (1998). (Actual percentages at each month are shown; Agresti & Coull intervals are not quite symmetrical around the actual percentages.) Although there is considerable overlap in the confidence intervals for any paid work, and some overlap for competitive employment, supported employment clients exhibited higher employment rates in each of the 12 months. The difference is much more pronounced for competitive employment.

View larger version (30K): [in this window] [in a new window] [as a PowerPoint slide]

Fig. 2 Month-by-month employment rates with 95% confidence intervals, for (a) any paid work, (b) competitive employment only. Unbroken lines, supported employment group; broken lines, usual services.

Table 2 compares the two groups on employment outcomes. The differences on competitive employment outcomes clearly favour supported employment; those for any paid work favour supported employment but are not statistically significant.

View this table: [in this window] [in a new window]

Table 2a Differences in outcomes for any paid employment between usual services and supported employment

View this table: [in this window] [in a new window]

Table 2b Differences in outcomes for competitive employment between usual services and supported employment

Odds ratios from generalised linear mixed models, with and without covariates, for any paid employment as well as competitive employment, are shown in Table 3. Whether covariates are included or not, supported employment does not have a statistically significant independent effect on the likelihood of having paid employment in a given month. None of the covariates is statistically significant (all of the 95% confidence intervals include the value 1). In contrast, the results for competitive employment, consistent with Fig. 2b, reflect higher rates of competitive employment in the supported employment group, with an initially sharper rate of increase showing a greater decelerating trend towards the end of the year. Among the covariates, only age is statistically significant, with increasing age associated with lower rates of success in obtaining competitive employment.

View this table: [in this window] [in a new window]

Table 3 Odds ratios (95%, CIs) from estimated generalised mixed linear models to predict monthly employment status, any paid and competitive employment (n=149, 12 months)

Results not shown indicate that, if missing values are replaced with zeroes in the analysis comparing monthly competitive employment rates, the P-value of the supported employment group x time interaction term rises to 0.07. Also, if the six individuals with almost no exposure to supported employment and the 53 individuals with almost no exposure to usual services, as defined above, are removed from the analysis, the effect of the supported employment model is no longer statistically significant.

Mixed-effects models reveal no effect of group assignment on symptoms, quality of life, social support, measures of functioning (GAF and MCAS) or the substance misuse measures (results not shown). They do, however, indicate a statistically significant significant time x group interaction for self-esteem (P < 0.01); this variable, initially lower in the supported employment group, rises with time (means: 25.6, 31.7, 47.2), whereas it shows a non-significant declining trend in the usual services group (48.2, 46.2, 42.3). There is, however, within the supported employment group no statistically significant correlation between, on the one hand, the change in self-esteem score between baseline and 12 months, or on the other hand, either hours in any paid employment (n=54, Spearman's =-0.03, P=0.80), hours of competitive employment (n=54, Spearman's =0.08, P=0.55) or number of contacts with supported employment staff over 12 months (n=54, Spearman's =0.08, P=0.56).

Finally, Table 4 compares the distributions of competitive jobs and hours worked across occupational categories. The distribution of types of jobs is quite similar between the two groups, with slightly more than one-third of jobs in clerical and sales occupations, and a similar proportion in services occupations (e.g. cleaning, waiting on tables). More dissimilarity is apparent in the distribution of hours: 17% of hours that are in service jobs in the control group were replaced in the supported employment group with hours in other occupational categories. The more dissimilar distribution of hours than of jobs across occupational categories arises, mathematically, from the proportionally shorter duration of service jobs in the supported employment group. The differences between groups in hours per job, however, are not statistically significant in any of the occupational categories.

View this table: [in this window] [in a new window]

Table 4 Number and duration of competitive jobs according to type of work and according to group assignment

TOP ABSTRACT INTRODUCTION METHOD RESULTS DISCUSSION ACKNOWLEDGMENTS REFERENCES

 
Main study findings
Consistent with previous studies in the USA the present trial found that the individual placement and support model yields significantly better competitive employment outcomes than the alternative it was compared with, in this case a wide array of traditional vocational services. People assigned to the supported employment condition were much more likely to engage in vocational activities, and significantly more of them achieved at least some competitive employment over their first 12 months in the programme.

As in previous studies, however, a significant proportion (here, 53%) of the supported employment clients were unable to achieve any competitive employment over their first year in the programme. Only a small minority (13%) were able to average even 5 h work per week over the 1-year follow-up period. These findings underscore the importance of ongoing studies of potential enhancements to the model, such as the incorporation of cognitive remediation (McGurk et al, 2005; Nuechterlein et al, 2005).

Again as in previous studies, the large number of people who did not work or worked only to a minimal extent in each study condition probably helps to explain why no differences emerged between the groups on any of the non-vocational measures we examined, with the singular exception of self-esteem. The use of Nugent and Thomas' (1993) Self-Esteem Rating Scale, as opposed to Rosenberg's (1965) Self-Esteem Scale, which has been used in several previous studies of this model but has been reported as relatively insensitive to change (Torrey et al, 2000), may partly account for this finding. The markedly lower self-esteem at baseline of the experimental group complicates interpretation, however. The observed rise in self-esteem in the experimental group could be due in part to regression to the mean, a hypothesis consistent with the absence of correlation between change in self-esteem and hours of work (any paid work or competitive work) or number of contacts with support staff.

Implications for generalisability of supported employment
Evidence on the effectiveness of individual placement and support outside the USA has until now been very limited. One recent British study, using a pre-post design, found that integrating a high-fidelity individual placement and support component into an early intervention service for young people with first-episode psychosis increased the open employment rate from 10% to 28% in 6 months (Rinaldi et al, 2004). The present study, however, is the first randomised trial of the model to be carried out outside the USA. The province of Québec's somewhat European-style approach to social policy provides an environment for vocational rehabilitation that differs from that in the USA in several respects. On the one hand, study participants had no reason to fear losing medical insurance, including coverage of most hospital and physician services as well as medications. On the other hand, however, there are also at least three important differences that would be expected to reduce the comparative effectiveness of the model. First, unlike in the USA, people with disabilities in Québec have no economic incentive to work more than a few hours per week, with monthly earnings above Can$100 subtracted dollar-for-dollar from their monthly disability cheque. Furthermore, free public transportation passes are available only to those who engage in sheltered programmes but not competitive work or work in the adapted businesses mentioned earlier. Second, many alternative vocational programmes are available, including adapted businesses as well as social firms, which offer real jobs that pay at the minimum wage or better, but where most employees have disabilities. Third, as in many European countries, unemployment rates are chronically high, remaining at about 8% throughout the study period.

The fact that supported employment proved significantly more effective in such an institutional environment suggests that it may well prove more effective than traditional programmes at helping clients achieve competitive employment in countries outside the USA.

The impact of supported employment on competitive employment outcomes reported here, however, is not as large as that found in most previous studies. In a systematic review summarising results from five trials comparing supported employment with pre-vocational training, Crowther et al (2001) reported cumulative rates of competitive employment of 70% (130 out of 187) at 6 months and 65% (165 out of 252) at 12 months, compared with 36% (27 out of 75) and 47% (35 out of 75) in our study (P < 0.005 for both differences). They also report that, during the 12th month, 34% of clients in supported employment were employed, consistent with another recently published randomised trial conducted in Hartford, Connecticut (Mueser et al, 2004). In contrast we observed 22% employed in competitive settings at 12 months; in no month did more than 27% of clients for whom we had data spend at least some time in competitive employment. Among published randomised trials of supported employment only one reports competitive employment rates in the supported employment condition quite similar to ours (Cook et al, 2005), and another reports lower rates: Lehman et al (2002) show a competitive employment rate of about 11% in the 12th month of their study, in inner-city Baltimore, Maryland.

At least two types of factors may account for the somewhat lower rates of competitive employment reported here: differences in institutional environments and implementation issues.

Differences in institutional environments, which could on balance have reduced the effectiveness of the model in comparison with that in the USA, have already been described. With regard to implementation, although the supported employment programme quickly achieved and maintained a high score on the Supported Employment Fidelity Scale, the programme was launched at the same time as the study and thus, for early study participants, supported employment staff may have been less effective than they later became. In addition, supported employment staff were open to helping clients who so desired to find non-competitive work - as reflected in much higher rates for any paid than for competitive employment even in the supported employment group. Indeed, the rich array of available alternatives to competitive employment appears to have somewhat diminished the relative attractiveness of competitive employment for clients and even, particularly at the beginning, for the supported employment staff. Further, the staff report that many clients appeared not to have understood the difference between competitive and non-competitive employment when they agreed to participate in the study, despite the explanations given during the recruitment process.

One likely implication of the comparatively low effectiveness of the supported employment model in our setting is that its cost-effectiveness will be reduced. A report on this question is in preparation.

Study limitations
Four methodological limitations should be noted. Interviewers were aware, after the baseline interview, of the group assignment of at least some clients. However, employment data are objective in nature and were collected in the same way for both groups. Most of the non-vocational measures were based on questionnaire responses by clients and involved no interviewer judgement. Interrater reliability ratings for the BPRS were excellent. Second, somewhat more participants in the supported employment group dropped out of the study, although the difference is not statistically significant. We were able to verify, however, that our results are reasonably robust to a worst-case scenario in which all missing observations on employment correspond to zero values. Third, there was a significant difference in self-esteem scores between the two groups at baseline. We can only attribute this difference to chance, as neither the interviewer nor the client was aware of group assignment during the interview. Adjusting for this difference did not alter the results. Finally, the supported employment programme was started at the same time as the study. A more mature programme might well have produced a larger difference between the groups.

In conclusion, we found that supported employment remains considerably more effective than traditional vocational services at helping clients obtain competitive employment, even in a setting more similar to those found in many European countries than to those in the USA. The supported employment model may then prove more effective than traditional vocational programmes at promoting competitive employment for people with severe mental illness in countries outside the USA.

TOP ABSTRACT INTRODUCTION METHOD RESULTS DISCUSSION ACKNOWLEDGMENTS REFERENCES

 
This study was funded by the Canadian Institutes of Health Research, the Québec Health Research Fund and AETMIS.

TOP ABSTRACT INTRODUCTION METHOD RESULTS DISCUSSION ACKNOWLEDGMENTS REFERENCES

 

1. Agresti, A. & Coull, B. A. (1998) Approximate is better than "exact" for interval estimation of binomial proportions. American Statistician, 52, 119 -126.[CrossRef]
2. American Psychiatric Association (1994) Diagnostic and Statistical Manual of Mental Disorders (4th edn) (DSM-IV). Washington, DC: APA.
3. Barker, S. & Barron, N. (1997) Multnomah Community Ability Scale: A User's Manual. Portland, OR: Network Behavioral Health Care.
4. Becker, D. R. & Drake, R. E. (2003) A Working Life for People with Severe Mental Illness. New York: Oxford University Press.
5. Becker, M., Diamond, R. & Sainfort, F. (1993) A new patient-focused index for measuring quality of life in persons with severe and persistent mental illness. Quality of Life Research, 2, 239 -251.[CrossRef][Medline]
6. Bond, G. R. (1997) A fidelity scale for the individual placement and support model of supported employment. Rehabilitation Counseling Bulletin, 40, 265 -284.
7. Bond, G. R., Becker, D. R., Drake, R. E., et al (2001) Implementing supported employment as an evidence-based practice. Psychiatric Services, 52, 313 -322.[Abstract/Free Full Text]
8. Caron, J., Corbiére, M., Mercier, C., et al (2003) The construct validity of the client questionnaire of the Wisconsin Quality of Life Index - a cross-validation study. International Journal of Methods in Psychiatric Research, 12, 128 -138.[CrossRef][Medline]
9. Cook, J. A., Leff, H. S., Blyler, C. R., et al (2005) Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness. Archives of General Psychiatry, 62, 505 -512.[Abstract/Free Full Text]
10. Corbiére, M., Crocker, A. G., Lesage, A. D., et al (2002) Factor structure of the Mulnomah Community Ability Scale. Journal of Nervous and Mental Disease, 190, 399 -406.[CrossRef][Medline]
11. Crowther, R. E., Marshall, M., Bond, G. R., et al (2001) Helping people with severe mental illness to obtain work: systematic review. BMJ, 322, 204 -208.[Abstract/Free Full Text]
12. Cutrona, C. & Russell, D. (1987) The provisions of social supports and adaptation to stress. Advance in Personal Relationships, 1, 37 -67.
13. Diaz, P. & Mercier, C. (1996) An evaluation of the Wisconsin quality-of-life questionnaires for clinical application and research in Canada. Quality of Life Newsletter, 16, 11-12.
14. Drake, R. E., Becker, D. R. & Anthony, W. A. (1994) A research induction group for clients entering a mental health research project. Hospital and Community Psychiatry, 45, 487 -489.[Free Full Text]
15. Drake, R. E., McHugo, G. J., Becker, D. R., et al (1996a) The New Hampshire Study of Supported Employment for People with Severe Mental Illness: vocational outcomes. Journal of Consulting and Clinical Psychology, 64, 391 -399.[CrossRef][Medline]
16. Drake, R. E., Mueser, K. T. & McHugo, G. (1996b) Clinical rating scales: Alcohol Use Scale (AUS). Drug Use Scale (DUS), and Substance Abuse Treatment Scale (SATS). In Outcomes Assessment in Clinical Practice (eds L. I. Sederer & B. Dickey), pp. 113-116. Baltimore, MD: Williams & Wilkins.
17. Drake, R. E., McHugo, G., Bebout, R., et al (1999) A randomized clinical trial of supported employment for inner-city patients with severe mental disorders. Archives of General Psychiatry, 56, 527 -633.[Abstract/Free Full Text]
18. First, M., Spitzer, R., Gibbon, M., et al (1997) Structured Clinical Interview for DSM-IV Disorders - Patient Edition. New York: Biometric Research Department.
19. Hatfield, A. B., Huxley, P. & Mohamad, H. (1992) Accommodation and employment: a survey into the circumstances and expressed needs of users of mental services in a northern town. British Journal of Social Work, 22, 61-73.[Abstract/Free Full Text]
20. Lecomte, T., Corbiére, M. & Laisné, F. (2006) Investigating self-esteem in individuals with schizophrenia: relevance of the SERS. Psychiatry Research, in press.
21. Lehman, A. F. (1995) Vocational rehabilitation in schizophrenia. Schizophrenia Bulletin, 21, 645 -656.[Abstract/Free Full Text]
22. Lehman, A. F., Goldberg, R., Dixon, L. B., et al (2002) Improving employment outcomes for persons with severe mental illness. Archives of General Psychiatry, 59, 165 -172.[Abstract/Free Full Text]
23. Littell, R. C., Milliken, G. A., Stroup, W. W., et al (1996) SAS System for Mixed Models. Cary, NC: SAS Institute.
24. Marwaha, S. & Johnson, S. (2004) Schizophrenia and employment: a review. Social Psychiatry and Psychiatric Epidemiology, 39, 337 -349.[CrossRef][Medline]
25. McGurk, S. R., Mueser, K. T. & Pascaris, A. (2005) Cognitive training and supported employment for persons with severe mental illness: one year results from a randomized controlled trial. Schizophrenia Bulletin, 31, 898 -909.[Abstract/Free Full Text]
26. Miller, L. S. & Faustman, W. O. (1996) Brief Psychiatric Rating Scale (BPRS). In Outcomes Assessment in Clinical Practice (eds L. I. Sederer & B. Dickey). Williams & Wilkins.
27. Mueser, K., Clark, R., Haines, M., et al (2004) The Hartford study of supported employment for persons with severe mental illness. Journal of Consulting and Clinical Psychology, 72, 479 -490.[CrossRef][Medline]
28. Nuechterlein, K. M., Subotnik, K. L., Ventura, J., et al (2005) Advances in improving and predicting work outcome in recent-onset schizophrenia. (abstract) Schizophrenia Bulletin, 31, 530 .
29. Nugent, W. R. & Thomas, J. W. (1993) Validation of a clinical measure of self-esteem. Research on Social Work Practice, 3, 191 -207.[Abstract/Free Full Text]
30. Rinaldi, M., McNeil, K., Firn, M., et al (2004) What are the benefits of evidence-based supported employment for patients with first-episode psychosis? Psychiatric Bulletin, 28, 281 -284.[Abstract/Free Full Text]
31. Samuel-Cahn, E. (1996) Is the Simes improved Bonferroni procedure conservative? Biometrika, 83, 928 -933.[Abstract/Free Full Text]
32. Simes, R. (1986) An improved Bonferroni procedure for multiple tests of significance. Biometrika, 73, 751 -754.[Abstract/Free Full Text]
33. Torrey, W. C., Mueser, K. T., McHugo, G. H., et al (2000) Self-esteem as an outcome measure in studies of vocational rehabilitation for adults with severe mental illness. Psychiatric Services, 51, 229 -233.[Abstract/Free Full Text]
34. Twamley, E. W., Jeste, D. V. & Lehman, A. F. (2003) Vocational rehabilitation in schizophrenia and other psychotic disorders: a literature review and meta-analysis of randomized controlled trials. Journal of Nervous and Mental Disease, 191, 515 -523.[Medline]
35. US Department of Labor and Employment and Training Administration Affairs (1991) Dictionary of Occupational Titles, vol. 1 (4th edn). Chicago, IL: NTC Publishing Group.
36. Ventura, J., Green, M. F., Shaner, A., et al (1993) Training and quality assurance with the Brief Psychiatric Rating Scale: `The drift busters'. International Journal of Methods in Psychiatric Research, 3, 221-244.
37. Vonesh, E. (1992) Nonlinear models for the analysis of longitudinal data. Statistics in Medicine, 11, 1929 -1954.[Medline]

Received for publication April 25, 2005. Revision received December 1, 2005. Accepted for publication December 19, 2005.

Related articles in BJP:

Highlights of this issue

Sukhwinder S. Shergill
BJP 2006 189: A1. [Full Text]  

This article has been cited by other articles:

				R. Mojtabai, L. Fochtmann, S.-W. Chang, R. Kotov, T. J. Craig, and E. Bromet Unmet Need for Mental Health Care in Schizophrenia: An Overview of Literature and New Data From a First-Admission Study Schizophr Bull, July 1, 2009; 35(4): 679 - 695. [Abstract] [Full Text] [PDF]

				P. Tyrer From the Editor's desk The British Journal of Psychiatry, August 1, 2008; 193(2): 178 - 178. [Full Text] [PDF]

				J. Catty, P. Lissouba, S. White, T. Becker, R. E. Drake, A. Fioritti, M. Knapp, C. Lauber, W. Rossler, T. Tomov, et al. Predictors of employment for people with severe mental illness: results of an international six-centre randomised controlled trial The British Journal of Psychiatry, March 1, 2008; 192(3): 224 - 231. [Abstract] [Full Text] [PDF]

				P. Tyrer Refreshing contradictions and lost in classification. The British Journal of Psychiatry, March 1, 2008; 192(3): 242 - 242. [Full Text] [PDF]

				N. C. Ware, K. Hopper, T. Tugenberg, B. Dickey, and D. Fisher A Theory of Social Integration as Quality of Life Psychiatr Serv, January 1, 2008; 59(1): 27 - 33. [Abstract] [Full Text] [PDF]

				K. Kin Wong, R. Chiu, B. Tang, D. Mak, J. Liu, and S. N. Chiu A Randomized Controlled Trial of a Supported Employment Program for Persons With Long-Term Mental Illness in Hong Kong Psychiatr Serv, January 1, 2008; 59(1): 84 - 90. [Abstract] [Full Text] [PDF]

				M. Rinaldi, R. Perkins, E. Glynn, T. Montibeller, M. Clenaghan, and J. Rutherford Individual placement and support: from research to practice Adv. Psychiatr. Treat., January 1, 2008; 14(1): 50 - 60. [Abstract] [Full Text] [PDF]

				N. H. J. van Erp, F. B. M. Giesen, J. van Weeghel, H. Kroon, H. W. C. Michon, D. Becker, G. J. McHugo, and R. E. Drake A Multisite Study of Implementing Supported Employment in the Netherlands Psychiatr Serv, November 1, 2007; 58(11): 1421 - 1426. [Abstract] [Full Text] [PDF]

				I. Kooyman, K. Dean, S. Harvey, and E. Walsh Outcomes of public concern in schizophrenia The British Journal of Psychiatry, August 1, 2007; 191(50): s29 - s36. [Abstract] [Full Text] [PDF]

				D. Becker, R. Whitley, E. L. Bailey, and R. E. Drake Long-Term Employment Trajectories Among Participants With Severe Mental Illness in Supported Employment Psychiatr Serv, July 1, 2007; 58(7): 922 - 928. [Abstract] [Full Text] [PDF]

This Article Abstract Full Text (PDF) A corrigendum has been published Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Related articles in BJP Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via CrossRef Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Latimer, E. A. Articles by Xie, H. Search for Related Content PubMed PubMed Citation Articles by Latimer, E. A. Articles by Xie, H.