Healthcare Commission, London and Postgraduate Medical School, University of Surrey, Guildford
Healthcare Commission, London
Picker Institute Europe, Oxford
Healthcare Commission, London, UK
Correspondence: Dr Veena S. Raleigh, Healthcare Commission, 103–105 Bunhill Row, London EC1Y 8TG, UK. Email: veena.raleigh{at}healthcarecommission.org.uk
Declaration of interest None. Funding detailed in Acknowledgements.
|
|
|---|
Aims To examine ethnic differences in patients experience of community mental health services.
Method Trusts providing mental health services in England conducted surveys in 2004 and 2005 of users of community mental health services. Multiple regression was used to examine ethnic differences in responses.
Results About 27 000 patients responded to each of the surveys, of whom 10% were of minority ethnic origin. In the 2004 survey, age, living alone, the 2004 survey, age, living alone, detention and hospital admissions were stronger predictors of patient experience than ethnicity. Self-reported mental health status had the strongest explanatory effect. In the 2005 survey, the main negative differences relative to the White British were for Asians.
Conclusions Ethnicity had a smaller effect on patient experience than other variables. Relative to the White British, the Black group did not report negative experiences whereas the Asian group were most likely to respond negatively. However, there is a need for improvements in services for minority ethnic groups, including access to talking therapies and better recording of ethnicity.
|
|
|---|
The Healthcare Commission coordinates a national programme of patient experience surveys on behalf of the Department of Health. This paper analyses ethnic variations in patient experience as reported in the 2004 and 2005 surveys of 26 625 and 25 143 users of community mental health services respectively across all National Health Service (NHS) mental health and primary care trusts providing mental health services in England. Surveys of mental health service users on this scale are unprecedented and offer a unique opportunity for analysing ethnic differences. This paper builds on previous analyses of ethnic variations in patients experience of NHS services (Commission for Health Improvement, 2004; Healthcare Commission, 2005a, 2006).
|
|
|---|
The surveys were approved by the Multi-Centre Research Ethics Committee for Scotland.
The questionnaire was developed following a review of the published literature on surveys of mental health service users (although there had been very few community-based surveys) and of the survey tools currently in use by NHS mental health trusts. Telephone and face-to-face interviews were carried out with mental health professionals and voluntary sector organisations to identify the issues they thought important to include. The information was used to construct a topic guide for use in focus groups with mental health service users, including those from Black and minority ethnic groups, in different parts of England. The results were used to construct a draft questionnaire, which was tested in cognitive interviews for face validity, comprehensibility and salience with people with mental health problems. Following consultations with an advisory group, including members of the Department of Healths Mental Health Task Force and service user group leads, the questionnaire was piloted before the surveys were launched.
Trusts were given detailed written guidance on sampling methods and advice on sampling was available from the NHS Surveys Advice Centre. To construct the sampling frame, trusts were asked to compile a list of service users aged 16–64 years on care programme approach (CPA; standard or enhanced) who had been seen within the 3 months prior to each of the surveys. They were asked to ensure that all separate CPA lists were combined and that any lists not held electronically were included. Trusts were asked to exclude service users that had been seen only once overall, current in-patients, those who had had no contact with NHS mental health services in the past 3 months and those that did not have a known UK address. Furthermore, prior to the survey a number of reviews of the quality of CPA lists were carried out; one of these is included in the Mental Health Survey Development report (Osborn et al, 2004). Full details of the sampling instructions can be found at http://www.nhssurveys.org/docs/MH2005_Guidance_v1.pdf
For each of the surveys, trusts were asked to take a simple random sample of 850 service users from their population lists. Detailed instructions on doing this using the Rand function in Excel were provided. The sample was not stratified by CPA level or by any other variable, because it was considered more important to minimise the risk of trusts making sampling errors by keeping the sampling instructions simple. Non-responders were sent up to two reminders.
The analysis is based on the national data-set for each of the two surveys. Although the sample was designed to be restricted to service users aged 16–64 years, some trusts included those over 64 years; these records were excluded from the analysis. The questionnaire used the 16 ethnic categories in the 2001 population census in England and Wales conducted by the Office for National Statistics (ONS). For the analysis, the ONS census ethnic categories were grouped as: White British; White Irish; White Other; Mixed (White–Black Caribbean, White–Black African, White Asian, Mixed Other); Asian or Asian British (Indian, Pakistani, Bangladeshi, Asian Other); Black or Black British (Black Caribbean, Black African, Black Other); Other (Chinese, Other).
For the 2004 survey, we analysed ethnic differences in experience of using services. The questions were grouped into domains of experience, developed jointly by the Department of Health and the Healthcare Commission with advice from the Picker Institute Europe, as follows: access and waiting (access); safe, high-quality, coordinated care (coordination); better information, more choice (information); building relationships (relationships).
Details of which questions were used to construct each of the patient experience domain scores are given in the Appendix. Domain scores from these surveys are used in the Healthcare Commissions performance assessments of trusts providing mental health services. They are also used at national level by the Department of Health to monitor progress against its Public Services Agreement target with the Treasury regarding annual improvements in patient experience.
Patients responses to questions were scored between 0 and 100, reflecting the gradient of negative–positive experience of services. Higher scores reflect a more positive experience than lower scores. Mean scores for each domain and an overall mean were derived for each ethnic group by aggregating scores for users responses to individual questions.
Multiple regression analysis was used to examine ethnic differences in responses after controlling for age, gender, employment status, living alone, self-reported mental health status, admission to hospital in the previous year for mental health reasons, detention under the Mental Health Act 1983 in the previous year and trust of treatment. Mean domain scores by ethnic group were estimated for a baseline group of respondents using the model coefficients, to illustrate the differences between different ethnic groups. Care programme approach status (i.e. standard or enhanced) was not known for 20% of respondents, hence it was not included in the model.
For the 2005 survey, we analysed ethnic differences in patients access to services and treatments, based on binary responses to individual questions. The White British group was used for comparison. Logistic regression was used to examine ethnic differences after controlling for selected independent variables. Adjustment was made for the same variables as in the 2004 survey, with two exceptions: the question on living alone was not included in the 2005 questionnaire and information on CPA status was more complete in the 2005 survey and hence was included in the analysis.
Results by ethnicity are presented after forcing all covariates into the model. Conclusions from models reduced using a stepwise approach to contain only significant covariates were highly similar. Statistical analysis was conducted using STATA version 8.0 for Windows. Details of the surveys, questionnaire, domain score methodology and trust-level results are available (Healthcare Commission, 2004, 2005b).
|
|
|---|
In both the 2004 and 2005 surveys, 10% of respondents were of Black and minority ethnic origin (i.e. excluding White British; 2745 and 2559 respectively; Table 1). The ethnic composition of respondents was similar across the two surveys.
|
View this table: [in a new window] | Table 1 Ethnic group of respondents to the 2004 and 2005 surveys of users of community mental health services in England |
The characteristics of respondents were also similar across the two surveys (Table 2). In both surveys, respondents from minority ethnic groups, other than the White Irish group, were younger than the White British group. Female respondents outnumbered male respondents except in the Asian group in the 2004 survey and in the Black group in the 2005 survey. The proportion living alone (only available for the 2004 survey) was highest in the Black group, being almost three times greater than in the Asian group. In both surveys, the proportions in paid work were lowest among the Asian, Mixed, Black and White Irish groups. Self-reported mental health status was poor/very poor in about one-quarter of respondents in most ethnic groups in 2004 and in about one-fifth in 2005; in both surveys, the proportion was significantly lower in respondents from the Black group (15.2 and 12.1% respectively). The proportion of respondents with at least one hospital admission for mental health reasons, or detention under the Mental Health Act 1983, in the past year was higher among minority ethnic groups than in the White British group, the proportions detained in the Black group being more than double those in the White British group in both years. Minority ethnic groups, the Black group in particular, were also more likely to be on enhanced CPA.
|
View this table: [in a new window] | Table 2 Characteristics of survey respondents by ethnic group for 2004 and 2005 surveys |
For the 2004 survey, we analysed ethnic differences in patients overall experience of using services (classified by domains of patient experience) after controlling for the independent variables (Table 3). Compared with the White British group, patient experience scores were lower for the White Other group for the access and information domains, and overall. For the Asian group, scores for the information domain were lower than for the White British group, and scores for the coordination domain were higher. Scores for respondents from the Black group were higher than for the White British group for the coordination and relationships domains.
|
View this table: [in a new window] | Table 3 Mean1 patient experience scores from 2004 survey according to ethnic group |
The regression analysis (Table 4) showed the extent to which the independent variables predicted patient experience scores. Although ethnicity was a significant predictor of patient experience for some ethnic groups for some domains, overall some other independent variables had stronger effects. Self-reported mental health status had the strongest explanatory effects across all domains and overall, with respondents in poor health responding more negatively. Increasing age was a significant, positive predictor of domain scores. Living alone, detention and hospital admissions in the past year were negatively associated with patient experience.
|
View this table: [in a new window] | Table 4 Beta coefficients1 from multiple regression analysis of 2004 survey data |
For the 2005 survey, we analysed ethnic differences in patients access to services and treatments, based on responses to individual questions and with the White British group as the baseline for comparison. Odds ratios from the regression analysis are given in Table 5. Overall, 84% of respondents had been in contact with mental health services for over a year and about half for over 5 years. After adjusting for the independent variables, the White Other, Asian and Other groups were more likely to have had a shorter duration of contact with mental health services (i.e. under 1 year) than the White British. Overall, 83.6% of respondents said they had seen a psychiatrist in the past 12 months. Except for the Other group, there were no ethnic differences from the White British group for being seen by a psychiatrist in the past 12 months or for being seen by the same psychiatrist at the last two appointments. Overall 57.9% of respondents said they had seen a community psychiatric nurse (CPN) in the previous 12 months. Compared with the White British group, a greater proportion of respondents from the Black group said they had seen a CPN. Just over half (55.3%) of respondents said they had also seen a health professional other than a psychiatrist or CPN in the past 12 months; the proportion was significantly lower in the Asian group than the White British group.
|
View this table: [in a new window] | Table 5 Fixed-effects logistic regression analysis of results from 2005 survey adjusting for confounding variables1 |
Overall, 92.6% of respondents said they had taken a medication for mental health problems in the past 12 months; no ethnic differences were observed after controlling for the independent variables. Overall, 40.6% of respondents said they had had some form of talking therapy (e.g. counselling or psychotherapy) in the past 12 months. Compared with the White British group, significantly lower proportions of respondents from the Asian and Black groups said they had received any form of talking therapy in the past 12 months. However, overall, 42.6% of respondents said they did not want a talking therapy. Among those who said they did want a talking therapy, overall 65.7% said they had received it. The odds ratios for those receiving talking therapy among those who wanted it were below 1 for all minority ethnic groups except for the Other group. The results did not reach statistical significance but this could reflect sample sizes as most of the confidence intervals for the individual ethnic groups only just straddled 1.
Almost two-thirds (62.5%) of respondents said they had been told their care coordinator; significant proportions said they had not (27.6%) or they did not know (9.9%). Compared with White British respondents, the proportions that said they had been told their care coordinator were significantly lower among White Other and Asian respondents, and significantly higher among Black respondents. Over two-thirds (69.6%) of respondents said that it was less than 1 month since they had last seen their care coordinator, 19.0% said it was 1–3 months, with the remainder stating it was over 3 months. A higher proportion of the Asian and Other groups compared with the White British said they had last seen their care coordinator over 1 month ago.
When asked whether they had been given or offered a written or printed copy of their care plan, overall under half (44.9%) answered affirmatively, a similar proportion answered negatively (44.4%) and 10.7% said they did not know. Compared with the White British group, a significantly lower proportion of Asian respondents said they had a copy of their care plan. Overall, 47.1% of respondents said they had had a care review in the past 12 months; compared with the White British group, this proportion was lower among Asian respondents and higher among Black respondents.
When asked whether they had an out-of-hours number for the local NHS mental health service, 44.4% of respondents said yes, 46.5% said no and 9.1% said they were not sure or did not know. The proportions responding affirmatively were lower among Mixed and Asian respondents compared with White British respondents.
In summary, relative to the White British group, the main ethnic differences were for the Asian group, who responded negatively to several questions about access to community mental health services. No negative differences were apparent for the White Irish and Black groups. Respondents from the Black group were more likely than White British to say they had seen a CPN, had a care review in the preceding year and had been told their care coordinator. Overall, minority ethnic groups were less likely to have said they had received talking therapies in the past year.
Age, employment status, hospital admission, detention under the Mental Health Act 1983 and CPA status were stronger and more consistent predictors of responses than ethnicity. The strongest predictor was self-reported health status.
|
|
|---|
Strengths
The Healthcare Commission has a national programme of patient experience
surveys across NHS primary care, acute, mental health and ambulance trusts in
England. The surveys provide direct feedback on patients experiences of
NHS services, and are intended to inform improvements in the services provided
by healthcare organisations. These are among the largest such surveys
conducted internationally. They are designed to measure patients
factual experience of health services rather than levels of satisfaction.
Patient satisfaction can be influenced by predetermined expectations,
gratitude bias and other factors (Sitzia
& Wood, 1997; Crow et
al, 2002), hence it is considered a less reliable marker of
patient feedback and inter-group differences. However, questions about
specific aspects of the healthcare actually experienced by patients provide
more objective and comparable measures of service quality. This approach is
now used across the NHS.
The results presented here are based on surveys of all NHS providers of mental health services in England. Almost 27 400 users of community mental health services participated in the 2004 survey and 26 500 in the 2005 survey. About 10% (2750 and 2560 respectively) of the respondents were of Black and minority ethnic origin. These are uniquely large samples for analysing ethnic variations in the experiences of those using community mental health services.
These surveys have several strengths for analysing ethnic differences in the views of service users with long-term mental health needs. Postal surveys such as these are a cost-effective way of obtaining feedback from large numbers of service users, hence they offer the statistical power for measuring ethnic differences that smaller, qualitative or interview-based studies do not. The surveys focused on priorities for service users and were developed with user involvement. The data were collected directly from service users and are independent of potential external bias. Hence the surveys are considered to be reliable markers of patient experience, and are used in the Healthcare Commissions assessments of NHS trusts and by the Department of Health for monitoring national progress on the Public Service Agreement target relating to patient experience.
Poor experience of mental health services among patients from Black and minority ethnic groups is widely reported, and undoubtedly this reflects the views expressed. However, systematic comparative research into ethnic variations in patient experience is scarce, based on small samples and shows mixed results. Bhugra et al (2004) reported that Black mental health patients tended to be more dissatisfied with general practitioner (GP) services than White patients. Parkman et al (1997) noted that African–Caribbeans were less satisfied with secure services than White service users. Other studies have found small or no ethnic differences in satisfaction with care (McGovern & Hemmings, 1994; Leavey et al, 1997; Callan & Littlewood, 1998; Commander et al, 1999). Although there is a dearth of research on ethnic differences in experience of mental health services, a study of disengagement and engagement with services among assertive outreach patients showed no differences between African–Caribbean and White patients (Priebe et al, 2005). The surveys analysed here had significantly larger samples and examined patient experience rather than satisfaction.
Limitations
There are some caveats to the findings. Although the analyses controlled
for mental health status, hospital admissions and detention status as proxies
for case mix, these variables may not fully control for diagnostic differences
(e.g. depression, psychotic illness), which can affect the way patients
respond (Fakhoury et al,
2002). This might be reflected in the significantly lower rates of
self-reported poor/very poor mental health status among the Black group
compared with other ethnic groups in both surveys. It is also not possible to
say whether or not the level of functioning affected patient responses.
The overall response rates to the surveys of about 40% are lower than those for the other Healthcare Commission surveys. However, we are not aware of other surveys published in the UK that have achieved a higher response rate from mental health service users sampled from CPA registers, or similar sampling frames of people with relatively serious mental illness. A comparative study in Switzerland of surveys of mental health patients discharged from hospital had response rates that were only moderately higher, in the range of 43–50% (Peytremann-Bridevaux et al, 2006). It was not possible to derive accurate response rates by ethnic group, as ethnicity coding in the trusts samples was significantly incomplete. The partial information available indicated that response rates were lower in respondents from minority ethnic groups than the White British group. This would be significant only if there is an additional systematic non-response bias. However, it is not possible to say whether there is such a bias, or in which direction it might operate. Moreover, similar ethnic differences in response rates are indicated in the Healthcare Commissions surveys of patients in other sectors (e.g. in-patients and out-patients in acute trusts, accident and emergency, ambulance service users, primary care), where we have reported more marked ethnic differences in patient experience than those observed here for mental health service users (Commission for Health Improvement, 2004; Healthcare Commission, 2005a, 2006). Response rates among Black and minority ethnic groups tend to be lower than among the White British population across most national surveys (McManus et al, 2006). However, in the absence of alternatives, this does not stop survey findings being used widely. Lower response rates among minority ethnic groups are in part attributable to the fact that response rates to surveys are generally lower among younger people, deprived groups, and those living in London and other inner-city areas, characteristics that apply particularly to minority ethnic groups. So, the apparent lower response rates from Black and minority ethnic groups will in part be due to artefactual demographic reasons. For instance, in the 2005 survey, overall response rates at ages 16–25, 26–35, 36–50, 51–64 years were 30, 33, 40 and 48% respectively.
Furthermore, indications that the sample is broadly representative are that the proportion of respondents from minority ethnic groups (10%) broadly reflects the proportion in the general population, and that ethnic differences in patient characteristics reflect other research evidence (Morgan et al, 2005a,b) such as the proportions in employment, living alone or having had a hospital admission or detention under the Mental Health Act 1983. For these reasons, we consider response bias is unlikely to affect the results significantly.
Differences in therapy
Patients from minority ethnic groups are frequently cited as being more
likely than White patients to be prescribed drugs and electroconvulsive
therapy rather than talking treatments such as psychotherapy and counselling.
One study showed that people of Caribbean origin with psychosis were less
likely to receive psychotherapy and be treated for depression
(McKenzie et al,
2001). However, there is limited evidence on these issues.
Effective community care could reduce the need for acute secondary care, but
research on the use of community mental health services and therapies by
ethnicity is particularly sparse.
Our analysis of the 2005 survey showed few or no differences relative to White British patients in terms of the proportions of patients from minority ethnic groups who saw a mental health professional in the past 12 months or those on medication. Although this study is limited to users of community mental health services, this is an important finding, since minority ethnic groups are widely reported as being more likely to receive medication (Sainsbury Centre for Mental Health, 2002; Department of Health, 2003, 2005). Our results relating to access to talking therapies (among respondents who said they wanted such therapies) narrowly failed to reach statistical significance for the individual minority ethnic groups; however, the odds ratios for most groups were low, indicating that ethnicity may be associated with a lower likelihood of receiving talking therapies.
Differences among groups
Where negative experiences were apparent, they applied in the main to the
Asian group, who were more likely than the White British to say they had not
received some services (2005 survey). Asian (and White Other) respondents also
showed some negative differences from the White British group in the analysis
of domains of patient experience, although not consistently (2004 survey).
Whereas much of the published literature focuses on issues relating to
African–Caribbean patients with mental illness, these findings clearly
indicate the need for improvements in the care provided for Asian service
users. Asian groups also report less favourably than White British patients in
a range of other patient experience surveys
(Commission for Health Improvement,
2004; Healthcare Commission,
2005a,
2006).
In contrast, patient experience scores for the Black group showed few differences from the White group, and in some cases were higher. No differences in access to mental health professionals or medication were observed for the Black group, other than a higher rate of CPN contact. Compared with White British counterparts, they were also more likely to say they knew their care coordinator and to have had an annual care review. These findings suggest that where Black groups of patients are in contact with community services, their self-reported experience is not very different from (and in some cases better than) that of White British patients. Based on a community sample, our findings are not dissimilar to some other studies and do not support the widely held view of adverse experiences of mental health services among Black groups.
These findings in relation to Black groups are encouraging and could reflect growing awareness and institutional changes towards more culturally sensitive services (Mclean et al, 2003). There may also be other explanations. McGovern & Hemmings (1994) suggest other factors might be responsible for a lack of Black–White difference in satisfaction with services; for example, that, for Black patients, White patients may not be the reference group for comparing quality of care. Diagnostic differences could play a role (Fakhoury et al, 2002); for example, patients with depression might respond differently to those with psychotic illness. Compared with patients with major depression and anxiety disorders, self-rated health and life satisfaction are better in patients with schizophrenia (Koivumaa-Honkanen et al, 1999). This may explain why Black groups, who are reported to have a higher prevalence of psychotic illness, had a lower proportion reporting poor/very poor mental health status in these surveys.
Research findings to date almost consistently show higher rates of diagnosed psychotic illness, hospital admission and detention among African–Caribbean patients, although the reasons are not fully understood (Sharpley et al, 2001; Bhui & Bhugra, 2002; Bhui et al, 2003; Morgan et al, 2004, 2005a,b; Fearon et al, 2006). This was most recently reflected in the 2005 and 2006 censuses of mental health in-patients in England and Wales, which highlighted the need for preventive action to reduce hospital admissions and detentions among these groups where appropriate (Healthcare Commission et al, 2005, 2007). It is possible that the excess of African–Caribbean patients detained and admitted to hospital reflects in some measure patients who are not in contact with community services, or those who have dropped out of contact. The literature provides some support for this view, as it indicates crisis modes of entry into secondary mental healthcare for African–Caribbean patients, with low GP referral rates, and high rates of detention and hospital admission via the criminal justice system (Bhui & Bhugra, 2002; Bhui et al, 2003, Morgan et al, 2004, 2005a,b; Healthcare Commission et al, 2005, 2007).
Our findings reiterate the need for earlier access to and full engagement with primary care and community mental health services by African–Caribbeans at risk of mental illness. This requires a coordinated response on the part of mental health service commissioners (primary care trusts and others), service providers, local authorities and other statutory agencies, in conjunction with African–Caribbean communities and voluntary groups. A key feature of the governments reform of mental health services is the implementation of community psychiatric services, including early intervention, assertive outreach and crisis resolution teams. These services have the potential for improving outcomes for people with severe mental illness, including those from minority ethnic groups (Department of Health, 2003; Chisholm & Ford, 2004, Johnson et al, 2005).
Other factors
We found that age, living alone, detention under the Mental Health Act
1983, CPA status and hospital admission were stronger and more consistent
predictors of patient experience than ethnicity. Of all the independent
variables examined, self-reported mental health status had the strongest
explanatory effect, consistent with the findings of other studies
(Hargreaves et al,
2001; Ren et al,
2001). Reviews of patient satisfaction surveys have similarly
shown a positive association of patient satisfaction with increasing age and
better health status (Sitzia & Wood,
1997; Crow et al,
2002). These findings suggest that factors associated with
ethnicity, rather than ethnicity per se, are stronger determinants of
patient experience. However, ethnicity does have an independent residual
effect, and our findings show that improvements are needed in mental health
services provided to minority ethnic groups, including better access to
talking therapies.
Ethnicity coding
One of the aims of the Count Me In censuses of 2005 and 2006
was to improve organisational recording of self-reported ethnic status and to
provide a baseline for ethnic monitoring (Healthcare Commission et
al, 2005,
2007). Our study shows that
ethnicity recording in trust records is significantly incomplete and needs to
be improved to support ongoing and effective ethnic monitoring, and adherence
to the Race Relations Amendment Act 2000.
|
|
|---|
E10. Can you contact your care coordinator if you have a problem?
F9. In the last 12 months, have any appointments been cancelled or changed by mental health services?
G1. Do you have the number of someone in mental health services that you can call out of office hours?
Safe, high-quality, coordinated care
B3. Did you have trust and confidence in the psychiatrist you
saw?
B6. The last 2 times you had an appointment with a psychiatrist was it with the same psychiatrist both times or with two different psychiatrists?
B9. Did you have trust and confidence in the CPN?
E7. Did you find the care review helpful?
Better information, more choice
C2. Do you have a say in decisions about the medication you
take?
E5. Were you told that you could bring a friend or relative to your care review meetings?
E6. Were you given a chance to express your views at the care review meeting?
F7. In the last 12 months have you received any information about local support groups for mental health service users?
J2. Do you have enough say in decisions about your care and treatment?
J3. Has your diagnosis been discussed with you?
Building relationships
B2. Did the psychiatrist listen carefully to you?
B4. Did the psychiatrist treat you with respect and dignity?
B5. When you last saw a psychiatrist, were you given enough time to discuss your condition and treatment?
B8. Did the CPN listen carefully to you?
B10. Did the CPN treat you with respect and dignity?
|
|
|---|
|
|
|---|
Related articles in BJP:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||