Hostname: page-component-7c8c6479df-94d59 Total loading time: 0 Render date: 2024-03-17T15:04:07.026Z Has data issue: false hasContentIssue false

Impact of co-located welfare advice in healthcare settings: prospective quasi-experimental controlled study

Published online by Cambridge University Press:  02 January 2018

Charlotte Woodhead*
Affiliation:
Department of Applied Health Research, University College London, London
Mizanur Khondoker
Affiliation:
Norwich Medical School, University of East Anglia, Norwich
Robin Lomas
Affiliation:
Haringey Citizens Advice, London
Rosalind Raine
Affiliation:
Department of Applied Health Research, University College London, London, UK
*
Charlotte Woodhead, Department of Applied Health Research, University College London, London WC1E 6BT, UK. Email: c.woodhead@ucl.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Background

Evaluations of primary healthcare co-located welfare advice services have been methodologically limited.

Aims

To examine the impact and cost-consequences of co-located benefits and debt advice on mental health and service use.

Method

Prospective, controlled quasi-experimental study in eight intervention and nine comparator sites across North Thames. Changes in the proportion meeting criteria for common mental disorder (CMD, 12-item General Health Questionnaire); well-being scores (Shortened Warwick and Edinburgh Mental Well-being Scale), 3-month GP consultation rate and financial strain were measured alongside funding costs and financial gains.

Results

Relative to controls, CMD reduced among women (ratio of odds ratios (rOR) = 0.37, 95% CI 0.20–0.70) and Black advice recipients (rOR=0.09, 95% CI 0.03–0.28). Individuals whose advice resulted in positive outcomes demonstrated improved well-being scores (β coefficient 1.29, 95% CI 0.25–2.32). Reductions in financial strain (rOR=042, 95% CI 0.23–0.77) but no changes in 3-month consultation rate were found. Per capita, advice recipients received £15 per £1 of funder investment.

Conclusions

Co-located welfare advice improves short-term mental health and well-being, reduces financial strain and generates considerable financial returns.

Type
Papers
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an open access article distributed under the terms of the Creative Commons Attribution (CC BY) licence.
Copyright
Copyright © The Royal College of Psychiatrists, 2017

Associations between poor mental health and social disadvantage such as indebtedness and unstable housing are well documented. 1 Individuals with mental ill health are also more likely to have difficulties accessing support and advice for social welfare issues. Reference Tunstall, Bevan, Bradshaw, Croucher, Duffy and Hunter2Reference Balmer, Pleasence, Buck and Walker5 Subjective experiences of financial difficulties (‘financial strain’) predict onset and duration of common mental disorders. Reference Weich and Lewis6 The impact on patients of economic hardships associated with recession and austerity exert additional strain on general practitioners (GPs), particularly those working in socially disadvantaged areas. 7,Reference Bloomer, Allen, Donkin, Findlay and Gamsu8 One approach to reducing psychological distress linked to social disadvantage has been to co-locate welfare advice services (for example for issues related to debt and access to welfare benefits) in healthcare settings. Reference Parkinson and Buttrick9,Reference Adams, White, Moffatt, Howel and Mackintosh10 Previous evaluations report an impact on increased income and debt management but there is limited evidence in terms of health or service use. Reference Woodhead, Collins, Lomas and Raine11 Existing research is limited by small sample sizes, lack of robust comparator groups, attrition and lack of exploration of underlying pathways of effect, Reference Adams, White, Moffatt, Howel and Mackintosh10 which may have an impact on continued funding of such services. Reference Parkinson and Buttrick9 We undertook a prospective controlled quasi-experimental study of the effects of co-located welfare benefits and debt advice on mental health and GP consultation frequency. We also compared funding costs of the service to the financial gains for advice recipients.

Method

Setting and study design

This quasi-experimental study (online supplement DS1) was part of a mixed-methods evaluation of co-located welfare advice services within North London conducted between December 2015 and December 2016; qualitative findings are reported elsewhere. Reference Woodhead, Collins, Lomas and Raine11 Co-location involves local Citizens Advice service staff providing specialist in-depth advice at general practices, primarily about welfare benefits and debts. Patients can self-refer or be signposted by practice staff. We prospectively compared individuals accessing co-located advice at eight GP sites with a propensity score weighted comparison group. Individuals were recruited over 8 months and followed up for 3 months. The evaluation received National Health Service (NHS) ethical approval from the London-Harrow Research Ethics Committee (REC) (NHS REC reference: 15/L0/I260).

Sample size

Intervention group size was limited by the number of individuals that the services had the capacity to support per week and time constraints linked to deadlines for subsequent commissioning decisions. The target sample size (n = 816; n = 204 intervention and n = 612 control) therefore included a larger comparison group to increase analytical power. Sample size was calculated to detect a moderate effect size (d) of 0.4 with 90% power and was sufficient to detect smaller effect sizes (d = 0.35) with 80% power (online supplement DS1). Reference Adams, White, Moffatt, Howel and Mackintosh10

Recruitment

Advice group

All individuals aged 18+ years accessing co-located welfare advice services in eight sites during the recruitment period were eligible. Individuals waiting to see an adviser were approached by researchers. Those whose English was insufficient to understand the information sheet and consent form were excluded (3.2% of those approached). In line with recommendations from prior reviews of research with ‘hard to reach’ groups, Reference Howe, Tilling, Galobardes and Lawlor12,Reference Bonevski, Randell, Paul, Chapman, Twyman and Bryant13 individuals were offered £15 supermarket vouchers per survey.

Comparison group

We identified individuals aged 18+ years from which to generate a propensity score weighted comparison group. Reference Rosenbaum and Rubin14 The propensity score estimates the probability that a given individual would receive co-located advice, summarising a range of variables associated with receiving advice into a single probability value. Reference Rosenbaum and Rubin15 Weighting reduces confounding from selection bias by assigning more weight to controls whose propensity scores are closer to those of advice recipients. Reference Sianesi16

We contacted potentially eligible comparator participants in three ways (Fig. 1, online supplement DS1). In each, no identifiable data were disclosed to researchers before individuals provided informed consent. First, individuals of similar age group, ethnicity and gender to those accessing local co-located advice services in the past 12 months (assessed using Citizens Advice data) were identified from practice lists of nine local general practices. These practices did not host advice services but were in areas with similar levels of social disadvantage. 17 Based on an anticipated response rate of 10%, 5419 patients over all practices were identified and posted recruitment packs on behalf of their practice. Packs included information sheets, consent forms, baseline surveys and two return envelopes for consent forms and surveys (addressed to different locations). We expected that responders to these contact attempts may differ to advice recipients. Therefore, we worked with a local housing association to contact 490 tenants comparable with advice recipients in terms of age group, gender and ethnicity. Finally, as Black African and Caribbean individuals were underrepresented in GP-based returns, and to achieve the required sample size, we worked with community organisations to advertise the study.

Fig. 1 Advice and comparison group sample flow chart.

Data collection

Surveys were self-report, taking approximately 15 min to complete. All materials were piloted (online supplement DS1). After survey refinement, baseline data were collected from advice recipients at general practices prior to their advice session and from controls by post. We collected follow-up data from both groups by post 3 months later. This follow-up period was chosen first, to increase confidence in a direct association between advice receipt and changes in mental health, particularly in a multiply disadvantaged population in which other factors could influence outcomes and override the benefits of advice. Second, to minimise attrition – a limitation of research with socioeconomically disadvantaged groups, optimising statistical power and reducing the risk of bias. Reference Howe, Tilling, Galobardes and Lawlor12,Reference Bonevski, Randell, Paul, Chapman, Twyman and Bryant13 Third, based on Citizens Advice data indicating a mean issue resolution time of 3 months.

To determine whether the study sample was representative of co-located advice recipients, anonymised demographic data for all individuals accessing services at participating sites during the recruitment period were extracted from the Citizens Advice information technology (IT) platform.

Outcome measures

Prior research demonstrates that the relationship between low income and CMDs is mediated by experiences such as perceived financial strain and indebtedness. Reference Fitch, Hamilton, Bassett and Davey3,Reference Weich and Lewis6,Reference Benzeval, Bond, Campbell, Egan, Lorenc and Petticrew18 Psychosocial theories linking such experiences with poor mental health suggest that they act as stressors, increasing the risk of poor health when demands exceed individual coping resources. Reference Benzeval, Bond, Campbell, Egan, Lorenc and Petticrew18,Reference Pearlin, Schieman, Fazio and Meersman19 Further, patients in more deprived areas have higher rates of GP consultations associated with psychological difficulties linked to problems such as financial hardship. Outcome measures were therefore selected to examine evidence for improved mental health and reduced consultations, and whether this was influenced by reduced financial strain.

Mental health and well-being

We used the 12-item General Health Questionnaire (GHQ-12) to measure the primary outcome, presence/absence of CMD. The GHQ-12 is a widely used and validated screening instrument for common symptoms of mental distress, encompassing comorbid symptoms of anxiety and depression. Reference Goldberg and Williams20,Reference Stansfeld and Marmot21 Each item has four response categories on a Likert scale ranging from ‘not at all’ to ‘much more than usual’. The ‘GHQ-method’ of scoring Reference Goldberg and Williams20 was used; assigning a score of 1 to ‘rather more’ or ‘much more than usual’, and a score of 0 to ‘not at all’ or ‘no more than usual’ responses. Total scores range from 0 to 12. Scores of four or more (GHQ ‘caseness’) indicate a level of symptoms likely to need further treatment. Reference Goldberg and Williams20 We counted missing items as low scores, 22 those responding to fewer than four items were coded as missing.

Well-being was measured using the seven-item Shortened Warwick-Edinburgh Mental Well-being Scale (SWEMWBS). Reference Tennant, Hiller, Fishwick, Platt, Joseph and weich23 This ordinal scale evaluates positive mental health over the past fortnight, assessing respondents' agreement with statements such as, ‘I've been feeling optimistic about the future’. Responses are measured on a five-point scale ranging from ‘none of the time’ to ‘all of the time’. Summed scores are used as a continuous variable, greater scores indicate more positive well-being. Scores range from 7 to 35 and are transformed to a total score. 24 Respondents answering three or more items were non-missing. The average score of non-missing items was imputed for remaining items. Reference Craig and Mindell25

Consultation frequency

Self-reported consultation frequency was assessed by asking individuals to report numbers of GP appointments over the past 12 months (baseline), and over the past 3 months (baseline and follow-up).

Financial strain

Perceived financial strain was measured with an item used in UK household panel surveys 26 asking, ‘How would you say you were managing your finances these days?’ Response options are on an ordinal scale from ‘living comfortably’ to ‘finding it very difficult’.

Financial support-seeking

We examined coping and support-seeking for financial pressures at baseline and follow-up using items adapted from previous surveys 27,28 (online supplement DS2). Participants were asked what they would do (for example ‘use credit card’) and who they would go to (such as ‘GP’), if their income did not cover their costs. Questions about how financial stressors affected them (for example ‘physical health’) were asked before enquiring who they would go to for support with these experiences. Any changes since receiving advice (welfare advice group only) and access to welfare advice services since baseline were assessed at follow-up.

Propensity score covariates

Independent variables to be included in the model were measured at baseline (Table 1). These included categorical variables: age group, gender, ethnicity, marital status, employment status, educational attainment, household composition, tenure, monthly household income, long-term health conditions and financial capability. Financial capability was assessed with four items indicating past-year problems meeting housing-related payments. Reference Taylor, Brice, Buck and Prentice-Lane29 We summed the number of problems and created a binary variable (0/1+).

Table 1 Covariate distribution across propensity score weighted advice group and comparison group members

%
Advice
(n = 278)
Comparison
(n = 623)
Gender
    Male 36.7 39.5
    Female 63.3 60.5
Age group, years
    18–24 1.5 1.6
    25–34 9.3 11.7
    35–44 22.2 16.9
    45–54 26.8 32.7
    55–64 28.4 25.0
    65–74 6.3 8.5
    75+ 5.4 6.3
Ethnicity
    White 48.6 43.6
    Black/Black British/mixed 30.8 41.1
    Asian/Asian British/mixed 10.7 9.7
    Other 9.9 5.7
Marital status
    Single 42.9 41.9
    Long-term relationship 27.7 24.6
    Ex-relationship 29.5 33.5
Educational attainment
    None 41.3 33.5
    Up to GCSE level 24.1 30.7
    Up to A level 18.5 22.6
    Degree and above 16.1 13.3
Employment status
    Unemployed 18.9 22.2
    Employed 24.4 18.6
    Retired 14.0 13.3
    Outside labour force 42.7 46.0
Tenure
    Owned/part owned 10.2 9.3
    Rented 69.6 72.6
    Rent free 20.2 18.2
Household composition
    Live alone 43.6 40.3
    Lone parent 12.0 22.2
    Live with partner with or without children 27.8 21.0
    Live with others/family 16.6 16.5
Household income, £
    0–549 57.9 53.6
    550–999 24.3 30.2
    >1000 17.8 16.1
Problems paying for housing
    0 34.7 41.9
    1+ 65.3 58.1
Health status
    Disabled/long-term health condition 72.6 74.6
    Not disabled/no health condition 27.5 25.4

Accessing the advice service

To explore further the accessibility of co-located advice services, the baseline survey included questions about how they had heard about the service (for example ‘word of mouth’); preferred location of welfare advice (GP/elsewhere); and, whether they had spoken to their GP about the issue they were seeing the adviser about (yes/no). Open-ended questions explored reasons for the latter two items, thematically coding responses for analyses (online Table DS1).

Cost-consequences analysis

As a return-on-investment measure, we divided the total financial gain for all individuals accessing the co-located advice services (income gain and debt managed) using data from the Citizens Advice IT platform, by the cost of the service to funders over the 8-month baseline data collection period. Reference Kaufman, Watkins, Sims, Crispo, Hall and Sprague30

Statistical analyses

Analyses were carried out using Stata v.14. Descriptive analyses examined baseline advice recipient and propensity weighted comparator group characteristics. Propensity scores were calculated with logistic regression, with advice group membership as the dependent variable. Reference Becker and Ichino31,Reference Brookhart, Schneeweiss, Rothman, Glynn, Avorn and Sturmer32 Data were kernel weighted Reference Leuven and Sianesi33 and comparator group members whose scores did not overlap with the distribution of advice group scores were excluded (online supplement DS1). Data were not imputed as missing covariate data were low (5.27%) and loss to follow-up was not associated with the main outcomes.

The effect of co-located advice receipt was estimated by comparing the before–after change in advice receipt and comparator groups by including an interaction term between group and time (before–after indicator) in analytical models. To account for clustering within individuals and general practices, data were analysed using mixed-effects multilevel longitudinal regression models. Reference Rabe-Hesketh, Skrondal and Pickles34 All analyses specified robust standard errors, were weighted using the kernel weights and adjusted for indicators of missingness on propensity score covariates and loss to follow-up (educational attainment, household composition, household income and ethnicity).

Logistic regression models were used for binary outcomes (CMD caseness, financial strain), interaction coefficients were exponentiated and expressed as ratios of odds ratios (rOR). For count (consultation frequency) and continuous (well-being) outcomes we used Poisson and linear regression models respectively, interaction coefficients indicated the difference between the changes in outcome score by group. To examine the role of financial strain, associations between financial strain, advice receipt and the main outcomes were assessed. Adjustments were made for financial strain where a significant impact of advice on the main outcomes was found.

We re-ran analyses for the main outcomes, generating separate propensity scores for specific subgroups identified a priori on the basis of utility for commissioners (because of limited subgroup sample sizes to detect small effect sizes): gender (male/female); ethnicity (White, Black/Black British and other); long-term conditions status; and, whether or not individuals were recorded with, or self-reported, improvements since receiving advice in income, housing or employment.

Results

Participants

We recruited 278 of the 397 service users approached at baseline (70.0%) (Fig. 1). Reasons for non-participation were ‘refusal unknown reason’ (48, 11.9%), ‘trust’ (35, 8.7%), ‘no time’ (23, 5.7%) and ‘language’ (13, 3.2%). Among the cohort of unique contacts recorded on the Citizens Advice IT platform over the baseline recruitment period, those recruited to the advice group were similar in terms of gender, age group, ethnic group and health status (online Table DS2). In total, 633 controls were recruited, of which 623 were included in analyses. We excluded controls whose propensity scores were outside the range of common support (n = 4) and who reported receiving welfare benefits/debt advice between baseline and follow-up (n = 6) (Fig. 1). We followed up 199 (71.6%) individuals in the advice group and 530 (85.1%) in the control group. Table 1 shows the propensity score covariate distribution across the two groups following weighting.

Estimating the impact of advice

At follow-up, 64% of the 199 people in the advice group reported at least one improvement since receiving advice. Of these the most common were: improved stress (25.9% of responses), income (20.6%), housing circumstances (17.7%) and confidence (15.9%) (online Fig. DS1).

Mental health and well-being

The proportion of individuals meeting criteria for CMD decreased over time to a greater extent among the advice group than the control group. However, the group × time interaction was not statistically significant (Table 2). Subgroup sample sizes and analyses are shown in Table 3. The reduction in proportion meeting CMD criteria was significantly greater for the advice group relative to the controls among women (rOR = 0.37, 95% CI 0.20–0.70, P = 0.002) and Black/Black British participants (rOR = 0.09, 95% CI 0.03–0.28, P<0.001).

Table 2 Before-and-after comparison of primary outcomes among those receiving co-located welfare advice and propensity score weighted controls

Baseline Follow-up Interaction group × time,
rOR/β coefficient (95% CI)
Advice Comparison Advice Comparison P
Participants with common mental disorder, a % 79.5 68.6 62.6 56.5 0.57 (0.30 to 1.07) 0.078
Well-being, b mean (s.d.) 18.1 (5.2) 18.7 (5.0) 18.0 (5.5) 19.7 (4.4) 0.10 (−0.74 to 0.94) 0.814
Consultation frequency, c mean (s.d.)   4.1 (3.8)   2.7 (3.1)   4.0 (3.6)   2.5 (2.5) 0.04 (−0.20 to 0.29) 0.730
Financial strain, d % 66.9 39.9 58.6 43.2 0.42 (0.23 to 0.77) 0.005

a. Twelve-item General Health Questionnaire, scores 4+ identified as ‘cases’ (logistic regression, ratio of odds ratios (rOR)).

b. Shortened Warwick and Edinburgh Mental Well-being Score (linear regression, β coefficient).

c. Self-reported general practitioner appointments in the past 3 months (Poisson regression, β coeffcient).

d. Self-reported financial situation ‘difficult/very difficult’ (logistic regression, rOR).

Table 3 Subgroup analyses estimating the impact of co-located welfare advice receipt to propensity score weighted controls

Common mental disorder a Well-being b Consultation frequency c Financial strain d
Interaction group × time
(rOR, 95% CI)
P Interaction group × time
(β coefficient, 95% CI)
P Interaction group × time
(β coefficient, 95% CI)
P Interaction group × time
(rOR, 95% CI)
P
Gender
  Female (n = 595) 0.37 (0.20 to 0.70) 0.002   0.26 (−0.52 to 1.05) 0.514 0.11 (−0.11 to 0.33) 0.325 0.33 (0.14 to 0.78) 0.011
  Male (n = 316) 1.15 (0.29 to 4.51) 0.843   0.27 (−1.16 to 1.70) 0.712   −0.19 (−0.77 to 0.38) 0.514 0.91 (0.21 to 3.93) 0.899
Ethnicity
  White (n = 466) 0.69 (0.33 to 1.46) 0.331   0.02 (−1.59 to 1.63) 0.981 0.14 (−0.11 to 0.39) 0.291 0.67 (0.36 to 1.27) 0.220
  Black/Black British (n = 252) 0.09 (0.03 to 0.28) <0.001 −0.21 (−1.44 to 1.03) 0.744 −0.01 (−0.45 to 0.44) 0.977 0.32 (0.06 to 1.76) 0.189
  Other (n = 176) 0.83 (0.13 to 5.20) 0.845   0.69 (−1.03 to 2.42) 0.432 −0.02 (−0.45 to 0.41) 0.928 0.53 (0.13 to 2.13) 0.374
Long-term conditions
  Yes (n = 438) 0.41 (0.15 to 1.13) 0.085 −0.24 (−1.03 to 0.56) 0.558 −0.01 (−0.31 to 0.30) 0.970 0.30 (0.16 to 0.58) <0.001
  No (n = 468) 0.71 (0.31 to 1.64) 0.429   1.15 (−0.17 to 2.46) 0.087 0.37 (−0.08 to 0.83) 0.109 0.72 (0.39 to 1.32) 0.283
Advice outcome
  Yes (n = 708) 0.45 (0.20 to 1.02) 0.055   1.29 (0.25 to 2.32) 0.015 0.13 (−0.16 to 0.41) 0.385 0.45 (0.28 to 0.74) 0.001
  No (n = 816) 0.64 (0.39 to 1.03) 0.063 −0.52 (−1.44 to 0.41) 0.271 0.03 (−0.24 to 0.30) 0.828 0.61 (0.31 to 1.21) 0.156

a. Twelve-item General Health Questionnaire, scores 4+ identified as ‘cases’ (logistic regression, ratio of odds ratios (rOR)).

b. Shortened Warwick and Edinburgh Mental Well-being Score (linear regression, β coefficient).

c. Self-reported general practitioner appointments in the past 3 months (Poisson regression, β coefficient).

d. Self-reported financial situation ‘difficult/very difficult’ (logistic regression, rOR).

We found no evidence for any difference in change in well-being scores between the two groups (Table 2). In subgroup analyses (Table 3), recipients who received a positive outcome from advice demonstrated significantly improved well-being scores compared with controls (β = 1.29, 95% CI 0.25–2.32, P = 0.015)

Consultation frequency

The welfare advice group reported more frequent consultations than controls (12 month mean consultation frequency of 13.1 (s.d. = 12.8) compared with 8.6 (s.d. = 9.1)). There was no evidence for an impact of advice on 3-month consultation frequency (Tables 2 and 3).

Role of perceived financial strain

Perceived financial strain was associated with CMD, well-being, consultation frequency and advice receipt (all P<0.001). There was a significant improvement (rOR = 0.42, 95% CI 0.23–0.77, P = 0.005) in financial strain among the advice group compared with controls (Table 2). Advice receipt was associated with significant reductions in financial strain among women (rOR = 0.33, 95% CI 0.14–0.78, P = 0.011), those with long-term conditions (rOR = 0.30, 95% CI 0.16–0.58, P< 0.001) and those with positive advice outcomes (rOR = 0.45, 95% CI 0.28–0.74, P = 0.001) (Table 3).

For CMD, adjustments for financial strain reduced the strength of the interaction among women (rOR = 0.48, 95% CI 0.24–0.97, P = 0.040) but not among Black/Black British participants (rOR = 0.12, 95% CI 0.04–0.38, P<0.001). For well-being, adjustment for financial strain only partly accounted for the impact of advice among those with a positive advice outcome (β = 1.12, 95% CI 0.04–2.20, P = 0.042).

Financial support-seeking

There was a significant impact of advice on reduced use of a credit card or overdraft if income did not cover participants' costs (rOR = 0.48, 95% CI 0.26–0.90, P = 0.021). Among support-seeking behaviours for financial-related problems, the advice group became more likely to report not knowing where to go to for support over time, compared with controls (rOR = 2.33, 95% CI 1.14–4.76, P = 0.021). Similarly, there was a significantly greater increase in the proportion of advice recipients who did not know where they would seek help for the health impact of financial issues, relative to controls (rOR = 8.8, 95% CI 1.56–49.27), P = 0.014). Controls became proportionately more likely to talk to their GP about the health impact of financial strains but there was no change over time among advice recipients, generating a significant group × time interaction (rOR = 0.56, 95% CI 0.36–0.89, P = 0.015).

Cost-consequences

In total, £793 135 additional income (debt managed, income increases and one-off payments) was gained during the study period by recipients (average £2689 per capita). The annual costs of the service to funders in 2015/16 was £79,000, equating to £52 667 over the 8-month recruitment period. Dividing income gain by cost over 8 months translates to £15 income gain per £1 funder contribution.

Accessing the advice service

Co-located advice recipients had most commonly heard about the service through their GP or practice staff, followed by Citizens Advice elsewhere, or other advice services (online Table DS1). Nearly all reported a preference to see a GP-located adviser. Open-ended responses indicated that this was because the service was easier to access (for example because of mobility problems or travel anxiety), nearer home or more convenient (129, 64.8%); or, because it was a more familiar or less anxiety-provoking environment (42, 21.1%). If the service had not been available almost half of recipients would either not have sought advice at all, or would have spoken to their GP/other practice staff. Two-fifths of recipients had already spoken to their GP about their advice issue. Of these, over half said this was because it was affecting their mental health or was otherwise health related.

Discussion

To our knowledge, this is the first controlled prospective summative evaluation of co-located welfare advice services in healthcare settings. The provision of co-located advice led to significant improvements in mental health and well-being. Specifically, CMD caseness reduced among women and Black/Black British advice group recipients; and, those with a positive advice outcome also reported improvements in well-being. The strongest evidence was for a significantly greater reduction in perceived financial strain among the advice group compared with controls. This was reflected in an average financial gain of £2689 per capita among recipients. Compared with controls, advice recipients also reported enhanced coping strategies for dealing with financial strains; however, they were also more likely to report not knowing where to go to for support with financial strain or the health impact of such strains over time. No differences in self-reported consultation frequency were found.

Explanations for the findings and comparison with literature

Mental health and well-being

Our hypothesis that improvements in mental health and well-being linked to advice receipt would be mediated by reductions in perceived financial strain was partially borne out. Thus, financial strain was associated both with poor mental health and receipt of advice; and, where a significant impact of advice on mental health and well-being was found, this was partially accounted for by adjustments for financial strain. The hypothesis was not supported among Black individuals. This suggests there may be other underlying mechanisms between receipt of advice and improved symptoms of CMD in this group or that financial strain insufficiently captured any reductions in stress. A generalised measure of perceived stress may be a more useful gauge of the impact of advice and may also capture improvements linked to other non-directly financial outcomes (for example, housing circumstances). Improvements in mental health may also arise from other psychosocial factors such as perceived social support and/or from material changes in circumstances. Reference Benzeval, Bond, Campbell, Egan, Lorenc and Petticrew18,Reference Zimmerman and Bell35

Reduction in indebtedness may also underlie changes in mental health and well-being. We found a significant reduction in reported use of a credit card or overdraft if income did not cover costs among advice recipients, relative to the control group. This may be linked to debt management outcomes of advice and/or to budgeting information provided. This is important since use of credit cards and unauthorised overdrafts incur high interest rates, further increasing the likelihood of indebtedness, which is prospectively associated with poor mental health. Reference Fitch, Hamilton, Bassett and Davey3

Consultation frequency

It is possible that a reduction in appointments was not found because of the short follow-up period and/or recall bias, although validity of self-reported healthcare use has been reported as fair. Reference Bhandari and Wagner36 Previous research using routinely collected medical record data found small reductions in GP consultation frequency and antidepressant prescription 6 months before and after receipt of co-located welfare advice. Reference Krska, Palmer, Dalzell-Brown and Nicholl37 However, this research was small and uncontrolled, precluding causal inference.

Financial support-seeking

In contrast to the advice group, controls were more likely to talk to their GP about the impact on health or functioning of financial strain, and less likely to seek advice from the welfare agencies if unable to meet payments. Further, there was an increase among advice recipients of not knowing where to seek help. Since many recipients had been directed to the co-located service from high street Citizens Advice, these findings could be related to concurrent closures of such local services.

Impact on GP non-health workload

Our findings are in line with two recent UK GP surveys, Reference lacobucci38,39 in which GPs reported patient health, GP workload and practice staff time demands had been adversely affected by greater patient financial hardship and welfare provision changes. Our results suggest that reductions in financial strain could reduce practice burden and that co-location in health settings can target individuals less able to self-manage. This was evidenced by the proportion of advice recipients who would talk, or had already spoken, to their GP about their advice issue; by a preference to access advice at their general practice; and, by the proportion reporting that they would have gone to their GP, or would have not have sought advice, had the service not been there.

Strengths and limitations

A major strength of our research was the robust comparator group, allowing us to infer causality. Second, unlike previous research Reference Mackintosh, White, Howel, Chadwick, Moffatt and Deverill40 our study was sufficiently powered to detect significant differences over time. Third, we achieved similar or higher follow-up rates than have previously been reported. Reference Adams, White, Moffatt, Howel and Mackintosh10 Fourth, we demonstrated that changes in perceived financial strain may be one, although not the only, underlying pathway linking advice to mental health. Fifth, by collecting data on health outcomes, service use and financial benefits accrued, we could provide data of direct value to commissioners.

This was a multisite study that increases the external validity of our results. However, all the sites examined were in London and served areas with high levels of multiple social disadvantage. Although these services are likely to be similar to other inner metropolitan areas, other urban and rural populations have differing sociodemographic population profiles and welfare needs. Nonetheless, co-located services provided in less urban UK locations also report that welfare benefits and debt are the main presenting issues and the income gain per capita is in line with other services. 41 This supports the generalisability of our findings but further empirical testing is required.

Self-reported consultations data may be less accurate than those extracted from practice records. Capacity to extract such data was limited as appointments were not routinely recorded. Reduced accuracy (underreporting) has been linked to older age, longer time frame of recall, more frequent service utilisation and use linked to stigmatised issues. Reference Bhandari and Wagner36 Although participants in both groups reported frequent GP consultations, the short recall time frame would have minimised inaccuracies. Further, as analyses compared change between the two groups (rather than absolute numbers), we have no reason to believe that the accuracy of self-report would have differed systematically over time. However, given the importance of this outcome to commissioners, future work should assess any change in service use over longer periods using objective measures.

As a quasi-experimental study, residual bias may arise if unmeasured variables exerted different influences on change over time in either group. However, we consider this risk to be small given the short follow-up and that the direction of change in the primary outcome was the same in both groups.

A potential disadvantage of the 3-month follow-up period is underreporting of the benefits of welfare advice. Data extracted from the Citizens Advice IT platform demonstrated that some individuals receive several episodes of advice over a longer period. We may therefore have collected outcome data for individuals in whom issues of concern are not fully resolved or for whom benefits may accumulate over time. Further, any impact of reduced financial strain on mental health and well-being may take longer to fully emerge and/or be muted among those chronically exposed to such stressors. Reference Kahn and Pearlin42 Finally, our approach to assessing return on investment may underestimate the value of co-located welfare advice since analyses excluded non-monetised benefits, such as from mental health or housing improvements.

Implications

Co-located welfare advice can reach people who would not otherwise have sought advice or may otherwise turn to their GP for support. Advice recipients may experience improvements to short-term mental health, reduced financial strain and receive considerable financial returns. Although this study focuses on primary care, provision of advice services may benefit secondary mental healthcare service users at risk of underclaiming entitled welfare benefits, financial, housing and employment instability and poor financial capability. Reference Slade, McCrone and Thornicroft43,Reference Holkar and Mackenzie44 Pathways for the impact on reduced NHS and social care costs for this group have been hypothesised but not yet empirically tested. Reference Parsonage45 Further research on the impact of advice in different health settings and within new models of care that include aims to address wider determinants of health and health inequalities (such as multi-speciality community providers and primary and acute care models), using objective measures of service use is needed.

Funding

This research was funded by Haringey Council and the School for Public Health Research. The funders had no role in the study design, collection, analysis or interpretation of the data, in the writing of the article or in the decision to submit the article for publication. The study received National Institute for Health Research (NIHR) support through the Clinical Research Network. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

Acknowledgements

C.W. and R.R. were supported by the NIHR Collaboration for Leadership in Applied Health Research and Care (CLAHRC) North Thames at Bart's Health NHS Trust. The study received NIHR support through the Clinical Research Network. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. Survey formatting, distribution and collation was supported by the Ipsos Mori Social Research Institute.

Footnotes

Declaration of interest

None.

References

1 World Health Organization, Calouste Galbenkian Foundation, Social Determinants of Mental Health, World Health Organization, 2014.Google Scholar
2 Tunstall, R, Bevan, M, Bradshaw, J, Croucher, K, Duffy, S, Hunter, C, et al. The Links Between Housing and Poverty: An Evidence Review. Joseph Rowntree Foundation, 2013.Google Scholar
3 Fitch, C, Hamilton, S, Bassett, P, Davey, R. The relationship between personal debt and mental health: a systematic review. Ment Health Rev J 2011; 16: 153–66.CrossRefGoogle Scholar
4 Balmer, NJ, Pleasence, P, Buck, A. Psychiatric morbidity and people's experience of and response to social problems involving rights. Health Soc Care Community 2010; 18: 588–97.CrossRefGoogle ScholarPubMed
5 Balmer, NJ, Pleasence, P, Buck, A, Walker, H. Worried sick: the experience of debt problems and their relationship with health, illness and disability. Soc Policy Adm 2006; 5: 3951.Google Scholar
6 Weich, S, Lewis, G. Poverty, unemployment, and common mental disorders: population based cohort study. BMJ 1998; 317: 115–9.CrossRefGoogle ScholarPubMed
7 GPs at The Deep End Group. GPs at The Deep End: Improving Partnership Working between General Practices and Financial Advice Services in Glasgow: One Year on (Report 27). University of Glasgow, 2015.Google Scholar
8 Bloomer, E, Allen, J, Donkin, A, Findlay, G, Gamsu, M. The Impact of the Economic Downturn and Policy Changes on Health Inequalities in London. UCL Institute of Health Equity, 2012.Google Scholar
9 Parkinson, A, Buttrick, J. The Role of Advice Services in Health Outcomes Evidence Review and Mapping Study. Consilium Research and Consultancy, 2015.Google Scholar
10 Adams, J, White, M, Moffatt, S, Howel, D, Mackintosh, J. A systematic review of the health, social and financial impacts of welfare rights advice delivered in healthcare settings. BMC Public Health 2006; 6: 81.CrossRefGoogle ScholarPubMed
11 Woodhead, C, Collins, H, Lomas, R, Raine, R. Co-located welfare advice in general practice: a realist qualitative study. Health Soc Care Community 1 June 2007 (https://doi.org/10.1111/hsc.12453).CrossRefGoogle Scholar
12 Howe, LD, Tilling, K, Galobardes, B, Lawlor, DA. Loss to follow-up in cohort studies: bias in estimates of socioeconomic inequalities. Epidemiol 2013; 24: 19.CrossRefGoogle ScholarPubMed
13 Bonevski, B, Randell, M, Paul, C, Chapman, K, Twyman, L, Bryant, J, et al. Reaching the hard-to-reach: a systematic review of strategies for improving health and medical research with socially disadvantaged groups. BMC Med Res Methodol 2014; 14: 42.CrossRefGoogle ScholarPubMed
14 Rosenbaum, PR, Rubin, DB. The central role of the propensity score in observational studies for causal effects. Biometrika 1983; 70: 4155.CrossRefGoogle Scholar
15 Rosenbaum, PR, Rubin, DB. Reducing bias in observational studies using subclassification on the propensity score. J Am Stat Assoc 1984; 79: 516–24.CrossRefGoogle Scholar
16 Sianesi, B. Implementing Propensity Score Matching Estimators with STATA. UK STATA Users Group, VII Meeting, 2001 (http://fmwww.bc.edu/RePEc/usug200i/psmatch.pdf).Google Scholar
17 Department for Communities and Local Government. English Indices of Multiple Deprivation 2015. Department for Communities and Local Government, 2015 (http://imd-by-postcode.opendatacommunities.org/).Google Scholar
18 Benzeval, M, Bond, L, Campbell, M, Egan, M, Lorenc, T, Petticrew, M, et al. How Does Money Influence Health? Joseph Rowntree Foundation, 2014.Google Scholar
19 Pearlin, LI, Schieman, S, Fazio, EM, Meersman, SC. Stress, health and the lifecourse: some conceptual perspectives. J Health Soc Behav 2005; 46: 205–19.CrossRefGoogle Scholar
20 Goldberg, D, Williams, P. General Health Questionnaire (GHQ). NferNelson, 1988.Google Scholar
21 Stansfeld, SA, Marmot, MG. Social class and minor psychiatric disorder in British Civil Servants: a validated screening survey using the General Health Questionnaire. Psych Med 1992; 22: 739–49.CrossRefGoogle ScholarPubMed
22 GL Assessment. General Health Questionnaire. GL Assessment (https://www.gl-assessment.co.uk/products/general-health-questionnaire-ghq/). Accessed 21 Sep 2017.Google Scholar
23 Tennant, R, Hiller, L, Fishwick, R, Platt, S, Joseph, S, weich, S, et al. The Warwick-Edinburgh Mental Weil-Being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes 2007; 5: 63.CrossRefGoogle Scholar
24 Warwick Medical School. Warwick and Edinburgh Mental wellbeing Scale: Guidance on Scoring. Warwick Medical School, 2015. (http://www2.warwick.ac.uk/fac/med/research/platform/wemwbs/researchers/guidance/).Google Scholar
25 Craig, R, Mindell, J. Health Survey for England 2012. The Health and Social Care Information Centre, 2013.Google Scholar
26 Institute for Social and Economic Research. Understanding Society the UK Household Longitudinal Survey. University of Essex, 2015 (https://www.understandingsociety.ac.uk/).Google Scholar
27 Organisation for Economic Co-operation and Development International Network on Financial Education. Measuring Financial Literacy: Core Questionnaire in Measuring Financial Literacy: Questionnaire and Guidance Notes for Conducting an Internationally Comparable Survey of Financial Literacy. OECD, 2011.Google Scholar
28 University College London School of Laws. English and Welsh Civil and Social Justice Panel Survey: Waves 1–2, 2010–2012. University College London, 2015.Google Scholar
29 Taylor, MF, Brice, J, Buck, N, Prentice-Lane, E. British Household Panel Survey User Manual Volume A: Introduction, Technical Report and Appendices. University of Essex, 2010.Google Scholar
30 Kaufman, R, Watkins, R, Sims, L, Crispo, NS, Hall, JC, Sprague, DE. Cost-consequences analysis: a case study. Perform Improv Q 1997; 10: 721.CrossRefGoogle Scholar
31 Becker, SO, Ichino, A. Estimation of average treatment effects based on propensity scores. Stata J 2002; 2: 358–77.CrossRefGoogle Scholar
32 Brookhart, MA, Schneeweiss, S, Rothman, KJ, Glynn, RJ, Avorn, J, Sturmer, T. Variable selection for propensity score models. Am J Epidemiol 2006; 163: 1149–56.CrossRefGoogle ScholarPubMed
33 Leuven, E, Sianesi, B. PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing. Statistical Software Components, 2015.Google Scholar
34 Rabe-Hesketh, S, Skrondal, A, Pickles, A. Generalized multilevel structural equation modelling. Psychometrika 2004; 69: 167–90.CrossRefGoogle Scholar
35 Zimmerman, FJ, Bell, JF. Income inequality and physical and mental health: testing associations consistent with proposed causal pathway. J Epidemiol Community Health 2006; 60: 513–21.CrossRefGoogle Scholar
36 Bhandari, A, Wagner, T. Self-reported utilization of health care services: improving measurement and accuracy. Med Care Res Rev 2006; 63: 217–35.CrossRefGoogle ScholarPubMed
37 Krska, J, Palmer, S, Dalzell-Brown, A, Nicholl, P. Evaluation of welfare advice in primary care: effect on practice workload and prescribing for mental health. Prim Health Care Res Dev 2013; 14: 307–14.CrossRefGoogle ScholarPubMed
38 lacobucci, G. GPs' workload climbs as government austerity agenda bites. BMJ 2014; 349: g4300.CrossRefGoogle Scholar
39 Citizens Advice. A Very General Practice: How Much Time do GPs Spend on Issues Other than Health? Citizens Advice, 2015.Google Scholar
40 Mackintosh, J, White, M, Howel, D, Chadwick, T, Moffatt, S, Deverill, M, et al. Randomised controlled trial of welfare rights advice accessed via primary health care: pilot study [ISRCTN61522618]. BMC Public Health 2006; 6: 162.CrossRefGoogle ScholarPubMed
41 Derbyshire Citizens Advice Bureaux. Citizens Advice Bureaux in General Practice: Report 2011/12. Derbyshire Citizens Advice Bureaux, 2012.Google Scholar
42 Kahn, JR, Pearlin, LI. Financial strain over the life course and health among older adults. J Health Soc Behav 2006; 47: 1731.CrossRefGoogle ScholarPubMed
43 Slade, M, McCrone, P, Thornicroft, G. Uptake of welfare benefits by psychiatric patients. Psychiatrist 1995; 19: 411–13.Google Scholar
44 Holkar, M, Mackenzie, P. Money on Your Mind. Money and Mental Health Policy Institute, 2016 (http://www.moneyandmentalhealth.org/moneyonyourmind/).Google Scholar
45 Parsonage, M. Welfare Advice for People who use Mental Health Services: Developing the Business Case. Centre for Mental Health, 2013 (https://www.centreformentalhealth.org.uk/welfare-advice-report).Google Scholar
Figure 0

Fig. 1 Advice and comparison group sample flow chart.

Figure 1

Table 1 Covariate distribution across propensity score weighted advice group and comparison group members

Figure 2

Table 2 Before-and-after comparison of primary outcomes among those receiving co-located welfare advice and propensity score weighted controls

Figure 3

Table 3 Subgroup analyses estimating the impact of co-located welfare advice receipt to propensity score weighted controls

Supplementary material: PDF

Woodhead et al. supplementary material

Supplementary Material

Download Woodhead et al. supplementary material(PDF)
PDF 1.8 MB
Submit a response

eLetters

No eLetters have been published for this article.