Evaluating the feasibility of complex interventions in mental health services: standardised measure and reporting guidelines

Victoria J. Bird , Clair Le Boutillier , Mary Leamy , Julie Williams , Simon Bradstreet , Mike Slade
  • Declaration of interest

    V.B. carried out consultancy work for the National Collaborating Centre for Mental Health at the time of the study.

Abstract

Background

The feasibility of implementation is insufficiently considered in clinical guideline development, leading to human and financial resource wastage.

Aims

To develop (a) an empirically based standardised measure of the feasibility of complex interventions for use within mental health services and (b) reporting guidelines to facilitate feasibility assessment.

Method

A focused narrative review of studies assessing implementation blocks and enablers was conducted with thematic analysis and vote counting used to determine candidate items for the measure. Twenty purposively sampled studies (15 trial reports, 5 protocols) were included in the psychometric evaluation, spanning different interventions types. Cohen’s kappa (κ) was calculated for interrater reliability and test-retest reliability.

Results

In total, 95 influences on implementation were identified from 299 references. The final measure - Structured Assessment of FEasibility (SAFE) - comprises 16 items rated on a Likert scale. There was excellent interrater (κ = 0.84, 95% CI 0.79-0.89) and test-retest reliability (κ = 0.89, 95% CI 0.85-0.93). Cost information and training time were the two influences least likely to be reported in intervention papers. The SAFE reporting guidelines include 16 items organised into three categories (intervention, resource consequences, evaluation).

Conclusions

A novel approach to evaluating interventions, SAFE, supplements efficacy and health economic evidence. The SAFE reporting guidelines will allow feasibility of an intervention to be systematically assessed.

Footnotes

  • Funding

    V.J.B., C.L., M.L. and J.W. are funded by a National Institute for Health Research (NIHR) Program Grant for Applied Research. M.S. received a research grant from the NIHR Program Grant for Applied Research (Grant RP-PG-0707-10040). This paper presents independent research funded by the NIHR under its Programme Grants for Applied Research Programme (Grant Reference Number RP-PG-0707-10040), and in relation to the NIHR Biomedical Research Centre for Mental Health at South London and Maudsley NHS Foundation Trust and Institute of Psychiatry, King’s College London. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

View Full Text

Log in through your institution

Purchase Short-Term Access 
Pay per Article - You may access this article (and download the PDF version) for 1 day for US$30.00.
Pay per Issue - You may access this issue (from the computer you are currently using) for 365 days for US$90.00.
Pay for Admission - You may access all content in The British Journal of Psychiatry (and download the PDF version) for 1 day for US$45.00.
Regain Access - You can regain access to a recent Pay per Article, Pay per Issue, or Pay for Admission purchase if your access period has not yet expired.