The British Journal of Psychiatry (2008) 193: 156-160. doi: 10.1192/bjp.bp.107.041681
© 2008 The Royal College of Psychiatrists
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Submit an eLetter
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Related articles in BJP
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Lelliott, P.
Right arrow Articles by Hunter, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Lelliott, P.
Right arrow Articles by Hunter, S.

Questionnaires for 360-degree assessment of consultant psychiatrists: development and psychometric properties

Paul Lelliott, MRCPsych

Royal College of Psychiatrists’ Research and Training Unit, London

Richard Williams, TD, FRCPsych

University of Glamorgan and University of Central Lancashire and Gwent Healthcare NHS Trust, Welsh Institute for Health and Social Care, St Cadoc’s Hospital, Newport, Wales

Alex Mears, PhD and Manoharan Andiappan, MSc

Royal College of Psychiatrists’ Research and Training Unit, London

Helen Owen and Paul Reading

both formerly at the National Leadership and Innovation Agency for Healthcare, Llanharan, Wales

Nick Coyle, MSc

Royal College of Psychiatrists’ Research and Training Unit, London

Stephen Hunter, FRCPsych

Gwent Healthcare NHS Trust, Cwmbran, UK

Correspondence: Paul Lelliott, Royal College of Psychiatrists’ Research and Training Unit, Standon House, 21 Mansell Street, London E1 8AA, UK. Email: plelliott{at}cru.rcpsych.ac.uk

Declaration of interest

The Royal College of Psychiatrists manages the ACP 360 system and charges a fee for its use by consultant psychiatrists. Funding detailed in Acknowledgements.

Background

Expert clinical judgement combines technical proficiency with humanistic qualities.

Aims

To test the psychometric properties of questionnaires to assess the humanistic qualities of working with colleagues and relating to patients using multisource feedback.

Method

Analysis of self-ratings by 347 consultant psychiatrists and ratings by 4422 colleagues and 6657 patients.

Results

Mean effectiveness as rated by self, colleagues and patients, was 4.6, 5.0 and 5.2 respectively (where 1=very low and 6=excellent). The instruments are internally consistent (Cronbach’s alpha >0.95). Principal components analysis of the colleague questionnaire yielded seven factors that explain 70.2% of the variance and accord with the domain structure. Colleague and patient ratings correlate with one another (r=0.39, P<0.001) but not with the self-rating. Ratings from 13 colleagues and 25 patients are required to achieve a generalisability coefficient (E{rho}2) of 0.75.

Conclusions

Reliable 360-degree assessment of humane judgement is feasible for psychiatrists who work in large multiprofessional teams and who have large case-loads.


Related articles in BJP:

From the Editor’s desk
Peter Tyrer
BJP 2008 193: 178. [Full Text]  

Highlights of this issue
Kimberlie Dean
BJP 2008 193: A6. [Full Text]  



This article has been cited by other articles:


Home page
 JAMAHome page
K. Shaw, C. K. Cassel, C. Black, and W. Levinson
Shared Medical Regulation in a Time of Increasing Calls for Accountability and Transparency: Comparison of Recertification in the United States, Canada, and the United Kingdom
JAMA, November 11, 2009; 302(18): 2008 - 2014.
[Abstract] [Full Text] [PDF]