Hostname: page-component-7c8c6479df-5xszh Total loading time: 0 Render date: 2024-03-27T22:38:33.079Z Has data issue: false hasContentIssue false

Coefficients of Agreement Between Observers and Their Interpretation

Published online by Cambridge University Press:  29 January 2018

A. E. Maxwell*
Affiliation:
Institute of Psychiatry, De Crespigny Park, London SE5 8AF

Summary

The measurement of agreement between ratings of patient symptomatology by two or more psychiatrists is discussed. It is noted that coefficients which allow for possible chance agreement are to be preferred, but they involve assumptions about the way in which chance factors may operate. Assumptions which involve prior probabilities of the incidence of a symptom appear to be too stringent, and a new coefficient, called the RE coefficient, is recommended in which chance is assumed to operate in a purely random way. Binary scales are discussed in detail, but methods of dealing with scales of wider range are also referred to.

Type
Research Article
Copyright
Copyright © Royal College of Psychiatrists 1977 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Cohen, J. (1969) A coefficient of agreement for nominal, scales. Educ. Psychol. Measmt., 20, 3746.CrossRefGoogle Scholar
Fleiss, J. L. (1975) Measuring agreement between two judges on the presence or absence of a trait. Biometrics, 31, 651–9.CrossRefGoogle ScholarPubMed
Maxwell, A. E. & Pilliner, A. E. G. (1968) Deriving coefficients of reliability and agreement for ratings. Brit, J. math. statist. Psychol., 21, 105–16.CrossRefGoogle ScholarPubMed
Submit a response

eLetters

No eLetters have been published for this article.