|
|
|||||||||||
SUPPLEMENT |
Institute of Preventive Medicine, Copenhagen University Hospital, Denmark
Clinical and Social Psychiatry Research Unit, University of Cantabria, Santander, Spain
Hvidovre Hospital, Department of Psychiatry, Copenhagen, Denmark
Clinical and Social Psychiatry Research Unit, University of Cantabria, Santander, Spain
Department of Psychiatry, University of Leipzig, Germany
Centre for the Economics of Mental Health, King's College London and London School of Economics, London, UK
Department of Medicine and Public Health, University of Verona, Italy
Department of Psychiatry, Academic Medical Centre, Amsterdam, The Netherlands
Institute of Psychiatry, King's College London, UK
Correspondence: Dr Helle Charlotte Knudsen, Institute of Preventive Medicine, Copenhagen Hospital Corporation, Copenhagen University Hospital, 1399 Copenhagen K, Denmark. Tel: +45 333 83 888; fax: +45 333 24 240
Declaration of interest No conflict of interest. Funding detailed in Acknowledgements.
|
|
ABSTRACT |
|---|
|
|
|---|
Aims To describe the strategies adopted in the European Psychiatric Services: Inputs Linked to Outcome Domains and Needs (EPSILON) Study for the translation and cross-cultural adaptation of five European versions of the instruments.
Method A protocol was developed for translation of the outcome scales, describing each step in the translation procedure. Disputed items were discussed in focus groups, which faced seven tasks: a list of topics to be discussed; chossing where the group should meet; composition of participants ; conducting the group; data collection; data completion afterwards; reporting results.
Results Modifications made to instruments were: changes in the instrument structure, contents and concepts; adjustments to the instrument structure; and modifications to the instrument manual.
Conclusion Use of focus groups is an adequate method to apply if concepts, constructs and translation issues are to be addressed; otherwise, less timeconsuming methods should be considered.
|
|
INTRODUCTION |
|---|
|
|
|---|
Often mental health measurements and psychological tests have been developed for content, validity and reliability in one country or language exclusively. Some of these instruments are then used in different languages and cultural settings, but often without detailed attention to the cross-national and cross-cultural adaptation that is necessary. Few instruments have been produced in equivalent versions in different languages, thus ensuring, in addition to their validity and reliability, their cross-cultural applicability in the new setting (Sartorius & Kuyken, 1994). The methods involved and their difficulties have been well described by different authors (Simonsen & Mortensen, 1990; Sartorius & Kuyken, 1994; Gaite et al, 1997; Hutchinson et al, 1997).
The aims of the present paper are: (a) to describe the process of transferring instruments from one language or culture to another; (b) to describe the strategies adopted in the European Psychiatric Services: Input Linked to Outcome Domains and Needs (EPSILON) Study for the translation and cross-cultural adaptation, in order to develop European Versions (EU) of five key instruments: Involvement Evaluation Questionnaire (IEQ) (Schene & van Wijngaarden, 1992), Camberwell Assessment of Need (CAN) (Phelan et al, 1995), Verona Service Satisfaction Schedule (VSSS) (Ruggeri & Dall'Agnola, 1993), Lancashire Quality of Life Profile (LQoLP) (Oliver, 1991) and Client Service Receipt Inventory (CSRI) (Beecham & Knapp, 1992); and (c) to summarise the impact that the methods applied had on the development of the instruments.
The process included the following steps: (a) a proper translation process ; (b) cross-cultural verification and adaptation; (c) verifying the psychometric properties of the instrument in the target language. The first two elements of this process will be considered in this paper, which will describe in detail the use of focus groups as part of the cross-cultural instrument adaptation process in the EPSILON Study. The third step - verifying the psychometric properties of the instruments - is described in van Wijngaarden et al (2000) elsewhere in this supplement.
|
|
TRANSLATION APPROACH (SEE APPENDIX) |
|---|
|
|
|---|
The translation approach selected depends on the degree of conceptual overlap between the source and the target culture for the concepts in question. In a European context, there is considerable conceptual overlap in most measures regarding patients, services, costs, or outcomes in mental health services; therefore the pragmatic approach is suitable when an instrument developed in Europe is translated into other European languages and cultures.
Within each of these approaches, the aim of translation is to maintain, as far as possible the semantic or the linguistic, the conceptual, and the technical equivalence between the versions of the instruments in the source and target languages (Sartorius & Kuyken, 1994; Hutchinson et al, 1997). Semantic equivalence means to retain a similar meaning of a measure in the source and in the target version, while conceptual equivalence refers to the need to obtain an identical meaning of concepts which may have different cultural understandings (for example the concept of good mental health) (Sartorius & Kuyken, 1994 ; Hutchinson et al, 1997). Finally, technical equivalence refers to both the technical features of the languages (i.e. language complexity, question length, acceptable level of abstraction) and their relationship to the sociocultural context (the feasibility of the nature and mode of questioning used in the instrument in the source and target versions; for example: whether the questionnaire is applied as a self-rating questionnaire or as a structured interview).
The three language- culture-related equivalencies are key issues in a proper translation of instruments. They require the translators involved in the translation procedures to be highly qualified: they need to have good technical knowledge of both the source and the target languages, and full emotional understanding of the source and target languages; to be deeply involved in the cultures in question; to know about the cultural problems related to the concepts and terms used in the questionnaire (so as, for example, to avoid the use of stigmatising concepts); and to have integrated knowledge of the area and domains explored in the questionnaire.
Translators will meet these rigorous criteria to varying degrees. When a translator does not have all these characteristics, strategies can be devised to compensate for this, including interactive discussions with experts, monolingual panels not involved in the translation process, or other strategies specifically designed for the translation of health assessment instruments (Gaite et al, 1998: details available from the corresponding author on request).
However accurate the translation process, it will not necessarily guarantee that the instrument has been fully adapted to the target language, in the sense that the concepts and constructs incorporated in the instrument are fully applicable. To achieve this, specific quantitative and qualitative strategies need to be adopted: for example, concept mapping (Russell, 1988), pile sorting (Trotter & Potter, 1993), key-informant consensus meeting (Johnson, 1990) and focus groups. Here we will summarise the characteristics of focus groups, which was the method selected in the EPSILON Study.
|
|
FOCUS GROUP |
|---|
|
|
|---|
Focus group process
The FG interview is a qualitative research method. The interview derives
from the formal group interview, which in its structure and method derives
from group psychotherapy. It is a focused group interview or an arranged
talk/communication among a selected group of people. Its aim is to uncover
important dimensions of a given problem, experience, service or other
phenomenon (Basch, 1987;
Krueger, 1994;
Bojlén
& Lunde, 1995). The advantage of the FG is that by properly
selecting the participants, and developing the outline of the FG session in
accordance with the aims of the FG interview (exploratory, judgement,
phenomenological) (Basch, 1987,
p. 418), we can produce a wide range of information and potentially uncover
important understanding of the problem to be addressed. It is possible to
address instrument problems like the readability of a measure, the construct
of the concept, or the understanding of the mental health care system, and at
the same time address the issue of acceptability of the content of the
questions (such as financial, religious or sexual issues).
Basch (1987) has outlined the key features of the FG interview: the role of the moderator, the physical setting, the psychological climate conducive to a successful FG session, proper selection of participants in accordance with the aim of the FG interview, instrumentation (development of discussion outline and questions to be asked), data collection and analysis, including a summary report on the findings.
It is recognised in group psychotherapy that the optimum size for a good working group is from six to ten participants, and the size of the group affects the nature of the data collected as well as the group structure. In general, it is thought that focus groups should be highly structured, with six to ten members, and with moderators controlling both the questions to be asked and the group dynamics. This approach is appropriate when the moderator knows what the key questions are.
Developing the discussion outline and the questions to be used by the moderator requires careful thought and a considerable amount of effort in planning. As in all questionnaire design, each item of the outline has a specific purpose. The data obtained in the FG interview can be analysed in different ways, depending on the method used for data collection (tape recorder, videotape, written notes); but in any case, in the final version of the report it is important to have a summary outlining the most important ideas and conclusions. Potential problems and technical issues are related to unbiased data reduction and the inferences to be drawn from qualitative data.
|
|
METHOD |
|---|
|
|
|---|
Translation
A protocol was developed for the translation of instruments, describing the
procedure for each step in the translation process.
With some modification, this procedure has been followed in the translation of all five instruments.
Focus groups
The FG activities involved seven main tasks: (a) establishing the list of
topics to be discussed for each instrument; (b) deciding where to hold the FG
; (c) the composition of FG participants; (d) conducting the FG session; (e)
data collection during the FG session; (f) post-FG data completion; (g)
reporting the results of the FG.
|
Structure of the report
Under Items, the report deals with linguistic problems uncovered during
the discussion, opinions about the applicability and relevance of the items,
topics arising due to overlapping of items present in different areas of the
instrument, and suggestions about items that the participants consider should
be included.
Topics: during the FG, a number of general topics in connection with the instrument were discussed by the participants, illustrating differences between participants in the interpretation of different subjects.
Reports were designed to :
Impact of the focus group on instrument development
The results of these strategies in converting the instruments to the
different languages/cultures influenced the development of the instrument
concepts and constructs. The modifications to the different instruments can be
categorised as: (a) changes in the instrument structure, contents and
concepts; (b) adjustments to the instrument structure; (c) modifications to
the instrument manual. In this paper we shall summarise the most relevant
overall decisions adopted in each of these categories, while details are
reported in the papers for each instrument.
Changes in the instrument structure, contents and concepts (IEQ-EU
and CSSRI-EU)
Involvement Evaluation Questionnaire (IEQ-EU)
(van Wijngaarden et al,
2000, this supplement)
The instrument was subjected to focus groups in Denmark, England, Italy and
Spain. The conclusion was that the instrument covers the main domains of
family burden well. There were some problems with items regarding education,
type of professional help, income categories, and drug use; and the response
categories were discussed. The instrument has been adjusted in accordance with
comments received; the response categories, however, remained unchanged,
because otherwise comparison with earlier research would become difficult. The
items on psychological distress were taken out and the General Health
Questionnaire, 12-item version (Goldberg
& Hillier, 1979) was included to describe general
well-being.
Client Socio-Demographic and Service Receipt Inventory
(CSSRI-EU) (Chisholm et al,
2000, this supplement)
The instrument underwent major changes as a consequence of the FGs in order
to enable comparisons to be made between different countries' health care and
social welfare systems. The diversity in organisation of the welfare systems
in the participating countries made it especially difficult to find a common
language in this area of the questionnaire. The many comments from the FG were
an important input in solving these problems. In addition, internationally
comparable concepts for describing individual socio-demographic variables were
added to the instrument.
Adjustments in the instrument structure (VSSS-EU)
Verona Service Satisfaction Schedule (VSSS-EU)
(Ruggeri et al, 2000,
this supplement)
The instrument was discussed in FGs in Denmark, England, Holland and Spain.
The instrument was considered acceptable in all countries and underwent
relatively minor modifications. There were some problems regarding the
grouping of professional staff, such as psychiatrists and psychologists, and
nurses and social workers, caused by the different structures of the mental
health care systems. These problems were solved by asking questions regarding
each professional group separately. Issues related to the organisation of
health care and social welfare were clarified, and translation issues were
taken into consideration.
Modification incorporated in the instrument manuals (LQoLP-EU and
CAN-EU)
Lancashire Quality of Life Profile (LQoLP-EU)
(Gaite et al, 2000,
this supplement)
The instrument was used in a focus group process in Denmark, Italy, Holland
and Spain, which gave rise to a lengthy discussion regarding its suitability,
arising from earlier psychometric analyses of the instrument. All countries
agreed that the instrument is the most comprehensive quality-of-life
instrument available in the field of mental health services research.
Camberwell Assessment of Needs (CAN-EU)
(McCrone et al, 2000,
this supplement)
The instrument was in a focus group process in Denmark, Italy, Holland and
Spain. The overall views were mixed, and there were many suggestions for
additional items, although there was consensus on only a small number of such
additional items. However, it was decided not to change the instrument as it
has already been used in many countries. Instead, the missing items were
addressed in a revised manual for the instrument. Translation issues raised
through the FGs have been included in each new language version.
|
|
DISCUSSION |
|---|
|
|
|---|
This paper has presented the methods used in the EPSILON Study to adapt nationally developed instruments into internationally applicable measurements. We chose five instruments which have already been used in research in several European countries. These five instruments were translated in accordance with strictly defined rules of the translation process.
In the outline of the FG interviews for each instrument, we included questions and probes related to an identified list of disputed translated issues (semantic equivalents), the readability of the instrument (technical equivalence) and the construct of the concepts (concept equivalence), in accordance with the minimum criteria described. We included questions to the FGs regarding the content of instruments, i.e. did the items of the questionnaire describe a phenomenon relevant to the culture and should other items be added to describe relevant phenomena ? All instruments were modified to improve semantic and technical equivalence, while the modifications made to improve conceptual equivalence varied, depending on the extent to which the instrument had already been accepted for use in international research.
To our knowledge, this is the first crossnational study reporting on the use of FGs as a method in the process of converting instruments into internationally comparable measurements, to assess the semantic, conceptual and technical issues in existing, pre-selected instruments. However, FGs of this type are not in general different from other FGs used to identify thoughts, beliefs and feelings; and this method shares, in general, the same advantages and disadvantages as other qualitative research methods (Trotter, 1991; Room et al, 1996).
One of our main concerns in using FG interviews in instrument development has been the question of the reliability and generalisability of the information gathered. The careful selection of participants, representing different positions in mental health care systems, and also representing different gender and socio-demographic groups, helps to generalise the results. However, only people living in cities participated in the FGs in this study; we have no information on the extent to which this population is also representative of people living in the rural areas in Europe.
In the structured FG sessions, the moderator plays an important role in ensuring that the information gathered is representative of the participants present. The FGs require a setting that will encourage a trusting, comfortable and secure atmosphere, so that potentially vulnerable contributors (for example, patients and relatives) do not withdraw themselves from the process; also, it is important to prevent dominant members of the group from determining the content of the discussion. The moderators in the EPSILON FGs were trained in group sessions, and were either psychologists or qualified psychiatrists, which we found enabled us to run the groups so as to establish the necessary atmosphere.
The instruments in the EPSILON Study were at different stages of development for international use. One instrument's main domains were defined (CSSRI-EU), while the internationally comparable concepts and constructs were to be developed (Chisholm et al, 2000, this supplement); another instrument (IEQ) was used in some European studies; reconstruction of the sequence of some questions and constructs (the construct of general well-being) of the instrument was, however, considered as an important improvement to the instrument and accepted by the instrument developers. Finally, three instruments were already in frequent use in European research (CAN, LQoLP, VSSS); changes to their concepts and constructs were considered less appropriate by the developers, because international use of the instrument was already widely accepted.
Organising and running the FGs is a time-consuming process, with many participants and with many parties involved, both in the FG process and in the discussions of the FG results and reports. It is our experience that this time is well spent if the instruments are still in their developmental phase, or have not been used internationally very often. In these situations, FGs contribute important information regarding concepts, construct and language, which is crucial to the development of the instruments for international use (CSSRI-EU, IEQ-EU). For instruments already used extensively in international research, and where major changes in the instruments are considered less appropriate, FGs bring less benefit. Most of the improvements in these instruments were related to semantic and technical equivalence; less time-consuming methods targeting these problems - like monolingual panels and expert groups - should be considered.
|
|
CONCLUSION |
|---|
|
|
|---|
Based on our experience using FGs, we suggest that researchers involved in the process of developing instruments for international use first consider :
The FG process is an adequate method to apply if concepts, constructs and translation issues are to be addressed. Otherwise, less time-consuming methods should be considered.
|
|
APPENDIX: CONCEPTS USED IN THE LITERATURE DESCRIBING THE TRANSLATION PROCESS |
|---|
|
|
|---|
Approaches to translation of questionnaires already developed
(Sartorius & Kuyken,
1994)
Translation and types of equivalence
(Sartorius & Kuyken, 1994
; Hutchinson et al,
1997)
Cross-cultural equivalence
|
|
ACKNOWLEDGMENTS |
|---|
|
|
|---|
This study was supported by the European Commission BIOMED-2 Programme (Contract BMH-14-CT95-1151). We would also like to acknowledge the sustained and valuable assistance of the users, carers and the clinical staff of the services in the five study sites. In Amsterdam, the EPSILON Study was partly supported by a grant from the Nationaal Fonds Geestelijke Volksgezondheid and a grant from the Netherlands Organization for Scientific Research (940-32-007). In Santander the EPSILON Study was partly supported by the Spanish Institute of Health (FIS) (FIS Exp. No. 97/1240). In Verona, additional funding for studying patterns of care and costs of a cohort of patients with schizophrenia were provided by the Regione del Veneto, Giunta Regionale, Ricerca Sanitaria Finalizzata, Venezia, Italia (Grant No. 723/01/96 to Professor M. Tansella).
|
|
REFERENCES |
|---|
|
|
|---|
Beecham, J. & Knapp, M. (1992) Costing psychiatric interventions. In Measuring Mental Health Needs (eds G. Thornicroft, C. R. Brewin & J. Wing), pp. 163 -183. London: Gaskell.
Bogardus, E. S. (1926) The group interview. Journal of Applied Sociology, 10, 372 -382.
Bojlén, N. S. & Lunde, I. L.
(1995) Focusgruppeinterview som kvalitativ forskningsmetode.
(Focus group interview as a qualitative research method.) Ugeskrift
for L
ger, 157, 3315
-3318.
Chisholm, D., Knapp, M. R. J., Knudsen, H. C., et al
(2000) The Client Socio-Demographic and Service Receipt
Inventory: development of an instrument for international research. EPSILON
Study 5. British Journal of Psychiatry,
177 (suppl. 39), s28
-s33.
Gaite, L., Ramirez, N., Herrera, S., et al (1997) Tradución y adaptación y transcultural de instrumentos de evalución en psiquiatria: aspectos metodológicos. Archivos de Neurobiologica, 60, 91 -111.
Gaite, Vázquez-Barquero, J. L.,
Arriaga Arrizabalaga, A., et al (2000) Quality of
life in schizophrenia: development, reliability and internal consistency of
the Lancashire Quality of Life Profile - European Version. EPSILON Study 8.
British Journal of Psychiatry,
177 (suppl. 39), s49
-s54.
Goldberg, D. & Hillier, V. F. (1979) A scaled version of the General Health Questionnaire. Psychological Medicine, 9, 139 -145.[Medline]
Hutchinson, A., Bentzen, N. & König-Zahn, C. (1997) Cross Cultural Health Outcome Assessment: A User's Guide (Vol. 1). European Research Group on Health Outcomes.
Johnson, J. C. (1990) Selecting Ethnographic Informants. Newbury Park, CA: Sage.
Krueger, R. A. (1994) Focus Groups: A Practical Guide for Applied Research, London: Sage.
McCrone, P., Leese, M., Thornicroft, G., et al
(2000) Reliability of the Camberwell Assessment of Need -
European Version. EPSILON Study 6. British Journal of
Psychiatry. 177 (suppl. 39), s34
-s40.
Meadows, K., Bentzen, N. & Touw-Otten, F. (1997) Cross-cultural issues: an outline of the important principles in establishing cross-cultural validity in health outcome assessment. In Cross Cultural Health Outcome Assessment; A User's Guide (eds A. Hutchinson, N. Bentzen & C. König-Zahn), Vol. I, pp. 34 -40. European Research Group on Health Outcomes.
Oliver, J. (1991) The Social Care Directive: development of a quality of life profile for use in community services for the mentally ill. Social Work and Social Sciences Review, 3, 5-45.
Phelan, M., Slade, M., Thornicroft, G., et al
(1995) The Camberwell Assessment of Need: the validity and
reliability of an instrument to assess the needs of people with severe mental
illness. British Journal of Psychiatry,
167, 589
-595.
Room, R., Janca, A., Bennett, L. A., et al (1996) WHO cross-cultural applicability research on diagnosis and assessment of substance use disorders: an overview of methods and selected results. Addiction, 91, 199 -220.
Ruggeri, M. & Dall'Agnola, R. (1993) The development and use of the Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS) measuring expectations and satisfaction with community-based psychiatric services in patients, relatives and professionals. Psychological Medicine, 23, 511 -523.[Medline]
Ruggeri, Lasalvia, A., Dall'Agnola, R., et al
(2000)Development, internal consistency and reliability of
the Verona Service Satisfaction Scale - European Version. EPSILON Study 7.
British Journal of Psychiatry,
177 (suppl. 39), s41
-s48.
Russell, B. H. (1988) Research Methods in Cultural Anthropology. London: Sage.
Sartorius, N. & Helmchen, H. (1981) Aims and implementation of multi-centre studies. Modern Problems of Pharmacopsychiatry, 16, 1 -8.
Sartorius, N. & Kuyken, W. (1994) Translation of health status instruments. In Quality of Life Assessment in Helath Care Settings (eds J. Orley & W. Kuyken), Vol. I. Berlin: Springer.
Schene, A. H. & van Wijngaarden, B. (1992) The Involvement Evaluation Questionnaire. Amsterdam: Department of Psychiatry, Academic Medical Centre/University of Amsterdam.
Schene, A. H., Koeter, M., van Wijngaarden, B., et al
(2000) Methodology of a multi-site reliability study. EPSILON
Study 3. British Journal of Psychiatry,
177 (suppl. 39), s15
-s20.
Simonsen, E. & Mortensen, E. L. (1990) Difficulties in translation of personality scales. Journal of Personality Disorders, 4, 290 -296.
Trotter, R. T. I. (1991) Ethnographic research methods for applied medical anthropology. In Applied Medical Anthropology (ed. C. Hill), pp. 172-203. Washington, DC: American Anthropological Association.
Trotter, R. T. I. & Potter, J. M. (1993) Pile sorts, an anthropological model of drug and AIDS risks for Navajo teenagers: assessment of a new evaluation tool. Drugs and Society, 7, 23 -39.[CrossRef]
van Wijngaarden, B., Schene, A. H., Koeter, M., et al
(2000) Caregiving in schizophrenia: development, internal
consistency and reliability of the Involvement Evaluation Questionnaire -
European Version. EPSILON Study 4. British Journal of
Psychiatry, 177 (suppl. 39), s21
-s27.
This article has been cited by other articles:
![]() |
F. Healey, V. L.M. Tan, and S. A. Chong Cross-cultural validation of expressed emotion in caregivers of Chinese patients with first episode psychosis in Singapore: a qualitative study. International Journal of Social Psychiatry, May 1, 2006; 52(3): 199 - 213. [Abstract] [PDF] |
||||
![]() |
T. Weiss and R. Berger Reliability and Validity of a Spanish Version of the Posttraumatic Growth Inventory Research on Social Work Practice, March 1, 2006; 16(2): 191 - 199. [Abstract] [PDF] |
||||
![]() |
T. BECKER, M. KNAPP, G. THORNICROFT, H. C. KNUDSEN, A. H. SCHENE, M. TANSELLA, and J. L. VAZQUEZ-BARQUERO Aims, outcome measures, study sites and patient sample: EPSILON Study I The British Journal of Psychiatry, July 1, 2000; 177 (39): s1 - s7. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. H. SCHENE, M. KOETER, B. VAN WIJNGAARDEN, H. C. KNUDSEN, M. LEESE, M. RUGGERI, I. R. WHITE, and J. L. VAZQUEZ-BARQUERO Methodology of a multi-site reliability study: EPSILON Study 3 The British Journal of Psychiatry, July 1, 2000; 177 (39): s15 - s20. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. VAN WIJNGAARDEN, A. H. SCHENE, M. KOETER, J. L. VAZQUEZ-BARQUERO, H. C. KNUDSEN, A. LASALVIA, and P. McCRONE Caregiving in schizophrenia: development, internal consiconsistency and reliability of the Involvement Evaluation Questionnaire - European Version: EPSILON Study 4 The British Journal of Psychiatry, July 1, 2000; 177 (39): s21 - s27. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. CHISHOLM, M. R. J. KNAPP, H. C. KNUDSEN, F. AMADDEO, L. GAITE, and B. VAN WIJNGAARDEN Client Socio-Demographic and Service Receipt Inventory - European Version : development of an instrument for international research: EPSILON Study 5 The British Journal of Psychiatry, July 1, 2000; 177 (39): s28 - s33. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. McCRONE, M. LEESE, G. THORNICROFT, G. GRIFFITHS, S. PADFIELD, A. H. SCHENE, H. CHARLOTTE KNUDSEN, J. L. VAZQUEZ-BARQUERO, A. LASALVIA, and I. R. WHITE Reliability of the Camberwell Assessment of Need - European Version: EPSILON Study 6 The British Journal of Psychiatry, July 1, 2000; 177 (39): s34 - s40. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. RUGGERI, A. LASALVIA, R. DALL'AGNOLA, M. TANSELLA, B. VAN WIJNGAARDEN, H. C. KNUDSEN, M. LEESE, and L. GAITE Development, internal consistency and reliability of the Verona Service Satisfaction Scale - European Version: EPSILON Study 7 The British Journal of Psychiatry, July 1, 2000; 177 (39): s41 - s48. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. GAITE, J. L. VAZQUEZ-BARQUERO, A. A. ARRIZABALAGA, E. VAZQUEZ-BOURGON, M. P. RETUERTO, A. H. SCHENE, B. WELCHER, G. THORNICROFT, M. LEESE, and M. RUGGERI Quality of life in schizophrenia: development, reliability and internal consistency of the Lancashire Quality of Life Profile - European Version: EPSILON Study 8 The British Journal of Psychiatry, July 1, 2000; 177 (39): s49 - s54. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Psychiatric Bulletin | Advances in Psychiatric Treatment | All RCPsych Journals |