Академический Документы
Профессиональный Документы
Культура Документы
© 2002 Published by Elsevier Science Ltd on behalf of OsteoArthritis Research Society International 1063–4584/02/$35.00/0
doi:10.1053/joca.2002.0533, available online at http://www.idealibrary.com on
International
Cartilage
Repair
Society
Summary
Objective: To assess and compare the test–retest reliability and the construct validity of the Lequesne and the French-Canadian version of
the WOMAC indexes.
Design: Patients with symptomatic knee osteoarthritis (OA) fulfilling the revised criteria of the American College of Rheumatology completed
both the Lequesne and the French-Canadian version of the WOMAC indexes twice at a 3-h interval. Impairment outcome measures,
patients’ perceived discomfort in walking and handicap were recorded. For both questionnaires, an analysis was performed item by item.
Repeatability was assessed using the intraclass correlation coefficient (ICC) and the Bland and Altman method. Construct validity was
investigated using the Spearman rank correlation coefficient and a factor analysis was performed.
Results: 88 patients were included. Eight questions of the WOMAC section C and one question of the Lequesne index had insufficient
psychometric properties. Although repeatability of questionnaires was fair to excellent (0.82, 0.68, 0.74, 0.95 for the WOMAC sections A, B,
C and Lequesne index respectively), construct validity could not be demonstrated. Factor analysis of the WOMAC extracted five factors
which differed from the a priori triple stratification. Factor analysis of the WOMAC section C extracted two factors explaining 71% of the
variance which could not be clinically characterized. For the Lequesne index, expected convergent correlations were not always achieved.
Three factors were extracted by factor analysis explaining 58% of the variance.
Conclusion: Despite their good test–retest reliability, the two composite indexes evaluated are not valid to assess the concept of functional
disability induced by knee OA in a French population. © 2002 Published by Elsevier Science Ltd on behalf of OsteoArthritis Research
Society International.
Key words: Knee, Osteoarthritis, Pain, Function.
602
Osteoarthritis and Cartilage Vol. 10, No. 8 603
of its simplicity (no misunderstanding, 3 to 4 minutes to floor’ (WC5), ‘Walking on flat’ (WC6), ‘Getting in/out of car’
complete). (WC7), ‘Going shopping’ (WC8), ‘Putting on socks/
The WOMAC (Western Ontario and McMaster Universi- stockings’ (WC9), ‘Rising from bed’ (WC10), ‘Taking off
ties) index is an English-language questionnaire developed socks/stockings’ (WC11), ‘Lying in bed’ (WC12), ‘Getting
and validated more recently by Bellamy et al. in a compara- in/out of bath’ (WC13), ‘Sitting’ (WC14), ‘Getting on/off
tive trial of non-steroidal antiinflammatory drugs used for toilet’ (WC15), ‘Heavy domestic duties’ (WC16), ‘Light
knee and hip OA8 and in a population followed after total domestic duties’ (WC17).
hip or knee arthroplasty in OA12. This self-administered Each of these 24 questions is graded either on a
composite questionnaire includes five questions about five-point Likert scale or a 100-mm visual analogue scale
pain, two questions about stiffness, and 17 about degree of (VAS)9 ranging from ‘no or 0’ to ‘extreme or 100’. In this
difficulty in accomplishing daily life activities. The score of
study, we used the VAS as in the French-Canadian
each subscale, pain, stiffness, and disability, is calculated
separately. A total score which aggregates dimensions into version16. Before answering questions, patients read
a global index has been proposed but has not been instructions about how to use the VAS. The score of section
validated, and the author recommends that the dimensions A ranges from 0 to 500, for Section B from 0 to 200 and for
be kept separate and the analysis conducted on a section C from 0 to 1700.
subscale-by-subscale basis9. This index is progressively The Lequesne OA index is a 10-question interview
becoming the most widely used instrument for assessment format questionnaire which was designed as a single unit.
of OA-specific health status in Europe; it is currently Thus, this index was used as a single unit to assess its
available in German13, Swedish14, Hebrew15, Italian and test–retest reliability and construct validity. By contrast, to
Spanish9. In France, a French-Canadian version is used, study the convergent and divergent validity of WOMAC
but its psychometric properties cannot be ascertained16. index, we broke apart the Lequesne index into three parts,
Three studies comparing the Lequesne and WOMAC as did Nicholas Bellamy in the validation study of
indexes have already been published. Two of them con- WOMAC8, in order to compare our results to those already
cerned only their responsiveness17,18, and the other13 had published. These three sections assess ‘pain or discomfort’
several methodological weaknesses. (LI), ‘maximum distance walked’ (LII) and ‘activities of daily
The aim of this work was to assess and compare the living’ (LIII): they are not usually graded separately. The
construct validity and test–retest reliability of the Lequesne first section contains five questions about ‘Pain or discom-
and the French-Canadian version of the WOMAC indexes fort during nocturnal bedrest’ (LIA), ‘duration of morning
in a French population. stiffness or pain after getting up’ (LIB), whether ‘Remaining
standing for 30 minutes increases pain’ (LIC), ‘Pain on
walking’ (LID), ‘Pain or discomfort when getting up from
Materials and methods sitting position without the help of arms’ (LIE). Questions IC
and IE are graded dichotomously: 0=no, 1=yes. Questions
PATIENTS LIA, LIB and LID are graded as follows: ‘0=no’, ‘1=only on
movement or in certain positions’, ‘2=without movement’
Out- and in-patients aged 40–80 years with symptomatic for IA, ‘0=no’, ‘1=less than 15 minutes’, ‘2=15 minutes or
knee OA fulfilling the clinical and radiographic revised more’ for LIB, and ‘0=no’, ‘1=only after walking some
criteria of the American College of Rheumatology20, for at distance’, ‘2=early after starting’ for LIC. The second sec-
least 6 months, were recruited from Departments of tion (LII) is graded from ‘0=unlimited’ to ‘6=less then 100
Rheumatology, Rehabilitation and Orthopedic surgery of a meters’ (‘1=more than 1 km, but limited’, ‘2=about 1 km
tertiary care teaching hospital. (about 15 minutes)’, ‘3=from 500 to 900 meters (about
Patients were excluded on the basis of following criteria: 8–15 min)’, ‘4=from 300 to 500 meters’, ‘5=from 100 to 300
(a) absence of written consent, (b) absence of knee X-ray meters’). This score is upgraded by one point ‘if the patient
in the previous 3 months, (c) having other disabling lower uses one walking stick or crutch’ or by two points ‘if the
limb osteoarthropathy or myopathy, (d) respiratory and patient uses two walking sticks or crutches’. The third
heart failure, (e) inability to speak and read French fluently, section (LIII) assesses difficulty in daily living activities. The
(f) severe psychiatric disorders, (g) isolated patellofemoral questions are: ‘Can you go up a standard flight of stairs’
OA. (LIIIA), ‘Can you go down a standard flight of stairs’ (LIIIB),
‘Can you squat’ (LIIIC), ‘Can you walk on uneven ground’
(LIIID). The score for each question is graded from
THE SCALES ’0=without difficulty’ to ‘2=unable to do’ (’0.5=with slight
difficulty’, ‘1=moderate difficulty’, ‘1.5=great difficulty’). The
The French-Canadian version of the WOMAC OA Lequesne OA index is scored as the sum of all questions
index16 is a self-administered composite questionnaire with ranging from 0 to 24.
a three-dimensional measure of pain, joint stiffness and
degree of difficulty to accomplish daily life activities. The
first subscale (section A) includes five questions about pain
when ‘Walking on a flat surface’ (WA1), ‘Going up or down STUDY DESIGN
stairs’ (WA2), ‘At night while in bed’ (WA3), ‘Sitting or lying’
(WA4), ‘Standing upright’ (WA5). The stiffness scale (sec- The two questionnaires were completed twice at a 3-h
tion B) includes two questions about stiffness ‘after first interval. Delusive questions were added in the scales for
awakening in the morning’ (WB1) and ‘after sitting, lying or the second assessment. Strict instructions were given to
resting later in the day’ (WB2). The third subscale (section the patients that WOMAC had to be performed alone,
C) includes 17 questions about the degree of difficulty without help, and that the instructions had to be read before
when ‘Descending stairs’ (WC1), ‘Ascending stairs’ (WC2), answering items. Patients’ demographic and clinical
‘Rising from sitting’ (WC3), ‘Standing’ (WC4), ‘Bending to characteristics were collected.
604 M. Faucher et al.: Comparison of WOMAC and Lequesne indexes
PILOT STUDY score of the Lequesne index (CLEQ). For the Lequesne
index, scores of sections A, B, C, VAS P, VAS H, and VAS
Patients completed the questionnaires in order to check Dw were used for convergent correlation. All the VAS used
for any misunderstandings (see results). ranged from 0 (no pain, no handicap, no discomfort) to
100 mm (maximum pain, maximum handicap, maximum
TESTING THE SCALES discomfort). The VAS H was accompanied by the question:
‘When considering your needs for daily life, what is your
The answers were checked before data recording and handicap level due to knee osteoarthritis?’ These VAS were
statistical analysis. In accordance with the standards explained to each patient and were completed after the
published by the American Psychological Association investigator was sure that the concept was understood.
(APA)21,22, the following properties of items and scales (2) Divergent validity was assessed by correlating the
were assessed: subscale scores of WOMAC and the global score of the
Lequesne index with variables known to have a weak or no
Item analysis relation with functional disability, stiffness and pain. For
both questionnaires these variables were the HADS (Hos-
For this step a ‘never done’ choice was added for pital Anxiety and Depression Scale, range from 0 to 21 for
questions A2, C1, C2, C7, C8, C13, C16, C17 of the depression and anxiety respectively)26, the radiological
WOMAC and for questions of the third section of the score of osteoarthritis adapted from Kellgren’s radiologic
Lequesne index (IIIA, IIIB, IIIC, IIID). This ‘never done’ score3 (0=no OA, 1=doubtful, 2=minimal OA, 3=moderate
choice concerned only questions about daily activities, and OA, 4=severe OA, range from 0 to 4), and the circumfer-
instructions to patients specified that this answer was to be ence of the thigh measured in centimeters at 10 cm above
chosen only if the activity was not done before the appear- the patella. For each section of the WOMAC index the two
ance of symptoms of knee OA. For each item a ceiling or other sections were considered as divergent.
floor effect was checked. Test–retest reliability of each item (3) Factor analysis was performed using principal com-
was studied using the intraclass coefficient (ICC)23 or the ponent analysis to extract factors. The retained factors had
degree of agreement calculated using the kappa coefficient eigenvalues>1. Independent factors were obtained using
() for binary items24. Reliability was considered to be the Varimax rotation method. For the WOMAC index,
insufficient when ICC and coefficient values were less several steps were followed to study the factorial structure
than 0.65. of the scale:
• the first step was to ascertain the a priori stratification
Psychometric properties of the scales (pain, stiffness, function) of the scale; thus, factor
analysis was performed on the whole questionnaire.
Face validity. The acceptability of each scale was studied. • the second step was to assess the factorial structure of
Item-by-item analysis was performed to detect concerning each of the sections.
missing responses. The time needed to complete the For the Lequesne index, factor analysis was performed
questionnaires was noted. on the whole questionnaire.
Test–retest reliability. The questionnaires were com-
pleted twice at a 3-h interval. The requirement for absence STATISTICAL ANALYSIS
of variation in clinical status of outpatients and patients
hospitalized the day before joint lavage or prosthetic knee Statgraphics SYSTAT 9 Delta Soft® for Windows
replacement imposed this short interval. To avoid patients NT/97/98 software was used for all statistical analyses.
remembering previous answers, we concealed the num- Quantitative variables were described using means, stan-
bers of the questions and randomly added delusive items to dard deviations (S.D.), minimum and maximum values.
both scales; the data concerning these items were not Test–retest reliability was assessed using simultaneously
included in the statistical study. A patient’s overall assess- the intraclass correlation coefficient (ICC)23 and Bland and
ment of knee pain and discomfort was recorded on a Altman method27. These two methods give complementary
height-level adjectival ordinal scale in order to distinguish information as shown by Atkinson et al. and I. Kuei Lin et
clinically stable from improved or worsened patients. Only al.29. For binary variables, test–retest reliability was calcu-
clinically stable patients were assessed. Reliability was lated using the coefficient of agreement. Correlation
assessed for the global score of the Lequesne index and between two quantitative variables was assessed with the
subscores of sections A, B, C of the WOMAC. non-parametric Spearman rank correlation coefficient (r),
as a normal distribution could not be demonstrated for all
the parameters studied. Spearman coefficient values were
Validity. Construct validity was investigated in three ways:
interpreted as excellent relationship >0.91; good 0.90–
(1) Convergent validity was assessed by correlating
0.71; fair 0.70–0.51; weak 0.5–0.31; little or none <0.323.
subscale scores of the WOMAC index and the global score
Factor analysis was performed as described above to
of the Lequesne index with variables that could be
explore the factorial structure of the two scales.
expected to have a converging relationship. For section A
of the WOMAC, the expected correlated variables were
global pain intensity in the last 48 h assessed on a visual Results
analog scale (VAS P) and the pain score of the Lequesne
index (ALEQ). For section B, the expected correlated PATIENTS
variable was the stiffness score of the Lequesne index Demographic and clinical data
(BLEQ). For section C the expected correlated variables
were Handicap VAS (VAS H)25, discomfort in walking for For the pilot study 19 patients (12 women) tested the two
daily living activities VAS (VAS Dw), and the functional algofunctionnal indices. Their mean age was 70.31±8.17
Osteoarthritis and Cartilage Vol. 10, No. 8 605
Table I
Demographic and clinical characteristics of the patients
Means S.D. Minimum Maximum
VAS: visual analog scale; VAS Dw: VAS discomfort in walking for daily living activities.
(range 46–80 years). Seventeen were retired, one was Test–retest reliability
employed, and one was on sick leave.
For the study, 88 patients (59 women and 29 men) The questionnaires were administered twice at an inter-
completed the Lequesne and WOMAC indexes between val of 3.04 h±0.24 h (minimum 2.66–maximum 3.50) to 32
January and June 2001. Their mean age was 67.1±10.2 patients. The mean score of section A of the WOMAC at
years (range 40–80 years). Fifty-one (58%) were in- and baseline visit was 247.78±94.26 (41–421); it was
outpatients in the Orthopaedic Surgery Department, and 37 107.13±58.63 (0–191) for section B and 599.26±273.27
(42%) were recruited from Departments of Rheumatology (124–1170) for section C. The score for the Lequesne index
and Rehabilitation. Table I shows demographic and clinical was 13.04±4.37 (2–20.5).
characteristics of the patients. 81.8% were retired, 7.3% on Mean scores at the second visit were 244.00±100.05
sick leave, 9.1% employed, and 2.3% unemployed. (43–406), 98.12±51.32 (0–184), 615.79±273.49 (126–
1095) for the WOMAC sections A, B and C respectively. It
was 12.90±4.39 (3.5–21) for the Lequesne index.
PILOT STUDY The reliability assessed by ICC (shown in Tables II and
III) was excellent for the Lequesne index (0.95), good for
48% of the patients needed explanation of the WOMAC section A (0.82) and section C (0.74) of the WOMAC, and
instructions and 42% of how to complete the VAS. 34% and only fair for section B (0.68). Bland and Altman analysis
21% of the patients had difficulty in answering at least one showed that means of the differences did not differ signifi-
question of the WOMAC and Lequesne indexes respect- cantly from 0 and no systematic trend was observed
ively. These difficulties were related to the variability of (Fig. 1).
disability or pain with time and intensity of the task.
Fig. 1. Reliability of the three sections of the WOMAC and of the Lequesne index: graphic representation according to the Bland and Altman
technique; r: Spearman correlation coefficient between differences and means of the measures.
Osteoarthritis and Cartilage Vol. 10, No. 8 607
Table IV
Construct validity of the three sections of the WOMAC index
Section A Section B Section C
Convergent validity
Lequesne pain score 0.43 Lequesne stiffness score 0.51 Lequesne function score 0.72
VAS pain 0.69 VAS handicap 0.37
VAS Dw 0.72
Divergent validity
Score of anxiety 0.38 Score of anxiety 0.27 Score of anxiety 0.38
Score of depression 0.27 Score of depression 0.17 Score of depression 0.35
Score of Kellgren 0.01 Score of Kellgren 0.12 Score of Kellgren 0.18
Circumference of the thigh 0.26 Circumference of the thigh 0.23 Circumference of the thigh 0.36
Section B 0.61 Section A 0.61 Section A 0.84
Section C 0.84 Section C 0.74 Section B 0.74
VAS: visual analog scale; VAS Dw: VAS discomfort in walking for daily living activities.
Table VI
Factors in factor analysis and Varimax rotated factor matrix of the whole WOMAC index and sections A and C
WOMAC index Section A Section C
section C was better correlated with section A (assessing idea of the need to use unidimensional assessment
pain) than with VAS H and VAS Dw, two assessment tools indexes35. Finally, when Creamer and colleagues33
measuring concepts that are supposed to be more closely assessed the correlation between function (evaluated by
related to function than to pain. The correlation value WOMAC section C) and pain evaluated by an other instru-
between section C and VAS H was weak and lower than ment than WOMAC section A, they found, as we did with
with VAS P, as was observed by Wigler et al. in their pain evaluated with VAS, a weak correlation.
validation study of a Hebrew version of WOMAC15. It is Concerning the Lequesne index, while expected diver-
unlikely that this could be due to patient misunderstanding gent validity was observed, expected convergent correla-
of the VAS H and VAS Dw for two reasons. First, they were tions were not always reached. In fact, correlation
explained to each patient and were completed after the coefficient with VAS P was weaker than expected. This
investigator was sure that the concept was understood. could be due to the algo-functional character of the index,
Second, VAS H and VAS Dw, which are supposed to where function is more important than pain. However the a
measure different but near dimensions, had an expected priori algo-functional structure of this index was not
correlation coefficient of 0.61. One possible explanation demonstrated after factor analysis.
for the high correlation between sections A and C of Factor analysis of the whole WOMAC index extracted
the WOMAC, which has been previously observed by five factors which differed from the a priori triple stratifica-
Thumboo et al.32 and Creamer et al.33, could be pain and tion. Two hypotheses can be advanced to explain this
function items addressing the same task. This hypothesis is discrepancy: pain, stiffness, and function should not be
supported by the high correlations found between ques- considered as different dimensions; it is, however, more
tions A1 and C6 (r=0.73), questions A4 and C3 (r=0.70), likely that the results could be partly explained by the
and questions A5 and C4 (r=0.79), which assess the same redundancy between pain and function items assessing the
activity for pain or disability. Using rash analysis, Ryser same tasks, as mentioned above. This hypothesis is
et al. obtained the same results34. Using the same turn of supported by the presence of pain and function items
phrase in questions assessing pain and function seems to assessing the same tasks in the same extracted factor.
disrupt patient ability to distinguish the two concepts. This Our results of construct validity are in contradiction with
observation points out the difficulty of assessing different several studies assessing the WOMAC in other languages
dimensions in the same questionnaire and reinforces the and concluding to a valid questionnaire. Stucki et al.13 did
Osteoarthritis and Cartilage Vol. 10, No. 8 609
21. American Psychological Association. Standards for 33. Creamer P, Lethbridge-Cejku M, Hochberg MC.
Educational and Psychological Testing. Washington, Factors associated with functional impairment in
DC: American Psychological Association 1985. symptomatic knee osteoarthritis. Rheumatology
22. Fermanian J. Evaluer correctement la validité d’une 2000;39:490–6.
échelle: les nombreux pièges à éviter. Rev Epidém et 34. Ryser L, Wright BD, Aeschlimann A, Mariacher-Gehler
Santé Publ 1996;44:278–86. S, Stucki G. A new look at the Western Ontario and
23. Fermanian J. Mesure de l’accord entre deux juges: cas McMaster Universities Osteoarthritis Index using
quantitatif. Rev Epidém et Santé Publ 1984;32: rash analysis. Arthritis Care Res 1999;12:331–5.
408–13. 35. Silverstein B, Kilgore KM, Fischer WP, Harley JP,
24. Fermanian J. Mesure de l’accord entre deux juges. Harvey RF. Applying psychometric criteria to func-
Cas qualitatif. Rev Epidém et Santé Publ tional assessment in medical rehabilitation: I. Explor-
1984;32:140–7. ing unidimensionality. Arch Phys Med Rehabil
25. Lequesne M, Samson M, Bakouche S. Utilisation 1991;72:631–7.
d’une échelle visuelle analogique pour 36. Duruöz MT, Poireaudeau S, Fermanian J, Menkes CJ,
l’autoappréciation du handicap dans les coxopathies Amor B, Dougados M, et al. Development and vali-
de l’adulte. Rev Rhum Mal Osteoartic 1991;58:694. dation of a rheumatoid hand functional disability
26. Lépine JP, Godchau M, Brun P. Anxiety and depres- scale that assess functional handicap. J Rheumatol
sion in inpatients. Lancet 1985;1425–26. 1996;23:1167–72.
27. Bland JM, Altman DG. Statistical methods for assess- 37. Poiraudeau S, Lefevre-Colau MM, Fermanian J, Revel
ing agreement between two methods of clinical M. The ability of the Cochin rheumatoid arthritis hand
measurement. Lancet 1986;1:307–10. functional scale to detect change during the course of
28. Atkinson G, Nevill A. Comment on the use of concord- disease. Arthritis Care Res 2000;13:296–303.
ance correlation to assess the agreement between 38. Kopec JA, Esdaile JM, Abrahamowicz M, Abenhaim L,
two variables. Biometrics 1997;52:775–7. Wood-Dauphinee S, Lamping DL, et al. The Quebec
29. I-Kuei Lin L, Chinchilli V. Rejoinder to the letter to the Back Pain Disability Scale. Measurement properties.
editor from Atkinson and Nevill. Biometrics Spine 1995;20:341–52.
1997;52:777–8. 39. Wlodyka-Demaille S, Poiraudeau S, Catanzariti JF,
30. Streiner DL, Norman GR. Health measurement scales. Rannou F, Fermanian J, Revel M. French translation
A practical guide to their development and use. and validation of three functional disability scales for
Oxford: Oxford University Press 1989. neck pain. Arch Phys Med (accepted for publication).
31. Guyatt GH, Feeny DH, Patrick DL. Measuring health- 40. Poiraudeau S, Chevalier X, Conrozier T, Flippo R,
related quality of life. Ann Intern Med Lioté F, Noël E, et al. Reliability, validity, and sensi-
1993;118:622–9. tivity to change of the Cochin hand functional disabil-
32. Thumboo J, Chew LH, Soh CH. Validation of the ity scale in hand osteoarthritis. Osteoarthritis Cart
Western Ontario and McMaster University osteoar- 2001;9:570–7.
thritis index in Asians with osteoarthritis in Singapore.
Osteoarthritis Cart 2001;9:440–6.