Authored by Domingos Emanuel Bevilacqua*,
Abstract
Introduction: While various sets of diagnostic criteria for hypermobility have been published, to date there is no recommended gold-standard, and diagnosis of hypermobility in children and their diagnosis is generally based on clinical judgement.
Objectives: The aims of this study were to test the inter-rater reliability of the Hospital Del Mar criteria, assessing the reliability of the total score as well as individual components of the score.
Methods: Secondary analysis of data was carried out from a retrospective study on a cohort of children under the age of 16 years, related to a joint clinic assessment. Two clinical evaluators examined those subjects using the Hospital Del Mar criteria [1] for diagnosing joint hypermobility (JH). Each evaluator also classified the subject as either hypermobile or normal based on their overall clinical findings. The Kappa statistic was used to calculate the level of agreement between the two evaluators.
Results: Thirty subjects were included in the study ranging in age from 3 to 12 years (mean = 7.02, ±2.47 SD). Of the 30 subjects assessed, 21 (30%) were classified as hypermobile. Overall, the prevalence of JH in this study was higher in boys than in girls.
Conclusion: In this group of children, the Hospital Del Mar criteria appeared to be reliable tool for diagnosing hypermobility. Inter-rater reliability was good to excellent when assessing JH. Specific thresholds for diagnosis need to be set dependant on the age and ethnic group of the population being studied.
Keywords: Children; Joint hypermobility; Diagnostic criteria; Iter-rater reliability; Validity; Reproducibility
Introduction
Joint hypermobility (JH), also known as joint laxity, is a condition where most of an individual’s synovial joints present an excessive range of movement (ROM) during passive or active movements, taking in consideration the age, gender and different ethnic group of the subject [2,3]. JH affects around 10% to 15% of the world population and is more prevalent in female subjects over male (3:1) [4,5]. Hypermobility decreases as people age [6-8], and it also seems to be associated with race being more frequent in African or Asian individuals when compared with white Caucasian descents [8,9]. While JH may be asymptomatic, in some cases it results in musculoskeletal complaints such as arthralgias and joint dislocation [2]. Epidemiological studies suggest that the prevalence of hypermobility depends also on the diagnostic criteria used [10,11]. There are several published literatures regarding diagnostic criteria for JH, but to date this condition remains underrecognised and poorly understood, and diagnosis is generally based on clinical judgement [12].
There are many diagnostic criteria established for identifying JH. The first scoring system was developed by Carter and Wilkinson in 1964 [13] and based on evaluation of five items - thumb abduction, elbow extension > 10°, finger extension > 90°, knee extension > 10°, ankle dorsiflexion and foot eversion - scoring a maximum of
5 points. These criteria were modified by Beighton PH and Horan F [14] in their Beighton and Horan Joint Mobility Index (BHJMI) which included the evaluation of (fifth finger extension, opposition of the thumb, elbow extension, knee extension , and trunk and hip flexion) scoring between zero and nine, where a total of five to nine indicate hypermobility. The latter in turn was amended by Beighton P, et al [15], who developed the Beighton Score to investigate the prevalence of JH in a rural community in South Africa. In 1983 Rotés J [16] created his own criteria including other items of clinical interest such as shoulder, cervical spine, hip and toe ROM. In 1992 Bulbena A, et al. [1] created the Hospital Del Mar criteria scoring one point/item (overall range zero to ten) including evaluation of apposition of the thumb, metacarpophalangeal, elbow, external shoulder rotation, hip abduction, rotular (patella) hypermobility, ankle and feet hypermobility, metatarsophalangeal, knee hyperflexion and ecchymoses. In 2000 Grahame R, et al. [17] developed the Brighton criteria for JH. These criteria are comprised of two major and/or eight minor criteria based on the Beighton score and four or more out of nine and arthralgia in four or more joints for more than three months. In 2005, Ferrari J, et al. [18] introduced the Lower Limb Assessment Score (LLAS), specifically designed for assessment of hypermobility in the lower limbs. These tests included movements of the joints in different planes of motion. While each of these criteria have recommendations by authors on how subjects should be scored, no specific thresholds have been determined to enable standardised diagnosis of hypermobile or not. Furthermore, most of these scoring systems are thought to be subjective and very few have been tested for validity and reliability [18]. Hence, to date there is no gold standard criteria for diagnosing JH.
The criteria proposed by Bulbena et al however, have been tested for validity in a previous study [1]. Hence the Hospital del Mar criteria (Table 1) have been shown to be valid tool in the diagnosis of JH. The reliability of these criteria however has not been established Therefore; the main aim of this study is to determine the level of reliability when the criteria are applied by two allied health professionals. Furthermore, a comparison of the classification for hypermobile or not by the two clinical evaluators (using their own clinical experience as a judgment) and the Hospital Del Mar will be made.
Table 1:Hospital Del Mar criteria for the assessment of joint hypermobility, (taken from Bulbena A, et al [1]). To score, each side is calculated separately giving a left score and right score. Each yes is given one mark. A total score of ten marks is available.
Materials and Methods
Sample
Analysis of data was carried out from a retrospective cohort of children assessed in a musculoskeletal clinic. The participants who provided the primary data were children under 16 years, asking to a multidisciplinary specialist, for a joint clinic assessment. Exclusion criteria included children with orthopaedics abnormalities such as hip dislocation, neurological condition, and systemic disease where the pathological conditions that would cause a limit to normal joint movement.
Procedure
The medical notes were reviewed, and the recordings of the hypermobility joint assessment were extracted. All the subjects included were examined and questioned by two health professionals on the same day, one physiotherapist and one podiatrist, both professionals who had received training in clinical examination of patients at the multidisciplinary team. Each health professional applied the Hospital Del Mar criteria during their routine assessment completing a proforma for this scoring system (Appendix). The two health professionals were blinded to each other evaluation; they did not have access to each other scores until the assessment was complete. There was no strict order to who assessed the patients first, and no order of application of the scoring system criteria. Each professional also classified the patient as either hypermobile or normal based on their overall clinical findings.
Data and statistical analysis
Data such as subject demographics, including gender and age were collected and analysed for descriptive statistics to mention the characteristics of the whole sample. Data from the hypermobility assessment collected from the proforma was transferred onto an Excel spreadsheet. As this study aimed to analyse reliability between two clinical evaluators, the Kappa coefficient was used. The Kappa value was calculated for each of the criteria, the right and the left side separately. An example of the calculation of Kappa of one category (left thumb) is demonstrated in Table 2. All the other categories were calculated in the same way.
Table 2:Statistical Analysis - The formulae for calculation of Kappa.
Results
Subject demographics
After applying the exclusion criteria, 30 subjects were included in the study. There was a slightly greater female predominance, 16 females (54%) and 14 (46%) males. Age ranged from 3 years to 12 years with an average age of 7.02 (+2.47 standard deviation).
Prevalence of JH
Of the 30 children assessed, 21 (70%) were classified as hypermobile, 11 boys (52.3%) and 10 girls (47.6%). Nine children (30%) were classified as a non-hypermobile, three boys (33.3%) and six girls (66.6%). Of the 30 children assessed, two children (one boy and one girl) showed a discrepancy in the clinical diagnosis by the two clinical evaluators, where one ratter classified a child as hypermobile and the other as non-hypermobile. Those children were the subjects 8 and 27. The subject 8 is a 9 years old girl, was classified as non-hypermobile by the podiatrist (HdelM = 3/10), but hypermobile by the physiotherapist (HdelM = 5/10). The subject 27 is an 8 years old boy, scored 4/10 (hypermobile) by the podiatrist, but scored 3/10 (non-hypermobile) by the physiotherapist. Overall, the prevalence of JH in this study was higher in boys than in girls (Table 3).
Table 3:Level of agreement.
Assessment using hospital del mar criteria
The results from the inter-rater comparison for individual components of the HdelM score using Kappa coefficient are demonstrated in Table 4. Kappa coefficients for the two evaluators were greater than 0.81 (usually considered as an excellent agreement beyond chance) in 2 of the 10 items (thumb and ecchymoses), but bilaterally on thumb and only on the right side for ecchymoses. Three items presented a kappa coefficient value between 0.61 and 0.8 (good agreement), they were shoulder and elbow bilaterally, and ecchymoses on the left side only. Two items presented Kappa value between 0.41 and 0.6 (moderate agreement), they were patella movement and ankle and feet (dorsiflexion / eversion). Two items presented kappa value between 0.21 and 0.4 (considered as a fair agreement), they were metatarsophalangeal on the right side and hip bilaterally. One item (metatarsophalangeal on the left side was below 0.21 (poor agreement). Two items (metacarpophalangeal and knee) could not have their kappa value calculated and were scored zero (agreement no better than chance). In both cases their proportional observed and expected had the same value and so the Kappa could not be calculated.
Table 4:Kappa values for assessment of JH using the Hospital del Mar criteria by Podiatrist vs. Physiotherapist.
The majority of agreement between medical evaluators occurred on passive apposition of the thumb, passive dorsiflexion of the fifth finger, passive hyperextension of the elbow, external shoulder rotation, knee hyperflexion, and ecchymoses. Most of the disagreement and lower kappa values occurred on passive hip abduction, rotular hypermobility, passive dorsiflexion of the ankle and eversion of the foot, and dorsal flexion of the first metatarsal.
Total scores and classification as hypermobile based on clinical experience
Following the assessment of the 30 subjects using the Hospital Del Mar criteria each subject were given a total score on both left and right side of their bodies and they were also classified as hypermobile or not based on clinical experience of the two health professionals who conducted the evaluations. A comparison with the Hospital Del Mar criteria threshold was made to find whether any subject would be missed out when diagnosing hypermobility (Table 5).
Table 5:Classification as hypermobile (H) or not (N).
Based on the total scores given by the two raters and considering the different cut-off point used in the Hospital Del Mar criteria, two subjects would be missed out on diagnosis of hypermobility. These differences occurred due to discrepancies between the scores given by the two raters to subject 8 and subject 27. The subject 8 was a female who was given a total score of 3 by podiatrist and 5 by physiotherapist. The subject 27 was a male who was given a total score of 4 by podiatrist but a total score of 3 by physiotherapist. Following the Hospital Del Mar criteria threshold the subject 8 could have been classified as non hypermobile if the total score given by podiatrist was taken in consideration, but hypermobile if the total score given by physiotherapist was considered. The subject 27 could have been classified as hypermobile if the total score given by podiatrist was considered, but non hypermobile if the total score given by physiotherapist was considered. Despite the difference in the total scores given by the two raters for the above subjects, both professionals classified the subject 8 as hypermobile and the subject 27 as non-hypermobile. These classifications were based on examiners’ own clinical experience and on clinical findings.
Discussion
The results of this study demonstrated some similarities to findings of other studies including similar subject demographics, prevalence of JH and clinical presentation. This study however demonstrated a higher prevalence of JH in boys than in girls, in contrast with previous studies which reported higher prevalence of JH in females [21-25]. The higher prevalence of JH in males in this study may be occurred due to the small sample size and broad range of age used.
In this study Kappa coefficients for the two raters were greater than 0.81 (usually considered as an excellent agreement beyond chance) in 2 of the 10 items (thumb and ecchymoses), but bilaterally on thumb and only on the right side for ecchymoses. Arguable in this study one subject had a positive score for bruising on one side and negative on the other side reported by the physiotherapist. This one result may have affected Kappa results negatively, because one discrepancy out of 30 can do such difference. The score for ecchymoses should not be necessary for both left and right sides because if an individual is prone to bruise easily it is surely for both sides. Three items presented a kappa coefficient value between 0.61 and 0.8 (good agreement), they were shoulder and elbow bilaterally, and ecchymoses on the left side only. Two items presented Kappa value between 0.41 and 0.6 (moderate agreement), they were patella and ankle and feet. The item patella was expected to have low agreement between the two raters due to the subjective interpretation of the rotular mobility. Two items presented kappa value between 0.21 and 0.4 (considered as a fair agreement), they were metatarsophalangeal on the right side and hip bilaterally. The item hip abduction was expected to have low percentage of agreement between raters because one examiner may mobilise joint tested slightly different with or without hip rotation and the result may be significantly different. One item (metatarsophalangeal on the left side was below 0.21 (poor agreement). Two items (metacarpophalangeal and knee) could not have their kappa value calculated and were scored zero (agreement no better than chance). In both cases their proportional observed and expected had the same value and so the Kappa could not be calculated.
The majority of disagreement and lower kappa values occurred on passive hip abduction, rotular hypermobility, passive dorsiflexion of the ankle and eversion of the foot, and dorsal flexion of the first metatarsal. The disagreement of the above-mentioned items could be due to difference in force applied by the two raters during passive mobility and/or due to lack of training phase in this study for improve the level of agreement between raters for such challenge tests.
In some of the items (elbow, shoulder, hip, and patella) the kappa values were the same in both left and right sides. However, in other items such as thumb, ankle and feet, Metatarsophalangeal, and ecchymoses the kappa values differed significantly between sides. The different kappa values between sides were: left thumb (k=0.81), right thumb (k=0.90), left ankle and feet (k=0.60), right ankle and feet (k=0.53), left Metatarsophalangeal (k=0.18), right Metatarsophalangeal (k=0.21), ecchymoses on the left side (k=0.76), and ecchymoses on the left side (k=0.85). It would be advisable to always carry out the assessment of JH using the Hospital Del Mar criteria bilaterally [26-35].
This study investigated the inter-rater reliability of the Hospital del Mar criteria when applied by two allied health professionals to identify hypermobility. A comparison of the classification as hypermobile or not amongst the two raters (using their own clinical experience as a judgment) and the Hospital Del Mar criteria (using different cut-off points for males and females) was made. The findings of this study are in agreement with Bulbena A, et al [1] and conclude that the Hospital Del Mar criteria provide the best ability to distinguish individuals with JH from those who did not have JH. Through comparison of the three classifications the Hospital Del Mar criteria were shown to have benefits over the already existent scoring systems. If replicated, these findings may give enhanced value to JH assessment in clinical and general population studies. Specific thresholds for diagnosis need to be set dependant on the age and ethnic group of the population being studied, and this may be investigated in future studies.
To read more about this article...Open access Journal of Rheumatology & Arthritis Research
Please follow the URL to access more information about this article
To know more about our Journals...Iris Publishers
No comments:
Post a Comment