Clinical Prediction Rules for Physical Therapy Interventions: A Systematic Review Jason M Beneciuk, Mark D Bishop and Steven

Z George PHYS THER. 2009; 89:114-124. Originally published online December 18, 2008 doi: 10.2522/ptj.20080239

The online version of this article, along with updated information and services, can be found online at: http://ptjournal.apta.org/content/89/2/114 Online-Only Material Collections http://ptjournal.apta.org/content/suppl/2009/02/06/89.2.11 4.DC1.html This article, along with others on similar topics, appears in the following collection(s): Clinical Prediction Rules Evidence-Based Practice Systematic Reviews/Meta-analyses 2 e-letter(s) have been posted to this article, which can be accessed for free at: http://ptjournal.apta.org/cgi/eletters/89/2/114 To submit an e-Letter on this article, click here or click on "Submit a response" in the right-hand menu under "Responses" in the online version of this article. E-mail alerts Sign up here to receive free e-mail alerts

e-Letters

Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

Research Report

Clinical Prediction Rules for Physical Therapy Interventions: A Systematic Review

Jason M Beneciuk, Mark D Bishop, Steven Z George
JM Beneciuk, PT, DPT, FAAOMPT, is currently enrolled in the Rehabilitation Sciences Doctoral Program (PhD), Department of Physical Therapy, University of Florida, PO Box 100154, Gainesville, FL 32610-0154 (USA). Address all correspondence to Dr Beneciuk at beneciuk@phhp.u.edu. MD Bishop, PT, PhD, is Assistant Professor, Department of Physical Therapy, University of Florida. SZ George, PT, PhD, is Assistant Professor, Department of Physical Therapy, Brooks Center for Rehabilitation Studies, University of Florida. Mailing address: Department of Physical Therapy, University of Florida, PO Box 100154, Gainesville, FL 32610-0154 (USA). Address all correspondence to Dr George at: szgeorge@phhp.u.edu. [Beneciuk JM, Bishop MD, George SZ. Clinical prediction rules for physical therapy interventions: a systematic review. Phys Ther. 2009;89:114 124.] 2009 American Physical Therapy Association

Background and Purpose. Clinical prediction rules (CPRs) involving physical therapy interventions have been published recently. The quality of the studies used to develop the CPRs was not previously considered, a fact that has potential implications for clinical applications and future research. The purpose of this systematic review was to determine the quality of published CPRs developed for physical therapy interventions. Methods. Relevant databases were searched up to June 2008. Studies were
included in this review if the explicit purpose was to develop a CPR for conditions commonly treated by physical therapists. Validated CPRs were excluded from this review. Study quality was independently determined by 3 reviewers using standard 18-item criteria for assessing the methodological quality of prognostic studies. Percentage of agreement was calculated for each criterion, and the intraclass correlation coefcient (ICC) was determined for overall quality scores.

Results. Ten studies met the inclusion criteria and were included in this review. Percentage of agreement for individual criteria ranged from 90% to 100%, and the ICC for the overall quality score was .73 (95% condence interval .27.92). Criteria commonly not met were adequate description of inclusion or exclusion criteria, inclusion of an inception cohort, adequate follow-up, masked assessments, sufcient sample sizes, and assessments of potential psychosocial factors. Quality scores for individual studies ranged from 48.2% to 74.0%. Discussion and Conclusion. Validation studies are rarely reported in the
literature; therefore, CPRs derived from high-quality studies may have the best potential for use in clinical settings. Investigators planning future studies of physical therapy CPRs should consider including inception cohorts, using longer follow-up times, performing masked assessments, recruiting larger sample sizes, and incorporating psychological and psychosocial assessments.

Post a Rapid Response or nd The Bottom Line: www.ptjournal.org 114 f Physical Therapy Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012 February 2009

Clinical Prediction Rules for Physical Therapy Interventions

linical prediction rules (CPRs) (or clinical decision rules) have become popular in the physical therapy literature. The intent of CPRs is to assist clinicians in making a diagnosis, establishing a prognosis, or implementing an intervention.1 Although it has been suggested that well-constructed CPRs can improve clinical decision making and practice,2 there is a lack of consensus as to what constitutes a methodologically sound CPR, especially in the derivation stage. McGinn and colleagues3 recommended a 3-step process in the development and testing of a CPR. The rst step involves the derivation of the CPR (derivation studies), and the second step involves the validation of the CPR (validation studies). The third step involves assessment of the impact of the rule on clinical behavior, also referred to as an impact analysis. For CPRs for physical therapy interventions, steps 2 and 3 are not routinely performed. Although it has been suggested that a validated CPR can be applied in various settings with condence in its accuracy,4 our impression is that most CPRs reported in the physical therapy literature are derivation studies. Furthermore, the lapse in time before validation occurs can be extensive. This situation presents clinicians with the dilemma of whether they should incorporate the results of a derivation study into their clinical practice. Our opinion is that the quality of a derivation study is one factor that should be considered before a CPR is implemented into clinical practice. This interpretation can be difcult, however, because the quality of CPR derivation studies pertaining to interventions has not been reported. Assessing the quality of derivation studies has potential advantages for physical therapy practice and research. First, a quality assessment
February 2009

will assist clinicians in deciding whether a given CPR is appropriate for implementation into clinical practice. Second, a quality assessment will assist future researchers in the design of high-quality studies for the development of new CPRs. Therefore, the purpose of this systematic review was to determine the quality of CPRs developed for interventions used by physical therapists. Studies were included in this review if the explicit purpose was to develop a CPR related to a specic intervention approach for conditions commonly treated by physical therapists. Previously validated CPRs were excluded from this review because there is less debate over the clinical application of validated CPRs2 and because methodological concerns about derivation studies are of less concern when a validation study has been reported.

Method
Data Sources and Searches A systematic review of relevant databases (PubMed, CINAHL, ProQuest, and Academic Search Premier) from their inception up to June 2008 resulted in the retrieval of 49 potential publications (Figure). The search strategy began with the lter predict$ OR clinical$ OR outcome$ OR risk$.5 In comparison with a gold standard,6 this lter has a sensitivity of 98.4% for retrieving CPRs from the literature.5 A second search strategy consisted of the key words clinical prediction rule. The rst author examined reference lists from all selected publications to verify that no pertinent publications were missed during the above-described searches. Studies were included in this review if the explicit purpose was to develop a CPR related to a specic intervention approach for conditions commonly managed by physical therapists. Previously validated CPRs were excluded from this review.

Data Extraction and Quality Assessment Quality scores were independently assigned to eligible studies by 3 reviewers using a modied version of a list of criteria, reported by Kuijpers et al,7 for assessing the methodological quality of prognostic studies. These criteria were selected because, in our experience, the physical therapy literature has followed a model that uses cohort designs for CPR derivation studies. Therefore, CPR derivation studies involving physical therapy interventions are appropriate for quality assessment tools that are sensitive to methodological issues that affect prognostic studies.8 Another reason why these criteria were appropriate for our purpose was that they were developed by authors aware of issues related to CPRs. Specically, Kuijpers et al9 later reported a CPR for determining the prognosis for patients with shoulder pain in general practice settings. The original list of criteria7 was altered slightly by removing the criterion related to the rate of response of potential study participants because this item is not commonly reported in the physical therapy literature. Additionally, we added an important criterion by including masking of outcome assessors and treating clinicians.6,8 In our opinion, the resulting criteria are similar to those that have been suggested for evaluating the quality of prognostic studies for patients receiving physical therapy care8 and are consistent with the process of evaluating prognostic variables.10 The 18 criteria used to assess quality in this systematic review represented 8 categories: study population, response information, followup, intervention, outcome, masking, prognostic factors, and data presentation. A description of each criterion is provided in the Appendix.
Physical Therapy f 115

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

Clinical Prediction Rules for Physical Therapy Interventions

Figure.
Flow chart depicting search and selection process for clinical prediction rule (CPR).

The criteria could be scored as positive, negative, or unclear. A positive score indicated that the criterion was identied in the study and met specic requirements consistent with a high-quality prognostic study. A negative score indicated that the criterion was identied in the study but did not meet specic requirements. A score of unclear meant that the study provided insufcient information regarding that criterion. To obtain a conservative estimate of quality, negative and unclear ratings were collapsed when study quality was rated. A total quality score was
116 f Physical Therapy

determined by adding positive scores, providing a potential high score of 18 (100%). Ratings of individual studies to determine quality scores were independently assigned by the 3 reviewers before a meeting on the interpretation of the 18-item list of criteria (time 1). The meeting provided an opportunity for reviewers to assess agreement and discuss criteria that resulted in high disagreement. In addition, components for a given criterion that may have been overlooked by reviewers were claried. As ap-

propriate, a quality criterion was updated to reect an updated interpretation. For example, there were differences in opinion about what constituted a prospective study (criterion E). During the meeting, an operational denition for a prospective study was approved. After the meeting, the 3 reviewers again independently assigned ratings (time 2), this time using the nal guidelines provided in the Appendix. Data Synthesis and Analysis Statistical pooling of results was not performed because of the obvious
February 2009

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

Clinical Prediction Rules for Physical Therapy Interventions heterogeneity among studies in populations used, interventions applied, and outcome measures administered. Reliability analyses were performed with SPSS 15.0 for Windows* and Excel. Percentage of agreement was calculated for individual items. Negative and unclear ratings were collapsed into one variable so that ratings could be dichotomized into 2 categories. Interrater reliability was reported for the total quality score by use of the intraclass correlation coefcient (ICC [2,1]) and respective 95% condence intervals (CI).11 To determine a single overall quality score for an individual study (Tab. 1), each of the 3 reviewers scores for a particular study were averaged to account for the possibility that interrater agreement was less than 100% after time 2. Therefore, the overall quality scores solely reect the results after time 2 ratings. As in other reviews using this scoring system, high-quality studies were operationally dened as those that had average quality scores of greater than 60%.7 Table 1.
Individual Clinical Prediction Rule (CPR) Studies and Mean Overall Quality Scores
CPR (Study) Stabilization exercise for low back pain (LBP) (Hicks et al34) Muscle trigger point therapy for chronic tension-type headache (Fernandez-de-las-Penas et al38) Inability of people with LBP to show improvement with spinal manipulation (Fritz et al29) Thoracic spine manipulation for neck pain (Cleland et al30) Multimodal intervention for cervical radiculopathy (Cleland et al37) Cervical manipulation for neck pain (Tseng et al31) Physical therapist management of cervicogenic headache (Jull and Stanton32) Patellar taping for patellofemoral pain syndrome (Lesher et al36) Lumbopelvic manipulation for patellofemoral pain syndrome (Iverson et al33) Hip mobilization for knee pain and clinical evidence of knee osteoarthritis (Currier et al35)
a

% Overall Quality Scorea 74.0 72.2 70.4 68.5 61.1 59.3 55.5 55.5 53.7 48.2

Mean of scores from all 3 reviewers after time 2.

Results
The initial search strategy yielded a total of 4,080 publications. A majority of the publications did not meet the criteria for review because they did not pertain to physical therapy interventions described in the Guide to Physical Therapist Practice.12 After titles were reviewed and duplicates were determined, 25 potential publications were further reviewed. Of these, 17 publications were excluded on the basis of the following criteria: not intervention based (n 12),9,1323 nonspecic intervention (n 3),24 26 and eventually validated CPR (n 2).27,28 Publications were excluded on the basis of the nonspecic intervention criterion
* SPSS Inc, 233 S Wacker Dr, Chicago, IL 60606. Microsoft Corp, One Microsoft Way, Redmond, WA 98052-6399.

if they did not report on the results of a specic physical therapy intervention approach or used multidisciplinary interventions. For example, methods consisting of various combinations of physical therapy interventions that were not specically described, such as exercises aimed at restoring neuromuscular control at the shoulder,26(pp12311232) or not described in general, such as physiotherapy for shoulder pain,24(p486) were grounds for exclusion. Gross and Battie25 used a multidisciplinary approach that consisted of physical therapy, occupational therapy, exercise therapy (kinesiology), medicine, and psychology but that was not specic to physical therapy alone; therefore, their study was also excluded. Additionally, studies that potentially included interventions that were not within the scope of physical therapy practice were excluded.26 The remaining 8 studies were included in this review. Two additional publications were included after a review of reference lists and related articles, resulting in the analysis of 10 publications in this review.

Five studies involved CPRs for responses to spinal manipulation.29 33 The other studies predicted responses to lumbar stabilization,34 hip mobilization,35 patellar taping,36 multimodal interventions for cervical radiculopathy,37 and trigger point therapy for headache38 (Tab. 1). Methodological Criteria Percentage of agreement on ratings of individual items ranged from 70% to 100%; items B, E, H, K, L, and P had the lowest levels of agreement (70% 86.7%) (Tabs. 2 and 3). After a meeting on the interpretation of the 18-item list of criteria, percentage of agreement on ratings of individual items ranged from 90% to 100% (Tabs. 2 and 3). Individual items commonly rated as low quality (ie, not meeting the criteria in greater than 50% of the studies) were items A, B, F, K, M, and R. Among these items, the inclusion of an inception cohort (item A), description of inclusion and exclusion criteria (item B), and follow-up of 6 months (item F) were met in 10% of the studies. The results indicated that for 6 items, all 3 reviewers were in absolute
Physical Therapy f 117

February 2009

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

Clinical Prediction Rules for Physical Therapy Interventions Table 2.

Interrater Reliability
Intraclass Correlation Coefcient (95% Condence Interval) .67 (.10.91) .73 (.27.92) Overall Quality Score X (%a) 11.47 (63.7) 11.13 (61.8) Range (%a) 715 (38.883.3) 714 (38.877.7)

rated at 50% to 60% (range 53.7% 59.3%), and one study35 was rated at less than 50% (48.2%).

Rating Time 1 2
a

Discussion
The intent of this review was to rate the methodological quality of CPR derivation studies reported in the physical therapy literature. This is an important issue because the quality of derivation studies for physical therapy interventions has not been systematically considered. The lack of consideration of derivation studies has important clinical and research implications. For example, CPR validation studies often are not performed, a fact that makes the decision to incorporate CPRs into clinical practice a potentially difcult one. One CPR has been validated in clinical settings with samples of patients similar to those included in the derivation study.28 However, this CPR has not been validated in different settings with new groups of patients and different intervention parameters.39 On the basis of the results of this review, several CPRs may be appropriate for clinical applications involving patients and clinical environments similar to those used in the CPR derivation process. We acknowledge that the quality of a derivation study is only one aspect of clinical decision making for the use of a CPR. However, it is information that was not previously reported and therefore might enhance clinical decision making. We used a quality score of greater than 60% as a cutoff score for a high-quality study, because this threshold was used in a previous review of prognostic studies.7 Studies that met this quality index included CPRs for determining factors associated with responses to stabilization exercises,34 responses to muscle trigger point therapy for tension-type headaches,38 the inability of patients with low back pain to show improvement with spinal maFebruary 2009

Overall quality score converted to percentage.

agreement that a given criterion was met across all studies reviewed (eg, all 3 reviewers were in absolute agreement that item B was met in 3% of all studies reviewed) (Tab. 4). Quality Score Absolute agreement among the 3 reviewers on overall quality scores was calculated at time 1 (ICC .67, 95% CI .10 .91) and after a meeting on

the interpretation of the 18-item list of criteria (time 2) (ICC .73, 95% CI .27.92) (Tabs. 2 and 3). Next, a mean quality score was calculated for each reviewer (Tab. 1). At time 2, mean quality scores for individual studies (X 11.13; 61.8%) ranged from 8.67 to 13.33 (48.2%74.0%). Five studies29,30,34,37,38 were rated at greater than 60% (range 61.1% 74.0%). Four studies3133,36 were

Table 3.
Individual Item Percentage of Agreement
% Agreement Among All 3 Reviewers Item A B C D E F G H I J K L M N O P Q R Inception cohort Inclusion/exclusion criteria Study population Nonresponders vs responders Prospective data collection Follow-up at 6 mo 20% Description Time 1 Rating 90.0 70.0 93.3 90.0 86.7 100.0 93.3 83.3 96.7 96.7 86.7 83.3 96.7 90.0 96.7 86.7 93.3 90.0 Time 2 Rating 90.0 96.7 93.3 90.0 96.7 100.0 93.3 90.0 96.7 96.7 93.3 96.7 96.7 90.0 96.7 100.0 93.3 90.0

Dropouts/loss to follow-up of

Information on subjects completing study vs loss to follow-up/dropouts Intervention fully described/standardized Standardized assessment of relevant outcome criteria Masking of outcome assessor and treating clinician Standardized assessment of subject characteristics and potential clinical prognostic factors Standardized assessment of potential psychosocial prognostic factors Frequencies of most important outcome measures Frequencies of most important prognostic factors Appropriate analysis techniques Prognostic model presented Sufcient numbers of subjects

118

Physical Therapy

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

Clinical Prediction Rules for Physical Therapy Interventions nipulation,29 manipulation of the thoracic spine in patients diagnosed with mechanical neck pain,30 and a multimodal intervention approach for cervical radiculopathy.37 The lower-quality studies included CPRs for predicting favorable responses to cervical manipulation in patients with neck pain,31 the management of cervicogenic headache,32 patellar taping,36 lumbopelvic manipulation in patients with patellofemoral pain syndrome,33 and hip mobilization for knee pain indicative of osteoarthritis.35 Quality scores can assist clinicians in deciding whether to use these nonvalidated CPRs. However, quality scores are not a substitute for CPR validation studies. Validation studies provide more-denitive information for clinical applications because they are independent studies of new subjects and involve a variety of clinicians and patients.1,3,6,40 An important factor to consider for a methodologically sound CPR derivation is the risk-to-benet ratio associated with its application. Risk was not empirically assessed in the CPRs considered in this review, a fact that is not surprising given the status of the physical therapy literature.41 Clinical prediction rules were originally developed in the medical profession for decisions involving higher associated risks, such as those associated with traumatic injuries.42 45 The risk associated with the interventions used in the CPRs considered in this review is believed to be minimal in comparison with the risk associated with emergency medicine. For example, consider the risk associated with the use of stabilization exercises for low back pain34 in comparison with the risk of not ordering radiographs for traumatic injuries.42 44 Failure to detect a fracture is associated with a risk higher than that associated with the use of stabilization exercises when those are not indicated. Unfortunately, the current physical therapy literature
February 2009

Table 4.
Methodological Criteria Commonly Receiving Low Ratings
Item B A F K R M Description Inclusion/exclusion criteria Inception cohort Follow-up at Masking Sufcient numbers of subjects Standardized assessment of potential psychosocial prognostic factors 6 mo % Positive Ratinga 3 10 10 27 40 47

a Items for which all 3 reviewers agreed (absolute agreement) that a given criterion was met across the 10 studies reviewed (eg, all 3 reviewers were in absolute agreement that item B was met in 3% of all studies reviewed).

does not allow a quantitative consideration of the risk-to-benet ratio, so clinical decisions must be based on qualitative factors. Individual items that received lowquality ratings were similar to previously suggested areas of methodological concern for CPR studies.2,6,40 Specically, masking of outcome assessors and treating clinicians (item K) did not occur in a majority of the studies reviewed. Masking of outcome assessors and treating clinicians is important for limiting the measurement bias of potential predictor variables.1,3,8 Additional areas of concern identied in this review included the use of an inception cohort and denition of the duration of symptoms in eligibility criteria. To limit potential error in establishing a prognosis, subjects should be enrolled in a common time frame with regard to their current condition.8 This criterion was not a component in a majority of the studies used to develop CPRs. Therefore, samples used to develop CPRs may lack homogeneity, thereby increasing the potential for bias in predictor variables and outcomes. Another area lacking in CPR derivation studies published to date was the follow-up period, which was suggested to be at least 6 months. Immediate effects were commonly reported; such immediate effects

might be benecial only in demonstrating evidence of responsiveness.8 Longer follow-up times are needed to demonstrate valid clinical implications for the use of a given intervention. Finally, an assessment of potential psychosocial prognostic factors (item M) was commonly not included. Psychological factors, such as kinesophobia, catastrophizing, anxiety, and depression might have strong inuences on outcomes related to musculoskeletal conditions.46 49 Incorporating these factors into the development process has important clinical implications for future CPRs. Limited sample sizes have been reported to be common methodological aws in CPR studies.2 It has been suggested that 10 to 15 subjects are required for each prospective predictor variable in CPR studies.50 Not meeting this requirement may lead to inaccurate statistical results because of overtting of regression models.50 It is important that our sample size determination was based on the nal CPR model and not on initial prospective variables. The result was that only 40% of studies had an adequate sample size, and this was a liberal estimate. If we had elected to use initial prospective variables, then no studies would have met the criterion for sample size, a result suggesting that previPhysical Therapy f 119

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

Clinical Prediction Rules for Physical Therapy Interventions ously noted concerns about small sample sizes used in CPR derivation studies are legitimate. We suggest that future studies include larger sample sizes to account for derivation regression models in addition to the nal, more parsimonious models. Several limitations of this systematic review should be considered in the interpretation of the results. Although the results may be relevant to the decision-making process for implementing a CPR in practice, our ndings should not be viewed as denitive. Our data provide complementary information on which CPRs to use in clinical practice, but the ultimate decision must be made in the context of a clinicians experience and factors specic to the encounter with a patient. These factors include, but are not limited to, whether patients seen in clinical practice are similar to those enrolled in the respective CPR study and whether a quantitative assessment of the risk-to-benet ratio is available. Another limitation is that the quality criteria used in this review were developed for prognostic studies, not specically for CPR derivation studies involving interventions. Although these study designs are similar, there may be subtle differences with regard to quality determinations. The quality criteria used in this review did not include certain statistical elements that may have important implications for CPRs. For example, the criteria did not include the consideration of a quantitative risk-to-benet analysis,41 reporting of potential predictor variable reliability,2,6 or reporting of CIs2,6 and effect sizes.51 Furthermore, the quality scores were equally weighted so that the methodological importance of a category was equally distributed among all of the criteria. This decision was made because we did not have clear evidence to follow for weighting decisions. Another relevant issue is that
120 f Physical Therapy

randomized designs have been suggested to be appropriate for CPR studies involving intervention selection.6,40 Although this may be true, it appears that the use of cohort studies is much more common in the physical therapy literature, because only one study included in this review used a randomized design.32 Therefore, future assessments of the quality of CPR derivation studies should include the development of a standardized rating system with a more-specic statistical criterion, consideration of weighting of quality scores on the basis of the methodological importance of particular categories, and the development of a criterion that is sensitive enough to determine the overall quality of a study design (such as distinguishing between cohort and randomized designs). There was substantial agreement among the raters on individual items and overall quality scores; however, it is clear that agreement can be improved. Improvement can be accomplished by providing quality criteria more explicit than previously reported criteria, especially with regard to inception cohort, responders versus nonresponders, frequency of outcome measures, and sample size determination. The reliability estimates were also imprecise (large 95% CIs); we believe that this result may have been attributable to the relatively small number of studies included in this review. Additionally, we opted to collapse negative and unclear ratings, a strategy that may have inuenced the percentage of agreement among the reviewers. However, this decision to collapse the data was made a priori and, even if the data had not been collapsed, the overall quality scores would not have been affected (Tab. 1). These scores considered only positive ratings because negative and unclear ratings were equally weighted as 0

when the overall quality scores were determined.7

Conclusion
This systematic review provides impetus for future research. First, it reinforces the importance and priority of performing validation studies. There are currently 10 CPR derivation studies in the physical therapy literature that have not been validated, and these studies vary greatly in overall quality. A glut of CPR derivation studies with various degrees of quality may only further confuse clinical practice, a result that is contrary to the original intent of CPRs. It is clear that follow-up validation studies are a high priority for advancing clinical practice. Second, the results of this review provide a clear direction for investigators wishing to conduct high-quality CPR derivation studies. In our opinion, the areas that should be a high priority for future derivation studies aimed at CPR development are recruiting inception cohorts, performing masked assessments, including longer follow-up times, collecting larger sample sizes, and incorporating psychological or psychosocial assessments.
All authors provided concept/idea/research design and writing. Dr Beneciuk and Dr Bishop provided data collection. Dr Beneciuk and Dr George provided data analysis. Dr George provided project management and fund procurement. Dr Bishop and Dr George provided consultation (including review of manuscript before submission). Dr Beneciuk was supported by a National Institutes of Health T-32 Neural Plasticity Research Training Fellowship (grant T32HD043730). Dr Bishop and Dr George were supported by grant R21 AT002796 awarded to Dr George from the National Institutes of Health/National Center for Complementary and Alternative Medicine. This article was received August 7, 2008, and was accepted October 30, 2008. DOI: 10.2522/ptj.20080239

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

February 2009

Clinical Prediction Rules for Physical Therapy Interventions References

1 Childs JD, Cleland JA. Development and application of clinical prediction rules to improve decision making in physical therapist practice. Phys Ther. 2006;86: 122131. 2 Cook C. Potential pitfalls of clinical prediction rules [editorial]. J Man Manip Ther. 2008;16:69 71. 3 McGinn TG, Guyatt GH, Wyer PC, et al. Users guides to the medical literature, XXII: how to use articles about clinical decision rules. Evidence-Based Medicine Working Group. JAMA. 2000;284:79 84. 4 McGinn TG, Guyatt GH, Wyer PC, et al. Diagnosis: clinical prediction rule. In: Guyatt GH, Rennie D, eds. Users Guide to the Medical Literature: A Manual for Evidence-Based Clinical Practice. Chicago, IL: AMA Press; 2002:471 483. 5 Ingui BJ, Rogers MA. Searching for clinical prediction rules in MEDLINE. J Am Med Inform Assoc. 2001;8:391397. 6 Laupacis A, Sekar N, Stiell IG. Clinical prediction rules: a review and suggested modications of methodological standards. JAMA. 1997;277:488 494. 7 Kuijpers T, van der Windt DA, van der Heijden GJ, Bouter LM. Systematic review of prognostic cohort studies on shoulder disorders. Pain. 2004;109:420 431. 8 Beattie PF, Nelson RM. Evaluating research studies that address prognosis for patients receiving physical therapy care: a clinical update. Phys Ther. 2007;87:15271535. 9 Kuijpers T, van der Windt DA, Boeke AJ, et al. Clinical prediction rules for the prognosis of shoulder pain in general practice. Pain. 2006;120:276 285. 10 Altman DG. Systematic reviews of evaluations of prognostic variables. BMJ. 2001;323:224 228. 11 Shrout P, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420 428. 12 Guide to Physical Therapist Practice. 2nd ed. Phys Ther. 2001;81:9 746. 13 Maher C. Clinical prediction rule for return to work after back pain. CMAJ. 2005;172:15751576. 14 Dionne CE, Bourbonnais R, Fremont P, et al. A clinical return-to-work rule for patients with back pain. CMAJ. 2005;172: 1559 1567. 15 Hancock MJ, Maher CG, Latimer J, et al. Can rate of recovery be predicted in patients with acute low back pain? Development of a clinical prediction rule. Eur J Pain. 28 April 2008 (epub ahead of print). 16 Kuijpers T, van der Windt DA, van der Heijden GJ, et al. A prediction rule for shoulder pain related sick leave: a prospective cohort study. BMC Musculoskelet Disord. 2006;7:97. 17 Kuijpers T, van der Heijden GJ, Vergouwe Y, et al. Good generalizability of a prediction rule for prediction of persistent shoulder pain in the short term. J Clin Epidemiol. 2007;60:947953. 18 Suissa S, Harder S, Veilleux M. The relation between initial symptoms and signs and the prognosis of whiplash. Eur Spine J. 2001;10:44 49. 19 Feuerstein M, Huang GD, Hauer AJ, Miller JK. Development of a screen for predicting clinical outcomes in patients with work-related upper extremity disorders. J Occup Environ Med. 2000;42: 749 761. 20 Heymans MWAJ, van Buuren S, Knol DL, et al. Return to work in a cohort of low back pain patients: development and validation of a clinical prediction rule [in Dutch]. Nederlands Tijdschrift Voor Fysiotherapie. 2007;117:199 206. 21 Kongsted A, Bendix T, Qerama E, et al. Acute stress response and recovery after whiplash injuries: a one-year prospective study. Eur J Pain. 2008;12:455 463. 22 Wolfe F, Lane NE. The long-term outcome of osteoarthritis: rates and predictors of joint space narrowing in symptomatic patients with knee osteoarthritis. J Rheumatol. 2002;29:139 146. 23 Enthoven P, Skargren E, Kjellman G, Oberg B. Course of back pain in primary care: a prospective study of physical measures. J Rehabil Med. 2003;35:168 173. 24 Kennedy CA, Haines T, Beaton DE. Eight predictive factors associated with response patterns during physiotherapy for soft tissue shoulder disorders were identied. J Clin Epidemiol. 2006;59:485 496. 25 Gross DP, Battie MC. Predicting timely re covery and recurrence following multidisciplinary rehabilitation in patients with compensated low back pain. Spine. 2005;30:235240. 26 Ginn KA, Cohen ML. Conservative treatment for shoulder pain: prognostic indicators of outcome. Arch Phys Med Rehabil. 2004;85:12311235. 27 Flynn T, Fritz J, Whitman J, et al. A clinical prediction rule for classifying patients with low back pain who demonstrate short-term improvement with spinal manipulation. Spine. 2002;27:28352843. 28 Childs JD, Fritz JM, Flynn TW, et al. A clinical prediction rule to identify patients with low back pain most likely to benet from spinal manipulation: a validation study. Ann Intern Med. 2004;141: 920 928. 29 Fritz JM, Whitman JM, Flynn TW, et al. Factors related to the inability of individuals with low back pain to improve with a spinal manipulation. Phys Ther. 2004;84: 173190. 30 Cleland JA, Childs JD, Fritz JM, et al. Development of a clinical prediction rule for guiding treatment of a subgroup of patients with neck pain: use of thoracic spine manipulation, exercise, and patient education. Phys Ther. 2007;87:9 23. 31 Tseng YL, Wang WT, Chen WY, et al. Predictors for the immediate responders to cervical manipulation in patients with neck pain. Man Ther. 2006;11:306 315. 32 Jull GA, Stanton WR. Predictors of responsiveness to physiotherapy management of cervicogenic headache. Cephalalgia. 2005;25:101108. 33 Iverson CA, Sutlive TG, Crowell MS, et al. Lumbopelvic manipulation for the treatment of patients with patellofemoral pain syndrome: development of a clinical prediction rule. J Orthop Sports Phys Ther. 2008;38:297312. 34 Hicks GE, Fritz JM, Delitto A, McGill SM. Preliminary development of a clinical prediction rule for determining which patients with low back pain will respond to a stabilization exercise program. Arch Phys Med Rehabil. 2005;86:17531762. 35 Currier LL, Froehlich PJ, Carow SD, et al. Development of a clinical prediction rule to identify patients with knee pain and clinical evidence of knee osteoarthritis who demonstrate a favorable short-term response to hip mobilization. Phys Ther. 2007;87:1106 1119. 36 Lesher JD, Sutlive TG, Miller GA, et al. Development of a clinical prediction rule for classifying patients with patellofemoral pain syndrome who respond to patellar taping. J Orthop Sports Phys Ther. 2006;36:854 866. 37 Cleland JA, Fritz JM, Whitman JM, Heath R. Predictors of short-term outcome in people with a clinical diagnosis of cervical radiculopathy. Phys Ther. 2007;87: 1619 1632. 38 Fernandez-de-las-Penas C, Cleland JA, Cuadrado ML, Pareja JA. Predictor variables for identifying patients with chronic tension-type headache who are likely to achieve short-term success with muscle trigger point therapy. Cephalalgia. 2008; 28:264 275. 39 Hancock MJ, Maher CG, Latimer J, et al. Independent evaluation of a clinical prediction rule for spinal manipulative therapy: a randomised controlled trial. Eur Spine J. 2008;17:936 943. 40 Beattie P, Nelson R. Clinical prediction rules: what are they and what do they tell us? Aust J Physiother. 2006;52:157163. 41 Newman D, Allison SC. Risk and physical therapy? J Orthop Sports Phys Ther. 2007;37:287289. 42 Stiell IG, Greenberg GH, McKnight RD, et al. A study to develop clinical decision rules for the use of radiography in acute ankle injuries. Ann Emerg Med. 1992; 21:384 390. 43 Stiell IG, Greenberg GH, Wells GA, et al. Derivation of a decision rule for the use of radiography in acute knee injuries. Ann Emerg Med. 1995;26:405 413. 44 Stiell IG, Wells GA, Vandemheen KL, et al. The Canadian C-spine rule for radiography in alert and stable trauma patients. JAMA. 2001;286:18411848. 45 Stiell IG, Wells GA, Vandemheen KL, et al. The Canadian CT head rule for patients with minor head injury. Lancet. 2001;357: 13911396.

February 2009

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

Physical Therapy f

121

Clinical Prediction Rules for Physical Therapy Interventions

46 Carroll LJ, Cassidy JD, Cote P. Depression as a risk factor for onset of an episode of troublesome neck and low back pain. Pain. 2004;107:134 139. 47 Crombez G, Vlaeyen JW, Heuts PH, Lysens R. Pain-related fear is more disabling than pain itself: evidence on the role of painrelated fear in chronic back pain disability. Pain. 1999;80:329 339. 48 Leeuw M, Goossens ME, Linton SJ, et al. The fear-avoidance model of musculoskeletal pain: current state of scientic evidence. J Behav Med. 2007;30:7794. 49 Vlaeyen JW, Linton SJ. Fear-avoidance and its consequences in chronic musculoskeletal pain: a state of the art. Pain. 2000; 85:317332. 50 Concato J, Feinstein AR, Holford TR. The risk of determining risk with multivariable models. Ann Intern Med. 1993;118: 201210. 51 Cook C. Clinimetrics corner: use of effect sizes in describing data. J Man Manip Ther. 2008;16:E54 E57.

122

Physical Therapy

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

February 2009

Clinical Prediction Rules for Physical Therapy Interventions Appendix.

Eighteen-Item List of Criteria for Assessing the Methodological Quality of Studiesa

A. Positive if subjects were identied at an early uniform point (inception cohort) in the course of the condition (rst episode, with restriction to duration of symptoms mentioned, of their respective complaint or rst physical therapyrelated intervention episode for their respective complaint). B. Positive if criteria were formulated for at least age, duration of symptoms, and relevant comorbidities. C. Positive if setting in which subjects were treated was described. D. Positive if information was presented about subject or condition characteristics of responders and nonresponders or if there was no selective response. E. Positive if a prospective design was used (immediate or same-day follow-up was not considered prospective). F. Positive if the follow-up period was 6 mo. 80% at the last moment of nal follow-up compared with the

G. Positive if the total number of subjects was number of subjects at baseline.

H. Positive if demographic or clinical information (subject or condition characteristics, such as age, sex, and other potential prognostic predictors) was presented for subjects completing the study and those lost to follow-up/ dropouts at the main moment of baseline outcome measurement, or no selective dropouts/lost to follow-up, or no dropouts/lost to follow-up. I. Positive if the intervention subsequent to inclusion in a cohort was fully described or standardized (treating clinicians had to adhere to a strict protocol and were not permitted to adjust the intervention on the basis of their independent decision-making processes). J. Positive if standardized questionnaires or quantitative measurements of at least 1 of the following 5 outcome measures were used for each follow-up measurement: pain, general improvement, functional status, general health status, or lost days of work. K. Positive if masking of the outcome assessor and treating clinician was achieved. In studies in which selfadministered questionnaires were used, masking of the outcome assessor portion of this criterion would be considered acceptable but would have no bearing on the treating clinician status. L. Positive if standardized questionnaires or objective measurements were used at baseline for at least 4 of the following 6 potential prognostic factors: age, sex, pain, functional status, duration of complaints, or physical work load. M. Positive if standardized questionnaires or objective measurements were used at baseline for at least 1 of the following 7 potential prognostic factors: depression, somatization, distress, fear-avoidance, coping strategies, anxiety, or psychosocial work-related factors (social support, psychological demands, and job decision latitude). N. Positive if frequency, percentage, or mean, median, and standard deviation or condence interval were reported for the most important outcome measures. O. Positive if frequency, percentage, or mean, median, and standard deviation or condence interval were reported for the most important prognostic factors.
(continued)

February 2009

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

Physical Therapy f

123

Clinical Prediction Rules for Physical Therapy Interventions Appendix.

Continued

P. Positive if univariate crude estimates were provided for the association of a prognostic factor with outcome. Q. Positive if an attempt was made to determine a set of prognostic factors with the highest prognostic value. R. Positive if the number of cases in the multivariate analysis was at least 10 times the number of independent variables in the multivariate analysis (on the basis of the nal clinical prediction rule model, not the initial prospective variables).
a Criteria B, E, H, and R required consensus agreement or clarication before the second rating process, as follows: B clarication regarding the inclusion of duration of symptoms; E consensus agreement on the operational denition of a prospective design; H clarication regarding information provided for dropouts/lost to follow-up; and R clarication regarding the number of cases in the multivariate analysis being at least 10 times the number of independent variables in the multivariate analysis (on the basis of the nal clinical prediction rule model).

124

Physical Therapy

Volume 89 Number 2 Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012

February 2009

Clinical Prediction Rules for Physical Therapy Interventions: A Systematic Review Jason M Beneciuk, Mark D Bishop and Steven Z George PHYS THER. 2009; 89:114-124. Originally published online December 18, 2008 doi: 10.2522/ptj.20080239

References

This article cites 49 articles, 17 of which you can access for free at: http://ptjournal.apta.org/content/89/2/114#BIBL This article has been cited by 7 HighWire-hosted articles: http://ptjournal.apta.org/content/89/2/114#otherarticles

Cited by

Subscription Information

http://ptjournal.apta.org/subscriptions/

Permissions and Reprints http://ptjournal.apta.org/site/misc/terms.xhtml Information for Authors http://ptjournal.apta.org/site/misc/ifora.xhtml

Downloaded from http://ptjournal.apta.org/ by guest on March 29, 2012