EMPIRICALLY-BASED RESEARCH ARTICLE RATING SCALE

Title: ________________________________________________________________________________________________________
Authors: ______________________________________________________________________________________________________
Source: __________________________________________ Vol: _______ Pages: __________ Month: _______ Year: _______
Research Method: ______________________________________________________________________________________________
Reviewer(s): __________________________________________________________________________________________________
.

CHECKLIST SYMBOLS
++ Criterion clearly met
+ Criterion partially met
- Criterion not met
? Uninterpretable
NA Not applicable
* Not in a position to make a judgment

A. Title
________ 1. Major variables identified
________ 2. Appropriate relationship among variables specified (e.g., difference, relationship, effect, etc.)
________ 3. Scope specified
________ 4. Consistent with article's hypotheses or purpose
________ 5. No unnecessary words

B. Abstract
________ 1. Purpose of hypothesis stated directly or indirectly
________ 2. Size of sample or population and type of subjects identified
________ 3. Instruments identified
________ 4. Experimental design identified
________ 5. Major results and/or conclusion stated
________ 6. Appropriate length (usually 100-150 words) written in complete sentences in the past tense

C. Introduction - Context of Problem

________ 1. Problem/issue identified and its existence documented
________ 2. Relevant "what we know so far" information about the problem/issue presented
________ 3. Background information relevant to the purpose
________ 4. Background information referenced
________ 5. Background information provides justification for purpose
________ 6. Background information logically organized
________ 7. Important variables not overlooked in background information

D. Introduction - Purpose/Research Hypothesis:

________ 1. Is presented
________ 2. Indicates variables of interest
________ 3. Indicates relationship among variables to be investigated (see A2)
________ 4. Logically deduced from context information
________ 5. Testable and stated such as to permit collection of data

E. Methods - Subjects
________ 1. Major characteristics of the accessible population described
________ 2. Sampling procedures described (if a subset of the accessible population is used)
________ 3. Sampling technique likely to produce a representative unbiased sample of the accessible population
________ 4. Size and major characteristics of the sample described
________ 5. Sample size appropriate

F. Methods - Instrumentation
________ 1. Instruments described in terms of purpose and content
________ 2. Evidence of appropriate type of validity discussed
________ 3. Evidence of appropriate type of reliability discussed
________ 4. Instrument appropriate for the sample under study
________ 5. References given for previously developed instruments
________ 6. Development, administration, scoring, and interpretation discussed if appropriate

G. Methods - Treatment
________ 1. Experimental design discussed
________ 2. Experimental design appropriate for purpose
________ 3. Potential confounding variables controlled
________ 4. Treatment conditions discussed for all groups
________ 5. Treatment received conforms to definition of independent variable
________ 6. Evidence presented that subjects received treatment

H. Methods - Data collection Procedures

________ 1. Discussed in sufficient detail to permit replication (who, where, when. how ... temporal order)
________ 2. Procedures appropriate for given purpose
I. Results
________ 1. Issues related to purpose/hypothesis
________ 2. Appropriate descriptive statistics presented
________ 3. Alpha level specified in advance of data analysis if appropriate
________ 4. Statistical tests identified
________ 5. Statistical tests appropriate for testing hypothesis
________ 6. Statistical results interpreted correctly
________ 7. Tables and Figures titled, labeled, and well organized
________ 8. Results presented in a clear and logical manner

J. Discussion - Conclusions
________ 1. Conclusions are clearly stated
________ 2. Conclusions are related to the purpose/hypothesis
________ 3. Conclusions are substantiated by the collected evidence

K. Discussion - Interpretation of Results

________ 1. Correct interpretations made in terms of the research design
________ 2. Correct interpretations made in terms of the context developed
________ 3. Issues of practical/clinical/educational significance addressed

L. Discussion - Recommendations
________ 1. Recommendations are presented
________ 2. Recommendations are specific with respect to changes in future research designs, and/or for
practical application of the conclusion, and/or next step studies
________ 3. Recommendations are appropriate given the introduction, methods, and results of the study
________ 4. Discussion is well organized

M. References
________ 1. References are complete and accurate
________ 2. All references cited

N. Style
________ 1. Appropriate English usage
________ 2. Appropriate layout structure
________ 3. Unbiased reporting style