Article Literacy Checklist

Tite
Opening Points
Abstract
Research Goals
Research Questions
Research Argument
Literature Review
Sample
Research Design
Qualitative Findings and Results
Quantitative Findings and Results
Discussions and Conclusions
Summary and Technical Issues

229
230
230
230
230
230
231
231
231
231
232
232
232

This checklist is designed to help you remember what questions to ask as you read
through each article:

Title
D
D
D
D
D
D
D

Is this a description title?

Is this an equation title?
Is this a situation title?
Is this a process title?
Is this a theoretical title?
What is the basic content of the article?
Does the title tell me enough about the content to see if the article reflects my
needs/interests?

Opening Points
D
D
D
D
D
D
D
D

Does the opening of the article describe some crisis?

Does the opening of the article describe some important issue?
Does the opening of the article point out some gap, or lacuna, in our knowledge or understanding?
Does the opening of the article suggest we need to look at this topic in more
depth?
Does the opening of the article cali for some commitment to some action or
process?
Does the opening of the article merely summarize the goals or conten of the
article?
Are both primary and secondary points covered in the opening of the article?
Does the opening of the article give us a clear sense of the goals and orientations of the authors?

D
D
D

Literatura Review

\
D
D
D
D

Abstract
D
D
D

Does the article have an abstract?

Can the abstract be decoded?
Does the abstract suggest that it is worthwhile to continu reading this
article?

Research Goals
D
D
D
D
D

Does the article clearly state one or more research goals?

Does the article seek to explore an rea that is not well understood?
Does the article seek to predict some result by manipulating and controlling
important factors?
Does the article seek to explain some previously unexplained setting or
situation?
Does the article seek to organize and interpret factors that have not previously
been brought together?

Research Questions
D
D
D
D

D
D
D
D
D
D
D

What sort of argument does the researcher make in order to support the
research question?
Does the argument set up the research question in a simple, linear way?

What sort of sample does the study use, and is sample appropriate for its goals
and questions?
Does the study use a random sample?
Does the study use a convenience sample?
Does the study use a stratified sample?
Does the study use a purposive sample?
Does the study use informants in a field setting?
Does the study use participants in a collaborative setting?

Research Design
D
D
D
D
D
D

What sort of research design is used, and why?

Does the study use a descriptive design?
Does the study use an experimental design?
Does the study use an investigative design?
If the study is quantitative, how does it operationalize key variables?
If the study is qualitative, how does it detail key efforts and procedures?

Qualitative Findings and Results

D

Does the literature review cover the major studies in the rea?
Does the literature review cover classic research?
Does the literature review focus primarily on current research?
Can the literature review lead you to other important reas of related
research?

Sample

Does the article explicitly state one or more research questions?

What is the research question, and can you put it into your own words?
Is the research question basic, applied, or evaluative?
How does the researcher plan to test or answer the research question?

Research Argument

Does the argument both set up and support the research question?
Does the argument begin with the question and work backwards in order to
set it up?
Does the argument ground the research question in practical experience?

D
D
D
D

Does the study use qualitative methods? If so, how do they report their
results?
Does the study pul together various bits and pieces to form a pattern?
Does the study use coding systems to find common themes?
Does the study document collaborative efforts?
Does the study seek to explain situations that have been previously poorly
understood?

How

Qucmtitative Fndings and Results

D
D
D
D
D
D

Does the study use quantitative methods? If so, how do they report their
results?
Does the study seek to describe some sample or population?
Does the study seek to compare one or more groups within a sample or
population?
Does the study seek to nail down one or more predictions?
Does the study seek to test one or more hypotheses?
Does the study seek to test the accuracy of some empirical or theoretical
model?

Glessary of Key Terms

Discussions and Conclusions

D
D
D
D
D
D

How does the study interpret and explain its findings?

Does the discussion simply summarize the main findings?
Does the discussion interpret and clarify the main findings?
Does the discussion address complex or perplexing or unexpected results?
Does the discussion interpret complex findings from field studies?
Does the discussion apply one or more theoretical frameworks toward understanding the main findings?

Summary and Technical Issues

D
D
D
D
D
D
D
D
D
D
D
D

Is the article topical and interesting?

Have the researchers made a case for the importance of their study?
Have the researchers stated their research questions clearly?
Is the cited literature clear and relevant?
Have the researchers properly tested their research questions?
Have the researchers made any obvious design errors?
Have the researchers made any obvious statistical errors?
Are any measurement tools reliable and valid?
Have the researchers taken care to avoid Type I and Type II errors?
Are any quantitative findings properly generalizable?
Does the research address realistic issues and circumstances, or is it too
artificial?
Has this article helped me hone my research literacy skills?

AbstractThe part of a primary research article that comes after the Title and
before the Introduction. It is the job of the Abstract to provide a short review of the
article, following specific rules and conventions.
Action ResearchA form of Qualitative Research that emphasizes working with
participants to bring about specific improvements.
AnalysisA systematic process of examining and/or testing Data. It is usually
grounded in the Research Questions.
ANOVAShorthand for "analysis of variance." An Inferential Statistics technique
designed to test if there are differences among three or more Treatment groups.
Applied ResearchResearch targeted to address specific practical issues or problems. As opposed to Basic Research.
ArgumentA cpherent set of claims to support asking a Research Question.
These arguments can either set up the question, support the question, or both set up
and support the question.
AutoethnographyA specialized form of Ethnography that combines ethnographic and autobiographical techniques.
Basic ResearchResearch conducted to advance knowledge in general, or to satisfy the curiosity of the researcher. As opposed to Applied Research.
BibliographyRarely found in Research Articles. A bibliography lists all sources
that were useful in creating the article, whether those sources were cited or not.
Most often, we find articles using a References section, where actually cited sources
are Usted.
Case StudyA type of Qualitative Research method where a small number of
people or situations, sometimes even only one person or situation, is examined in
great depth.

Contents

PREFACE

Vil

Introduction

Basic Quantitative Literacy

23

Basic Statistical Literacy

37

:007 by Taylor & Francis Group, LLC

atledge is an imprint of Taylor & Francis Group, an Informa business

Basic Qualitative Literacy

57

nted in the United States of America on acid-free paper

J87654321

Titles and Opening Points

73

srnational Standard Book Number-10: 0-415-95527-0 (Softcover) 0-415-95526-2 (Hardcover)

srnational Standard Book Number-13: 978-0-415-95527-0 (Softcover) 978-0-415-95526-3 (Hardcover)

The Abstract

91

part of this book may be reprinted, reproduced, transmitted, or utilized in any form by any electronic, mechanical, or
er means, now known or hereafter invented, including photocopying, microfilming, and recording, or in any informai storage or retrieval system, without written permission from the publishers.

Introductions

103

Methods and Procedures

123

Qualitative Findings and Results

143

10

Quantitative Findings and Results

157

11

Discussions and Conclusions

179

12

Understanding Mixed-Methods Articles

189

13

Becoming a Personal Reviewer

203

14

From Consumer to Critic

219

Routledge
Taylor & Francis Group
2 Park Square
Milton Park, Abingdon
Oxon OX14 4RN

utledge
dor & Francis Group
) Madison Avenue
w York, NY 10016

demark Notice: Product or corporate ames may be trademarks or registered trademarks, and are used only for
itification and explanation without intent to infringe.
Library of Congress Cataloging-in-Publication Data
Shank, Gary D.
Exploring educational research literacy / Gary Shank, Launcelot Brown.
p. cm.
Includes bibliographical references and ndex.
ISBN 0-415-95526-2 (hardback) - ISBN 0-415-95527-0 (pbk.) 1.
EducationResearch-Methodology-Textbooks. I. Brown, Launcelot. II. Title.
LB1028.S439 2006
370.7'2-dc22
t the Taylor & Francis Web site at

2006024986