Вы находитесь на странице: 1из 54

David R.

Krathwohl

A Revision of Bloom's Taxonomy:


An Overview

T HE TAXONOMY OF EDUCATIONAL OBJECTIVES Bloom saw the original Taxonomy as more than
T is a framework for classifying statements of a measurement tool. He believed it could serve as a
what we expect or intend students to learn as a
* common language about learning goals to facili-
result of instruction. The framework was conceived
tate communication across persons, subject matter,
as a means of facilitating the exchange of test items
and grade levels;
among faculty at various universities in order to * basis for determining for a particular course or
create banks of items, each measuring the same curriculum the specific meaning of broad educa-
educational objective. Benjamin S. Bloom, then tional goals, such as those found in the currently
Associate Director of the Board of Examinations of
prevalent national, state, and local standards;
the University of Chicago, initiated the idea, hoping * means for determining the congruence of educa-
that it would reduce the labor of preparing annual tional objectives, activities, and assessments in
comprehensive examinations. To aid in his effort, he a unit, course, or curriculum; and
enlisted a group of measurement specialists from * panorama of the range of educational possibili-
across the United States, many of whom repeatedly ties against which the limited breadth and depth
faced the same problem. This group met about twice of any particular educational course or curricu-
a year beginning in 1949 to consider progress, make lum could be contrasted.
revisions, and plan the next steps. Their final draft
was published in 1956 under the title, Taxonomy qf The Original Taxonomy
Educational Objectives: The Classification of Edu- The original Taxonomy provided carefully
cational Goals. Handbook I: Cognitive Domain developed definitions for each of the six major cat-
(Bloom, Engelhart, Furst, Hill, & Krathwohl, 1956).' egories in the cognitive domain. The categories
Hereafter, this is referred to as the original Taxono- were Knowledge, Comprehension, Application,
my. The revision of this framework, which is the Analysis, Synthesis, and Evaluation.3 With the ex-
subject of this issue of Theory Into Practice, was ception of Application, each of these was broken
developed in much the same manner 45 years later into subcategories. The complete structure of the
(Anderson, Krathwohl, et al., 2001). Hereafter, this original Taxonomy is shown in Table 1.
is referred to as the revised Taxonomy. 2 The categories were ordered from simple to
complex and from concrete to abstract. Further, it
David R. Krathwohl is Hannah Hammond Professor of was assumed that the original Taxonomy repre-
Education Emeritus at Syracuse University. sented a cumulative hierarchy; that is, mastery of

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright C) 2002 College of Education, The Ohio State University
Krathwohl
An Overview

Table 1 across the spectrum of categories. Almost always,


Structure of the Original Taxonomy these analyses have shown a heavy emphasis on
1.0 Knowledge objectives requiring only recognition or recall of
1.10 Knowledge of specifics
information, objectives that fall in the Knowledge
1.1] Knowledge of terminology category. But, it is objectives that involve the under-
1.12 Knowledge of specific facts staniding and use of knowledge, those that would be
1.20 Knowledge of ways and means of dealing with classified in the categories from Comprehension to
specifics Synthesis, that are usually considered the most im-
1.21 Knowledge of conventions portant goals of education. Such analyses, therefore,
1.22 Knowledge of trends and sequences have repeatedly provided a basis for moving curricu-
1.23 Knowledge of classificationsand categories la and tests toward objectives that would be classi-
1.24 Knowledge of criteria fied in the more complex categories.
1.25 Knowledge of methodology
1.30 Knowledge of universals and abstractions in a From One Dimension to Two Dimensions
field Objectives that describe intended learning
1.31 Knowledge of principles and generaliza- outcomes as the result of instruction are usually
tions
framed in terms of (a) some subject matter content
1.32 Knowledge of theories and structures
and (b) a description of what is to be done with or to
2.0 Comprehension that content. Thus, statements of objectives typically
2.1 Translation consist of a noun or noun phrase-the subject matter
2.2 Interpretation content-and a verb or verb phrase-the cognitive
2.3 Extrapolation
process(es). Consider, for example, the following
3.0 Application objective: The student shall be able to remember
4.0 Analysis the law of supply and demand in economics. "The
4.1 Analvsis of elements stu(dent shall be able to" (or "The learner will," or
4.2 Analysis of relationships some other similar phrase) is common to all objec-
4.3 Analysis of organizationalprinciples tives since an objective defines what students are
5.0 Synthesis expected to learn. Statements of objectives often
5.1 Production of a unique communication omit "The student shall be able to" phrase, speci-
5.2 Productionof a plan, or proposed set of operations fyirig just the unique part (e.g., "Remember the
5.3 Derivation of a set of abstract relations economics law of supply and demand."). In this
6.0 Evaluation forn it is clear that the noun phrase is "law of
6.1 Evaluation in terms of internal evidence supply and demand" and the verb is "remember."
6.2 Judgments in terms of external criteria In the original Taxonomy, the Knowledge cate-
gory embodied both noun and verb aspects. The noun
each simpler category was prerequisite to mastery or sabject matter aspect was specified in Knowledge's
of the next more complex one. extensive subcategories. The verb aspect was includ-
At the time it was introduced, the term tax- ed in the definition given to Knowledge in that the
onomy was unfamiliar as an education term. Po- student was expected to be able to recall or recog-
tential users did not understand what it meant, nize knowledge. This brought unidimensionality to
therefore, little attention was given to the original the framework at the cost of a Knowledge category
Taxonomy at first. But as readers saw its poten- that was dual in nature and thus different from the
tial, the framework became widely known and cit- other Taxonomic categories. This anomaly was elim-
ed, eventually being translated into 22 languages. inated in the revised Taxonomy by allowing these
One of the most frequent uses of the original two aspects, the noun and verb, to form separate di-
Taxonomy has been to classify curricular objec- mensions, the noun providing the basis for the Knowl-
tives and test items in order to show the breadth, edge dimension and the verb forming the basis for
or lack of breadth, of the objectives and items the Cognitive Process dimension.

213
THEORY INTO PRACTICE/Autumn 2002
Revising Bloom's Taxonomy

The Knowledge dimension Table 2


Like the original, the knowledge categories Structure of the Knowledge Dimension
of the revised Taxonomy cut across subject matter of the Revised Taxonomy
lines. The new Knowledge dimension, however, A. Factual Knowledge - The basic elements that stu-
contains four instead of three main categories. dents must know to be acquainted with a discipline
Three of them include the substance of the subcat- or solve problems in it.
egories of Knowledge in the original framework. Aa. Knowledge of terminology
But they were reorganized to use the terminology, Ab. Knowledge of specific details and elements
and to recognize the distinctions of cognitive psy- B. Conceptual Knowledge - The interrelationships
chology that developed since the original frame- among the basic elements within a larger structure
work was devised. A fourth, and new category, that enable them to function together.
Metacognitive Knowledge, provides a distinction Ba. Knowledge of classifications and categories
that was not widely recognized at the time the orig- Bb. Knowledge of principles and generalizations
inal scheme was developed. Metacognitive Knowl- Bc. Knowledge of theories, models, and structures
edge involves knowledge about cognition in general C. Procedural Knowledge - How to do something; meth-
as well as awareness of and knowledge about one's ods of inquiry, and criteria for using skills, algorithms,
own cognition (Pintrich, this issue). It is of in- techniques, and methods.
creasing significance as researchers continue to Ca. Knowledge of subject-specific skills and al-
demonstrate the importance of students being made gorithms
aware of their metacognitive activity, and then us- Cb. Knowledge of subject-specific techniques and
methods
ing this knowledge to appropriately adapt the ways
Cc. Knowledge of criteria for determining when
in which they think and operate. The four catego- to use appropriate procedures
ries with their subcategories are shown in Table 2.
D. Metacognitive Knowledge - Knowledge of cognition
The Cognitive Process dimension in general as well as awareness and knowledge of
one's own cognition.
The original number of categories, six, was re-
Da. Strategic knowledge
tained, but with important changes. Three categories Db. Knowledge about cognitive tasks, including
were renamed, the order of two was interchanged, appropriate contextual and conditional
and those category names retained were changed to knowledge
verb form to fit the way they are used in objectives. Dc. Self-knowledge
The verb aspect of the original Knowledge
category was kept as the first of the six major cat- Application, Analysis, and Evaluation were re-
egories, but was renamed Remember. Comprehen- tained, but in their verb forms as Apply, Analyze,
sion was renamed because one criterion for and Evaluate. Synthesis changed places with Evalu-
selecting category labels was the use of terms that ation and was renamed Create. All the original sub-
teachers use in talking about their work. Because categories were replaced with gerunds, and called
understand is a commonly used term in objectives, "cognitive processes." With these changes, the cate-
its lack of inclusion was a frequent criticism of the gories and subcategories-cognitive processes-of the
original Taxonomy. Indeed, the original group con- Cognitive Process dimension are shown in Table 3.
sidered using it, but dropped the idea after further Whereas the six major categories were given
consideration showed that when teachers say they far more attention than the subcategories in the orig-
want the student to "really" understand, they mean inal Taxonomy, in the revision, the 19 specific cog-
anything from Comprehension to Synthesis. But, nitive processes within the six cognitive process
to the revising authors there seemed to be popular categories receive the major emphasis. Indeed, the
usage in which understand was a widespread syn- nature of the revision's six major categories emerg-
onym for comprehending. So, Comprehension, the es most clearly from the descriptions given the spe-
second of the original categories, was renamed cific cognitive processes. Together, these processes
Understand. 4 characterize each category's breadth and depth.

214
Krathwohl
An Overview

Like the original Taxonomy, the revision is a Table 3


hierarchy in the sense that the six major categories Structure of the Cognitive Process
of the Cognitive Process dimension are believed to Dimension of the Revised Taxonomy
differ in their complexity, with remember being
less complex than understand, which is less com- 1.0 Remember - Retrieving relevant knowledge from
plex than apply, and so on. However, because the long-term memory.
revision gives much greater weight to teacher us- 1.1 Recognizing
age, the requirement of a strict hierarchy has been 1.2 Recalling
relaxed to allow the categories to overlap one an- 2.01 Understand - Determining the meaning of instruc-
other. This is most clearly illustrated in the case of tional messages, including oral, written, and graphic
the category Understand. Because its scope has communication.
been considerably broadened over Comprehend in 2.1 Interpreting
2.2 Exemplifying
the original framework, some cognitive processes
2.3 Classifying
associated with Understand (e.g., Explaining) are 2.4 Summarizing
more cognitively complex than at least one of the 2.5 Inferring
cognitive processes associated with Apply (e.g., 2.6 Comparing
Executing). If, however, one were to locate the 2.7 Explaining
"center point" of each of the six major categories 3.6 Apply - Carrying out or using a procedure in a given
on a scale of judged complexity, they would likely situation.
form a scale from simple to complex. In this sense, 3.1 Executing
the Cognitive Process dimension is a hierarchy, 3.2 Implementing
and probably one that would be supported as well 4.0 Analyze - Breaking material into its constituent parts
as was the original Taxonomy in terms of empiri- and detecting how the parts relate to one another and
cal evidence (see Anderson, Krathwohl, et al., 2001, to an overall structure or purpose.
chap. 16). 4.1 Differentiating
4.2 Organizing
The Taxonomy Table 4.3 Attributing
In the revised Taxonomy, the fact that any 5.0 Evaluate - Making judgments based on criteria and
objective would be represented in two dimensions standards.
immediately suggested the possibility of construct- 5.1 Checking
ing a iwo-dimensional table, which we termed the 5.2 Critiquing
Taxonomy Table. The Knowledge dimension would 6.0 Create - Putting elements together to form a novel,
form the vertical axis of the table, whereas the coherent whole or make an original product.
Cognitive Process dimension would form the hori- 6.1 Generating
zontal axis. The intersections of the knowledge and 6.2 Planning
cognitive process categories would form the cells. 6.3 Producing
Consequently, any objective could be classified in academic purposes and situations by writing original
the Taxonomy Table in one or more cells that cor- compositions that analyze patterns and relationships
respond with the intersection of the column(s) ap- of ideas, topics, or themes. (State of Minnesota, 1998)
propriate for categorizing the verb(s) and the row(s) We begin by simplifying the standard (i.e., objec-
appropriate for categorizing the noun(s) or noun tive) by ignoring certain parts, particularly restric-
phrase(s). To see how this placement of objectives tions such as "using grammar, language mechanics,
is accomplished, consider the following example and other conventions of standard written English
adapted from the State of Minnesota's Language for a variety of academic purposes and situations."
Arts Standards for Grade 12: (Some of these specify scoring dimensions that, if
A sttident shall demonstrate the ability to write us- not done correctly, would cause the student's com-
ing grammar, language mechanics, and other con- position to be given a lower grade.) Omitting these
ventions of standard written English for a variety of restrictions leaves us with the following:

215
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

Write original compositions that analyze patterns and Understand through Create are usually considered
relationships of ideas, topics, or themes. the most important outcomes of education, their
Placement of the objective along the Knowl- inclusion, or lack of it, is readily apparent from
edge dimension requires a consideration of the noun the Taxonomy Table. Consider this example from
phrase "patterns and relationships of ideas, topics, or one of the vignettes in the revised Taxonomy vol-
themes." "Patterns and relationships" are associated ume in which a teacher, Ms. Gwendolyn Airasian,
with B. Conceptual Knowledge. So we would classi- describes a classroom unit in which she integrates
fy the noun component as an example of B. Concep- Pre-Revolutionary War colonial history with a per-
tual Knowledge. Concerning the placement of the suasive writing assignment. Ms. Airasian lists four
objective along the Cognitive Process dimension, we specific objectives. She wants her students to:
note there are two verbs: write and analyze. Writ- I. Remember the specific parts of the Parliamentary
ing compositions calls for Producing, and, as such, Acts (e.g., the Sugar, Stamp, and Townshend
would be classified as an example of 6. Create. Acts);
Analyze, of course, would be 4. Analyze. Since 2. Explain the consequences of the Parliamentary
both categories of cognitive processes are likely to Acts for different colonial groups;
be involved (with students being expected to ana- 3. Choose a colonial character or group and write
lyze before they create), we would place this ob- a persuasive editorial stating his/her/its position
jective in two cells of the Taxonomy Table: B4, on the Acts (the editorial must include at least
Analyze Conceptual Knowledge, and B6, Create one supporting reason not specifically taught or
[based on] Conceptual Knowledge (see Figure 1). covered in the class); and
We use the bracketed [based on] to indicate that 4. Self- and peer edit the editorial.
the creation itself isn't conceptual knowledge; rath-
er, the creation is primarily based on, in this case, Categorizing the first objective, 1. Remember
conceptual knowledge. is clearly the cognitive process, and "specific parts
By using the Taxonomy Table, an analysis of the Parliamentary Acts" is Ab. Knowledge of spe-
of the objectives of a unit or course provides, cific details or elements, a subcategory of A. Factu-
among other things, an indication of the extent to al Knowledge. So this objective is placed in cell
which more complex kinds of knowledge and cog- Al. 5 "Explain," the verb in the second objective,
nitive processes are involved. Since objectives from is the seventh cognitive process, 2.7 Explaining,

The Cognitive Process Dimension

The Knowledge 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create


Dimension

A. Factual
Knowledge

B. Conceptual X X
Knowledge

C. Procedural
Knowledge

D. Metacognitive
Knowledge

Figure 1. The placement in the Taxonomy Table of the State of Minnesota's Language Arts Standard for
Grade 12.

216
Krathwohl
An Overview

under 2. Understand. Since the student is asked to more important and long-lasting fruits of educa-
explain the "consequences of the Parliamentary tion-the more complex ones.
Acts," one can infer that "consequences" refers to In addition to showing what was included,
generalized statements about the Acts' aftereffects the Taxonomy Table also suggests what might have
and is closest to Bc. Knowledge of theories, models, been but wasn't. Thus, in Figure 2, the two blank
and structures. The type of knowledge, then, would bottom rows raise questions about whether there
be B. Conceptual Knowledge. This objective would might have been procedural or metacognitive
be classified in cell B2. knowledge objectives that could have been includ-
The key verb in the third objective is "write." ed. For example, are there procedures to follow in
Like the classification of the State of Minnesota's editing that the teacher could explicitly teach the
standard discussed above, writing is 6.3 Produc- students? Alternatively, is knowledge of the kinds of
ing, a process within 6. Create. To describe "his/ errors common in one's own writing and preferred
her/its position on the Acts" would require some ways of correcting them an important metacognitive
combination of A. Factual Knowledge and B. Con- outcome of self-editing that could have been em-
ceptual Knowledge, so this objective would be clas- phasized? The panorama of possibilities presented
sified in two cells: A6 and B6. Finally, the fourth by the Taxonomy Table causes one to look at blank
objective involves the verbs "self-edit" and "peer areas and reflect on missed teaching opportunities.
edit." Editing is a type of evaluation, so the process The Taxonomy Table can also be used to clas-
involved is 5. Evaluate. The process of evaluation sify the instructional and learning activities used
will involve criteria, which are classified as B. to achieve the objectives, as well as the assess-
Conceptual Knowledge, so the fourth objective would ments employed to determine how well the objec-
fall in cell B5. The completed Taxonomy Table for tives were mastered by the students. The use of
this unit's objectives is shown in Figure 2. the Taxonomy Table for these purposes is described
From the table, one can quickly visually de- and illustrated in the six vignettes contained in the
termine the extent to which the more complex cat- revised Taxonomy volume (Anderson, Krathwohl,
egories are represented. Ms. Airasian's unit is quite et al., 2001, chaps. 8-13). In the last two articles
good in this respect. Only one objective deals with of this issue, Airasian discusses assessment in great-
the Remember category; the others involve cogni- er detail, and Anderson describes and illustrates
tive processes that are generally recognized as the alignment.

The Cognitive Process Dimension


The Knowledge 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create
Dimension

A. Factual Objective 1 Objective 3


Knowledge

B. Conceptual Objective 2 Objective 4 Objective 3


Knowledge

C. Procedural
Knowledge

D. Metacognitive
Knowledge
Figure 2. The classification in a Taxonomy Table of the Four objectives of Ms. Airasian's unit integrat-
ing Pre-Revolutionary War colonial history with a persuasive writing assignment.

217
THEORY INTO PRACTiCE / Autumn 2002
Revising Bloom's Taxonomy

Conclusion 2. The revised Taxonomy is published both in a hard-


cover complete edition and a paperback abridgment,
The Taxonomy of Educational Objectives is which omits Chapters 15, The Taxonomy in Rela-
a scheme for classifying educational goals, objec- tion to Alternative Frameworks; 16, Empirical Stud-
tives, and, most recently, standards. It provides an ies of the Structure of the Taxonomy; 17, Unsolved
organizational structure that gives a commonly Problems; and Appendix C, Data Used in the Meta-
Analysis in Chapter 15.
understood meaning to objectives classified in one
3. Terms appearing in the original Taxonomy appear
of its categories, thereby enhancing communica- in italics with initial caps; terms in the revised Tax-
tion. The original Taxonomy consisted of six cate- onomy add boldface to these specifications.
gories, nearly all with subcategories. They were 4. Problem solving and critical thinking were two oth-
arranged in a cumulative hierarchical framework; er terms commonly used by teachers that were also
considered for inclusion in the revision. But unlike
achievement of the next more complex skill or abil-
understand, there seemed to be no popular usage
ity required achievement of the prior one. The orig- that could be matched to a single category. There-
inal Taxonomy volume emphasized the assessment fore, to be categorized in the Taxonomy, one must
of learning with many examples of test items (large- determine the intended specific meaning of prob-
ly multiple choice) provided for each category. lem solving and critical thinking from the context
in which they are being used.
Our revision of the original Taxonomy is a
5. One can use the subcategories to designate the rows
two-dimensional framework: Knowledge and Cog- and columns; however, for the sake of simplicity, the
nitive Processes. The former most resembles the examples make use of only the major categories.
subcategories of the original Knowledge category.
The latter resembles the six categories of the orig- References
inal Taxonomy with the Knowledge category named Anderson, L.W. (Ed.), Krathwohl, D.R. (Ed.), Airasian,
Remember, the Comprehension category named P.W., Cruikshank, K.A., Mayer, R.E., Pintrich, P.R.,
Understand, Synthesis renamed Create and made Raths, J., & Wittrock, M.C. (2001). A taxonomy for
learning, teaching, and assessing: A revision of
the top category, and the remaining categories Bloom's Taxonomy of EducationalObjectives (Com-
changed to their verb forms: Apply, Analyze, and plete edition). New York: Longman.
Evaluate. They are arranged in a hierarchical struc- Bloom, B.S. (Ed.), Engelhart, M.D., Furst, E.J., Hill,
ture, but not as rigidly as in the original Taxonomy. W.H., & Krathwohl, D.R. (1956). Taxonomy of
In combination, the Knowledge and Cognitive educational objectives: The classification of edu-
cational goals. Handbook 1: Cognitive domain.
Process dimensions form a very useful table, the Tax- New York: David McKay.
onomy Table. Using the Table to classify objectives, Dave, R.H. (1970). Psychomotor levels. In R.J. Arm-
activities, and assessments provides a clear, concise, strong (Ed.), Developing and writing educational
visual representation of a particular course or unit. objectives (pp. 33-34). Tucson AZ: Educational
Once completed, the entries in the Taxonomy Ta- Innovators Press.
Harrow, A.J. (1972). A taxonomy of the psychomotor
ble can be used to examine relative emphasis, cur- domain: A guide for developing behavioral objec-
riculum alignment, and missed educational tives. New York: David McKay.
opportunities. Based on this examination, teachers Krathwohl, D.R., Bloom, B.S., & Masia, B.B. (1964).
can decide where and how to improve the plan- Taxonomy of educational objectives: The classifi-
cation of educational goals. Handbook 11: The af-
ning of curriculum and the delivery of instruction. fective domain. New York: David McKay.
Simpson, B.J. (1966). The classification of educational
Notes objectives: Psychomotor domain. Illinois Journal
1. The Taxonomy of Educational Objectives: Handbook of Home Economics, 10(4), 110-144.
II, The Affective Domain was published later (Krath- State of Minnesota. (1998). State educational standards
wohl, Bloom, & Masia, 1964). A taxonomy for the coupled to lesson plans and resources: Language Arts,
psychomotor domain was never published by the High standards (1998): Grade 12: Writing-Unit: De-
originating group, but some were published by Simp- scription, Academic. Retrieved April 20, 2001, from
son (1966), Dave (1970), and Harrow (1972). http://www.statestandards.com/showstate.asp?st=mn.

218
PaulR. Pintrich

The Role of Metacognitive Knowledge in


Learning, Teaching, and Assessing

A s KRATHWOHL (THIS ISSUE) STATES, the re- general developmental trend vary from theory to
A vised Taxonomy contains four general knowl- theory, but they include the development of meta-
edge categories: Factual, Conceptual, Procedural, and cognitive knowledge, metacognitive awareness,
Metacognitive. While the first three categories were self-awareness, self-reflection, and self-regulation.
included in the original Taxonomy, the Metacogni- Although there are many definitions and mod-
tive Knowledge category was added. The purpose of els of metacognition, an important distinction is
this article is to discuss the Metacognitive Knowl- one between (a) knowledge of cognition and (b)
edge category and its implications for learning, the processes involving the monitoring, control, and
teaching, and assessing in the classroom. regulation of cognition (e.g., Bransford et al, 1999;
Metacognitive knowledge involves knowledge Brown, Bransford, Ferrara, & Campione, 1983;
about cognition in general, as well as awareness of Flavell, 1979; Paris & Winograd, 1990; Pintrich,
and knowledge about one's own cognition. One of Wolters, & Baxter, 2000; Schneider & Pressley,
the hallmarks of psychological and educational theo- 1997). This basic distinction between metacogni-
ry and research on learning since the original Taxon- tive knowledge and metacognitive control or self-
omy was published is the emphasis on helping regulatory processes parallels the two dimensions
students become more knowledgeable of and respon- in our Taxonomy Table.
sible for their own cognition and thinking. This Metacognitive knowledge includes knowledge
change cuts across all the different theoretical ap- of general strategies that might be used for differ-
proaches to learning and development-from neo- eni tasks, knowledge of the conditions under which
Piagetian models, to cognitive science and information these strategies might be used, knowledge of the
processing models, to Vygotskian and cultural or extent to which the strategies are effective, and
situated learning models. Regardless of their theo- knowledge of self (Flavell, 1979; Pintrich et al.,
retical perspective, researchers agree that with de- 2000; Schneider & Pressley, 1997). For example,
velopment students become more aware of their learners can know about different strategies for read-
own thinking as well as more knowledgeable about ing a textbook as well as strategies to monitor and
cognition in general. Furthermore, as they act on check their comprehension as they read. Learners also
this awareness they tend to learn better (Brans- activate relevant knowledge about their own strengths
ford, Brown, & Cocking, 1999). The labels for this and weaknesses pertaining to the task as well as
Paul R. Pintrich is a professor of education at the their motivation for completing the task. Suppose
University of Michigan. learners realize they already know a fair amount

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright (D 2002 College of Education, The Ohio State University
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

about the topic of a chapter in a textbook (which most academic disciplines or subject matter do-
they may perceive as a strength), and that they are mains in contrast to more specific strategies from
interested in this topic (which may enhance their the disciplines or domains. Consequently, these
motivation). This realization could lead them to strategies can be used across a large number of
change their approach to the task, such as adjusting different tasks and domains, rather than being most
their reading approach or rate. Finally, learners also useful for one particular type of task in one specif-
can activate the relevant situational or conditional ic subject area (e.g., solving a quadratic equation
knowledge for solving a problem in a certain context in mathematics, applying Ohm's law in science).
(e.g., in this classroom; on this type of test; in this Strategic knowledge includes knowledge of the
type of real-life situation, etc.). They may know, for various strategies students might use to memorize
example, that multiple-choice tests require only rec- material, to extract meaning from text, and to com-
ognition of the correct answers, not actual recall of prehend what they hear in classrooms or what they
the information, as required in essay tests. This type read in books and other course materials. Although
of metacognitive knowledge might influence how they there are a large number of different learning strat-
subsequently prepare for an examination. egies, they can be grouped into three general cate-
In contrast, metacognitive control and self- gories: rehearsal, elaboration, and organizational
regulatory processes are cognitive processes that (Weinstein & Mayer, 1986). Rehearsal strategies
learners use to monitor, control, and regulate their refer to the strategy of repeating words or terms to be
cognition and learning. As such, they fit under the remembered over and over to oneself, generally not
six cognitive process categories and specific cogni- the most effective strategy for learning more com-
tive processes in the revised Taxonomy. The meta- plex cognitive processes. In contrast, elaboration strat-
cognitive and self-regulatory processes are well egies include various mnemonics for memory tasks,
represented in tasks such as checking, planning, and as well strategies such as summarizing, paraphras-
generating. Accordingly, on the Knowledge dimen- ing, and selecting main ideas from texts. These
sion, Metacognitive Knowledge categories refer elaboration strategies result in deeper processing
only to knowledge of cognitive strategies, not the of the material to be learned and result in better
actual use of those strategies. comprehension and learning than do rehearsal strat-
egies. Finally, organizational strategies include
Three Types of Metacognitive Knowledge various forms of outlining, concept mapping, and
In Flavell's (1979) classic article on meta- note taking, where the student makes connections
cognition, he suggested that metacognition includ- between and among content elements. Like elabo-
ed knowledge of strategy, task, and person ration strategies, these organizational strategies
variables. We represented this general framework usually result in better comprehension and learn-
in our categories by including students' knowledge ing than rehearsal strategies.
of general strategies for learning and thinking (Da In addition to these general learning strate-
- Strategic knowledge) and their knowledge of cog- gies, students can have knowledge of various meta-
nitive tasks as well as when and why to use these cognitive strategies that will be useful to them in
different strategies (Db - Knowledge about cogni- planning, monitoring, and regulating their learning
tive tasks, including appropriate contextual and and thinking. These strategies include ways indi-
conditional knowledge). Finally, we included viduals plan their cognition (e.g., set subgoals),
knowledge about the self (the person variable) in monitor their cognition (e.g., ask themselves ques-
relation to both cognitive and motivational com- tions as they read a piece of text; check their answer
ponents of performance (Dc - Self-knowledge). to a math problem), and regulate their cognition (e.g.,
re-read something they don't understand; go back
Strategic knowledge and "repair" their calculating mistake in a math prob-
Strategic knowledge is knowledge of general lem). Again, in this category we refer to students'
strategies for learning, thinking, and problem solv- knowledge of these various strategies, not their ac-
ing. These strategies are applicable across all or tual use.

220
Pintrich
Metacognative Knowledge in Learning

Finally, there are a number of general strate- ferent tasks, but this is not necessarily the most
gies for problem solving and thinking. These strat- aclaptive use of the hammer-particularly if there
egies represent the various heuristics individuals are other tools that are better suited to the task. In
can use to solve problems, particularly ill-defined the same way, specific learning and thinking strat-
problems where there is no definitive algorithmic egies are better suited to different tasks. For exam-
solution. In the problem-solving area they can in- ple, if one confronts a novel problem that is
clude the knowledge of means-ends analysis as well ill-defined, then general problem-solving heuris-
as knowledge of working backward from the de- tics may be very useful. In contrast, if one con-
sired goal state. In terms of thinking, there are a fronts a physics problem regarding the second law
number of general strategies for deductive and in- of thermodynamics, more specific procedural
ductive thinking, such as evaluating the validity of knowledge, not general metacognitive knowledge,
different logical statements, avoiding circularity in will be much more useful and adaptive for this
arguments, making appropriate inferences from dif- task. An important aspect of learning about strate-
ferent sources of data, and drawing on appropriate gies is the knowledge of when and why to use
samples to make inferences. them appropriately.
Another important aspect of conditional
Knowledge about cognitive tasks knowledge concerns the local situational and gen-
In addition to knowledge about various strat- eral social, conventional, and cultural norms for
egies, individuals also accumulate knowledge about the use of different strategies. For example, a teach-
different cognitive tasks. Knowledge of tasks in- er may encourage the use of certain strategies for
cludes knowledge that different tasks can be more reading. A student who knows the teacher's strate-
or less difficult and may require different cogni- gic preferences is better able to adapt to the de-
tive strategies. A recall task is more difficult than mands of this teacher's classroom. In the same
a recognition task, for example, because in the re- manner, different cultures may have norms for the
call task, the individual must actively search mem- use of different strategies and ways of thinking
ory and retrieve the relevant information; while in about problems. Again, knowing these norms can
the recognition task, the emphasis is on discrimi- he:lp students adapt to the demands of the culture
nating among alternatives and selecting the appro- in terms of solving the problem.
priate answer.
As students develop their knowledge of dif- Self-knowledge
ferent learning and thinking strategies and their Along with knowledge of different strategies
use, this knowledge reflects the "what" and "how" of and knowledge of cognitive tasks, Flavell (1979)
the different strategies. However, this knowledge proposed that self-knowledge was an important
may not be enough for expertise in learning. Stu- component of metacognition. Self-knowledge in-
dents also must develop some knowledge about cludes knowledge of one's strengths and weakness-
the "when" and "why" of using these strategies es. For example, a student who knows that he or
appropriately (Paris, Lipson, & Wixson, 1983). she generally does better on multiple-choice tests
Because not all strategies are appropriate for all than on essay tests has some metacognitive self-
situations, the learner must develop some knowl- knowledge about his or her test-taking ability. This
edge of the different conditions and tasks where knowledge may be useful to the student as he or
the different strategies are used most appropriately. she studies for the two different types of tests.
If one thinks of strategies as cognitive "tools" One of the hallmarks of experts is that they know
that help learners construct their understanding, when they don't know something and have to rely
then just as the carpenter uses a variety of differ- on some general strategies for finding the appro-
ent tools for all the tasks that go into building a priate information. This self-awareness of the
house, the learner must use different tools for dif- breadth and depth of one's own knowledge base is
ferent cognitive tasks. Of course one tool, such as an important aspect of self-knowledge. Finally, in-
a hammer, can be used in different ways for dif- dividuals need to be aware of the different types

221
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

of strategies they are likely to rely on in different the ways students are taught and assessed in the
situations. An awareness that one overrelies on a classroom (Bransford et al., 1999). First, as previ-
particular strategy when there may be other more ously noted, metacognitive knowledge of strate-
adaptive strategies for the task could lead to the gies and tasks, as well as self-knowledge, is linked
possibility of a change in strategy use. to how students will learn and perform in the class-
In addition to general self-knowledge, individ- room. Students who know about the different kinds
uals also have beliefs about their motivation. These of strategies for learning, thinking, and problem
include judgments of their capability to perform a solving will be more likely to use them. After all,
task (self-efficacy), their goals for completing a task if students do not know of a strategy, they will not
(learning or just getting a good grade), and the inter- be able to use it. Students who do know about
est and value the task has for them (high interest and different strategies for memory tasks, for example,
high value versus low interest and low value). Al- are more likely to use them to recall relevant in-
though these motivational beliefs are usually not con- formation. Similarly, students who know about dif-
sidered in cognitive models, there is a fairly ferent learning strategies are more likely to use
substantial body of literature emerging that shows them when studying. And, students who know about
important links between students' motivational be- general strategies for thinking and problem solv-
liefs and their cognition and learning (Pintrich & ing are more likely to use them when confronting
Schrauben, 1992; Pintrich & Schunk, 2002; Snow, different classroom tasks (Bransford et al., 1999;
Corno, & Jackson, 1996). It seems important that Schneider & Pressley, 1997; Weinstein & Mayer,
just as students need to develop self-knowledge and 1986). Metacognitive knowledge of all these dif-
self-awareness about their knowledge and cognition, ferent strategies enables students to perform better
they also need to develop self-knowledge and self- and learn more.
awareness about their motivation. In addition, metacognitive knowledge of all
Although self-knowledge itself can be an im- these different strategies seems to be related to the
portant aspect of metacognitive knowledge, it is transfer of learning; that is, the ability to use knowl-
important to underscore the idea that accuracy of edge gained in one setting or situation in another
self-knowledge seems to be most crucial for learn- (Bransford et al., 1999). Students are often con-
ing. That is, we are not advocating that teachers fronted with new tasks that require knowledge and
try to boost students' self-esteem (a completely skills they have not yet learned. In this case, they
different construct from self-knowledge) by pro- cannot rely solely on their specific prior knowl-
viding students with positive, but false, inaccurate, edge or skills to help them on the new task. When
and misleading feedback about their strengths and experts find themselves in this situation, they are
weaknesses. It is much more important to have likely to use more general strategies to help them
accurate perceptions and judgments of one's knowl- think about or solve the problem. In the same man-
edge base and expertise than to have inflated and ner, students, who by definition lack expertise in
inaccurate self-knowledge (Pintrich & Schunk, many areas, need to know about different general
2002). If students do not realize they do not know strategies for learning and thinking in order to use
some aspect of factual, conceptual, or procedural general strategies for new or challenging tasks.
knowledge, it is unlikely they will make any effort to Finally, in terms of learning, self-knowledge
acquire or construct new knowledge. Accordingly, can be either an important facilitator or a constraint.
we stress the need for teachers to help students make Students who know their own strengths and weak-
accurate assessments of their self-knowledge, not nesses can adjust their own cognition and thinking
inflate their self-esteem. to be more adaptive to diverse tasks and, thus, fa-
cilitate learning. If, for example, a student realizes
Implications for Learning, that she does not know very much about a particu-
Teaching, and Assessing lar topic, she might pay more attention to the topic
Metacognitive knowledge can play an impor- while reading and use different strategies to make
tant role in student learning and, by implication, in sure she understands the topic being studied. In

222
Pintrich
Metacognative Knowledge in Learning

the same manner, if a student is aware that she has Pintrich et al., 1987). It is more important that
difficulties on certain tests (e.g., mathematics ver- metacognitive knowledge is embedded within the
sus history tests), then she can prepare for an up- usual content-driven lessons in different subject
coming mathematics test in an appropriate manner. a.reas. General strategies for thinking and problem
Students who lack knowledge of their own strengths solving can be taught in the context of English,
and weaknesses will be less likely to adapt to dif- mathematics, science, social studies, art, music, and
ferent situations and regulate their own learning in p:hysical education courses. Science teachers, for
them. For example, if a student reads a text and example, can teach general scientific methods and
thinks he understands it, but in reality does not, procedures, but learning will likely be more effec-
then he will be less likely to go back and reread or tive when it is tied to specific science content, not
review the text to make sure it is understood. Sim- taught in the abstract. Of course, in some skill ar-
ilarly, a student who believes he understands the eas, such as reading or writing, the teaching of
material thoroughly will not study for an upcom- metacognitive knowledge about different general
ing test to the same extent as a student who knows strategies for reading comprehension or writing is
he does not understand the material. A student who both acceptable and desirable.
believes he understands the material when he does The key is that teachers plan to include some
not will not do well on the test of that material goals for teaching metacognitive knowledge in their
because he did not study as well as the student regular unit planning, and then actually try to teach
who had an accurate perception of his lack of and assess for the use of this type of knowledge as
knowledge. Accordingly, lack of self-knowledge they teach other content knowledge. One of the
can be a constraint on learning. most important aspects of teaching for metacogni-
There are several implications of the rela- tive knowledge is the explicit labeling of it for
tionships among metacognitive knowledge, learn- students. For example, during a lesson, the teacher
ing, teaching, and assessing. In terms of instruction, can note occasions when metacognitive knowledge
there is a need to teach for metacognitive knowl- comes up, such as in a reading group discussion of
edge explicitly. Teachers may do this in some les- the different strategies students use to read a sec-
sons, but in many cases the instruction is more tion of a story. This explicit labeling and discus-
implicit. Simply stated, many teachers assume that sion helps students connect the strategies (and their
some students will be able to acquire metacogni- names/labels) to other knowledge they may already
tive knowledge on their own, while others lack the have about strategies and reading. In addition, mak-
ability to do so. Of course, some students do ac- ing the discussion of metacognitive knowledge part
quire metacognitive knowledge through experience of the everyday discourse of the classroom helps
and with age, but many more students fail to do foster a language for students to talk about their
so. In our work with college students (see Hofer, own cognition and learning. The shared language
Yu, & Pintrich, 1998; Pintrich, McKeachie, & Lin, and discourse about cognition and learning among
1987), we are continually surprised at the number peers and between students and teacher helps stu-
of students who come to college having very little dents become more aware of their own metacogni-
metacognitive knowledge; knowledge about differ- tive knowledge as well as their own strategies for
ent strategies, different cognitive tasks, and, par- learning and thinking. As they hear and see how
ticularly, accurate knowledge about themselves. their classmates approach a task, they can com-
Given the fact that students who go on to college pare their own strategies with their classmates' and
are more likely to be better students in general make judgments about the relative utility of differ-
suggests that there is a need to explicitly teach ent strategies. This type of discourse and discus-
metacognitive knowledge in K-12 settings. sion helps makes cognition and learning more
Having said this, it is not our expectation explicit and less opaque to students, rather than
that teachers would teach for metacognitive knowl- being something that happens mysteriously or that
edge in separate courses or separate units, although some students "get" and learn and others struggle
this can certainly be done (see Hofer et al., 1998; and don't learn.

223
THEORY INTO PRACTICE/ Autumn 2002
Revising Bloom's Taxonomy

In addition to the development of a class- prior knowledge. This type of informal assessment
room discourse around metacognitive knowledge, can be used to calibrate the instruction to help stu-
another important instructional strategy is the mod- dents gain both content knowledge (whether it be
eling of strategies, accompanied by an explanation factual, conceptual, or procedural) and metacogni-
of them. For example, as the teacher is solving a tive knowledge.
problem for the class, he might talk aloud about From these informal "assessment conversa-
his own cognitive processes as he works through tions," teachers also may be able to make infer-
the problem. This provides a model for students, ences about the level of metacognitive knowledge
showing them how they use strategies in solving of individual students. Just as there is variance in
real problems. In addition, the teacher also might the content knowledge that students bring to the
discuss why he is using this particular strategy for classroom, it is likely there will be a wide distri-
this specific problem, thereby also engaging stu- bution of metacognitive knowledge in a class of
dents in issues concerning the conditional knowl- 20-30 students. This information about individual
edge that governs when and why to use different students can be used to adapt instruction to indi-
strategies. As experts in their field, teachers have vidual differences. Teachers can talk to students
all kinds of implicit knowledge about strategies individually or in small groups to estimate levels
and when and why they are appropriate to use; of metacognitive knowledge. Finally, more formal
however, students often lack the means to gain ac- questionnaires and interview procedures can be
cess to this knowledge. If the knowledge is never used to assess students' metacognitive knowledge
shared through discussion, modeling, or explicit concerning their learning strategies as well as their
instruction, it is difficult for students to learn. knowledge about different tasks and contexts (see
In terms of implications for assessment, the Baker & Cerro, 2000; Pintrich et al., 2000).
inclusion of metacognitive knowledge in the re- As mentioned previously, an important compo-
vised Taxonomy is not meant to generate the de- nent of metacognitive knowledge is self-knowledge.
velopment of separate sections of standardized or In terms of assessment, a focus on self-knowledge
formal classroom tests on metacognitive knowl- implies that students should have the opportunity
edge. Metacognitive knowledge is important in to assess their own strengths and weaknesses. Al-
terms of how it is used by students to facilitate though this will occasionally happen in larger, pub-
their own learning. In this sense, it is more likely lic groups, it is important for motivational reasons
that any assessment of metacognitive knowledge that self-assessment is more private, occurring be-
by teachers will be informal rather than formal. tween one teacher and one student (see Pintrich &
For example, if teachers are teaching and discuss- Schunk, 2002). In this way, students are able to
ing metacognitive knowledge as part of their nor- meet individually with their teachers to discuss their
mal classroom discourse, they will need to talk to perceptions of their own strengths and weakness-
their students about metacognitive knowledge and, es, and teachers can provide them with feedback
perhaps more importantly, actually listen to the stu- about these perceptions. Portfolio assessment some-
dents as they talk about their own cognition and times offers students the opportunity to reflect on
learning. As a result of these conversations, teach- their work as represented in the portfolio and this
ers will become aware of the general level of meta- certainly provides self-assessment information to
cognitive knowledge in their classrooms and will them. As students have more opportunities to re-
be able to judge fairly quickly the level and depth flect on their own learning, they will develop more
of students' metacognitive knowledge. In many self-knowledge that can be helpful to them.
respects, this is no different from what teachers do
to assess the level of content knowledge their stu- Conclusion
dents bring to their classrooms. They start a dis- In summary, metacognitive knowledge is a new
cussion, ask some questions, listen to the answers, category of knowledge in the revised Taxonomy.
and talk with the students. Based on this discourse, However, given its important role in learning, it is a
they can quickly estimate the depth of students' welcome and much-needed addition. Although there

224
Pintrich
Metacognative Knowledge in Learning

are different kinds of metacognitive knowledge, college students to be self-regulating learners. In


three general types are of particular importance. D.H. Schunk & B.J. Zimmerman (Eds.), Self-reg-
Strategic knowledge refers to knowledge of strate- ulated learning: From teaching to self-reflective
practice (pp. 57-85). New York: Guilford.
gies for learning and thinking. Knowledge of tasks Paris, S., Lipson, M., & Wixson, K. (1983). Becoming
and their contexts represents knowledge about dif- a strategic reader. Contemporary EducationalPsy-
ferent types of cognitive tasks as well as class- chology, 8, 293-316.
room and cultural norms. Finally, self-knowledge Paris, S., & Winograd, P. (1990). How metacognition
is a critically important component of metacogni- can promote academic learning and instruction. In
B.F. Jones & L. Idol (Eds.), Dimensions of think-
tive knowledge. Because metacognitive knowledge ing and cognitive instruction (pp. 15-51). Hills-
in general is positively linked to student learning, dale, NJ: Erlbaum.
explicitly teaching metacognitive knowledge to fa- Pintrich, P.R., McKeachie, W.J., & Lin, Y. (1987).
cilitate its development is needed. As the revised Teaching a course in learning to learn. Teaching
Taxonomy emphasizes, the need to align objec- of Psychology, 14, 81-86.
Pintrich, P.R., & Schrauben, B. (1992). Students' moti-
tives, instruction, and assessment requires us to vational beliefs and their cognitive engagement in
consider the role that metacognitive knowledge classroom tasks. In D. Schunk & J. Meece (Eds.),
plays in the classroom. Student perceptions in the classroom: Causes and
consequences (pp. 149-183). Hillsdale, NJ: Erlbaum.
References Pintrich, P.R., & Schunk, D.H. (2002). Motivation in
education: Theory, research, and applications.
Baker, L., & Cerro, L. (2000). Assessing metacognition Upper Saddle River, NJ: Merrill Prentice-Hall.
in children and adults. In G. Schraw & J. Impara Pintrich, P.R., Wolters, C., & Baxter, G. (2000). As-
(Eds.), Issues in the measurement of metacognition sessing metacognition and self-regulated learning.
(pp. 99-145). Lincoln, NE: Buros Institute of Mental In G. Schraw & J. Impara (Eds.), Issues in the
Measurements. measurement of metacognition (pp. 43-97). Lin-
Bransford, J., Brown, A., & Cocking, R. (1999). How coln, NE: Buros Institute of Mental Measurements.
people learn: Brain, mind, experience, and school. Schneider, W., & Pressley, M. (1997). Memory devel-
Washington, DC: National Academy Press. opment between two and twenty. Mahwah, NJ:
Brown, A., Bransford, J., Ferrara, R., & Campione, J. Lawrence Erlbaum Associates.
(1983). Learning, remembering, and understand- Snow, R., Corno, L., & Jackson, D. (1996). Individual
ing. In P.H. Mussen (Series Ed.) & J. Flavell & E. differences in affective and cognitive functions.
Markman (Vol. Eds.), Handbook of child psychol- In D. Berliner & R. Calfee (Eds.), Handbook of
ogy: Vol. 3. Cognitive development (4th ed., pp. EducationalPsychology (pp. 243-3 10). New York:
77-166). New York: Wiley. Macmillan.
Flavell, J. (1979). Metacognition and cognitive monitor- Weinstein, C.E., & Mayer, R. (1986). The teaching of
ing: A new area of cognitive-developmental inquiry. learning strategies. In M.C. Wittrock (Ed.), Hand-
American Psychologist, 34, 906-911. book of research on teaching (pp. 315-327). New
Hofer, B., Yu, S., & Pintrich, P.R. (1998). Teaching York: Macmillan.

ip

225
RichardE. Mayer

Rote Versus Meaningful Learningi

L EARNING INVOLVES THE ACQUISITION of knowl- retention requires that students remember what they
have learned, whereas transfer requires students not
L edge. This is a commonsense view of learn-
ing that has implications for how to teach-such only to remember but also to make sense of and be
as presenting information to learners in books and able to use what they have learned (Bransford,
lectures-and how to assess-such as testing to Brown, & Cocking, 1999; Detterman & Sternberg,
see how much of the presented material students 1993; Haskell, 2001; Mayer, 1995; McKeough,
can remember (Mayer, 2001). The revised Taxon- Lupart, & Marini, 1995; Phye, 1997). Stated some-
omy is based on a broader vision of learning that what differently, retention focuses on the past;
includes not only acquiring knowledge but also be- transfer emphasizes the future. After reading a text-
ing able to use knowledge in a variety of new situ- book lesson on Ohm's Law, for example, a reten-
ations. When taking a knowledge acquisition view tion test might include questions asking students
of learning, teachers sometimes emphasize one kind to write the formula for Ohm's Law. In contrast, a
of cognitive processing in instruction and assess- transfer test might include questions asking stu-
ment-what we call Remembering. Like the origi- dents to rearrange an electrical circuit to maximize
nal Taxonomy, however, the revised Taxonomy is the rate of electron flow or to use Ohm's Law to
based on the idea that schooling can be expanded explain a complex electric circuit.
to include a fuller range of cognitive processes. Although educational objectives for promot-
The purpose of this article is to describe this fuller ing retention are fairly easy to construct, educators
range of processes in more detail. may have more difficulty in formulating, teaching,
Two of the most important educational goals and assessing objectives aimed at promoting trans-
are to promote retention and to promote transfer fer (Baxter, Elder, & Glaser, 1996; Mayer, 2002;
(which, when it occurs, indicates meaningful learn- Phye, 1997). The revised Taxonomy is intended to
ing). Retention is the ability to remember material help broaden the typical set of educational objec-
at some later time in much the same way it was tives to include those aimed at promoting transfer.
presented during instruction. Transfer is the abili-
ty to use what was learned to solve new problems, A Tale of Three Learning Outcomes
answer new questions, or facilitate learning new As an introduction, consider three learning
subject matter (Mayer & Wittrock, 1996). In short, scenarios. The first exemplifies what might be
called no learning, the second, rote learning, and
Richard E. Mayer is a professor of psychology and edu-
cation at the University of California, Santa Barbara. the third, meaningful learning.

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright 2002 College of Education, The Ohio State University
Mayer
Rote Versus Meaningful Learning

No learning possesses relevant knowledge, she also can use that


Amy reads a chapter on electrical circuits in knowledge to solve problems and understand new
her science textbook. She skims the material, certain concepts. She can transfer her knowledge to new
that the test will be a breeze. When she is asked to p.roblems and new learning situations. Carla has
recall part of the lesson (as a retention test), she is altended to relevant information and has under-
able to remember very few of the key terms and stood it. The resulting learning outcome can be
facts. For example, she cannot list the major compo- called meaningful learning.
nents in an electrical circuit even though they were Meaningful learning occurs when students
described in the chapter. When she is asked to use build the knowledge and cognitive processes needed
the information to solve problems (as part of a trans- for successful problem solving. Problem solving in-
fer test), she cannot. For example, she cannot an- volves devising a way of achieving a goal that one
swer an essay question that asks her to diagnose a has never previously achieved; that is, figuring out
problem in an electrical circuit. In this worst-case how to change a situation from its given state into
scenario, Amy neither possesses nor is able to use a goal state (Mayer, 1992). Two major components
the relevant knowledge. Amy has neither sufficient- in problem solving are (a) problem representation,
ly attended to nor encoded the material during in which a student builds a mental representation
learning. The resulting outcome can be essentially of the problem, and (b) problem solution, in which
characterized as no learning. a student devises and carries out a plan for solving
the problem (Mayer, 1992).
Rote learning A focus on meaningful learning is consistent
Becky reads the same chapter on electrical with the view of learning as knowledge construc-
circuits. She reads carefully, making sure she reads tion in which students seek to make sense of their
every word. She goes over the material, memoriz- experiences. In constructivist learning, students
ing the key facts. When she is asked to recall the engage in active cognitive processing, such as pay-
material, she can remember almost all of the im- ing attention to relevant incoming information,
portant terms and facts in the lesson. Unlike Amy, mentally organizing incoming information into a
she is able to list the major components in an elec- coherent representation, and mentally integrating
trical circuit. However, when Becky is asked to incoming information with existing knowledge
use the information to solve problems, she cannot. (Mayer, 1999). In contrast, a focus on rote learn-
Like Amy, she cannot answer the essay question ing is consistent with the view of learning as knowl-
requiring her to diagnose a problem in an electri- edge acquisition in which students seek to add new
cal circuit. In this scenario, Becky possesses rele- information to their memories (Mayer, 1999).
vant knowledge but is unable to use that knowledge Meaningful learning is recognized as an im-
to solve problems. She cannot transfer this knowl- portant educational goal. It requires that instruction
edge to a new situation. Becky has attended to go beyond simple presentation of Factual Knowl-
relevant information but has not understood it and, edge and that assessment tasks require more of stu-
therefore, cannot use it. The resulting learning out- dents than simply recalling or recognizing Factual
come can be called rote learning. Kr,owledge (Bransford, Brown, & Cocking, 1999;
Lambert & McCombs, 1998). The cognitive process-
Meaningful learning es summarized here describe the range of students'
Carla reads the same textbook chapter on cognitive activities in meaningful learning; that is,
electrical circuits. She reads carefully, trying to these processes are ways students can actively en-
make sense out of it. When asked to recall the gage in the process of constructing meaning.
material, she, like Midori, can remember almost
all of the important terms and facts in the lesson. Cognitive Processes for
Furthermore, when she is asked to use the infor- Retention and Transfer
mation to solve problems, she generates many pos- If you are interested mainly in teaching and
sible solutions. In this scenario, Carla not only assessing the degree to which students have learned

227
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

some subject matter content and retained it over some Recognizing (also called identifying) involves
period of time, you would focus primarily on one locating knowledge in long-term memory that is
class of cognitive processes, namely, those associat- consistent with presented material. For example, in
ed with Remember. In contrast, if you wish to ex- social studies, an objective could be "Identify the
pand your focus by finding ways to foster and assess major exports of various South American countries."
meaningful learning, you need to emphasize those A corresponding test item would be "Which of
cognitive processes that go beyond remembering. these is a major export of Colombia? (a) bananas,
What are some of the cognitive processes used (b) coffee, (c) silk, (d) tea."
for retention and transfer? As discussed above, the Recalling (also called retrieving) involves re-
revised Taxonomy includes six cognitive process cat- trieving relevant knowledge from long-term mem-
egories-one most closely related to retention (Re- ory. In literature, an objective could be "Recall the
member) and the other five increasingly related to poets who authored various poems." A correspond-
transfer (Understand, Apply, Analyze, Evaluate, and ing test question would be "Who wrote The Charge
Create). Based on a review of the illustrative ob- of the Light Brigade?"
jectives listed in the original Taxonomy and an
examination of other classification systems, we Understand
have selected 19 specific cognitive processes that As you can see from the previous section,
fit within these six categories. These 19 cognitive when the goal of instruction is to promote reten-
processes are intended to be mutually exclusive; tion, the most important cognitive process is Re-
together they delineate the breadth and boundaries member. However, when the goal of instruction is
of the six categories. In the discussion that fol- to promote transfer, the focus shifts to the other
lows, each of the six categories, as well as the five cognitive process categories, Understand
cognitive processes that fit within them, are de- through Create. Of these, arguably the largest cat-
fined and exemplified. egory of transfer-based educational objectives em-
phasized in schools and colleges is Understand.
Remember Students are said to understand when they are able
When the objective of instruction is to pro- to construct meaning from instructional messages-
mote retention of the presented material in much including oral, written, and graphic communica-
the same form in which it was taught, the relevant tions, and material presented during lectures, in books,
process category is Remember. Remembering in- or on computer monitors. Examples of potential in-
volves retrieving relevant knowledge from long- structional messages are an in-class physics dem-
term memory. Remembering knowledge is essential onstration, a geological formation viewed on a field
for meaningful learning and problem solving when trip, a computer simulation of a trip through an art
that knowledge is used in more complex tasks. For museum, or a musical work played by an orches-
example, knowledge of the correct spelling of com- tra, as well as numerous verbal, pictorial, and sym-
mon English words appropriate to a given grade lev- bolic representations on paper.
el is necessary if a student is to master writing an Students understand when they build connec-
essay. When teachers concentrate solely on rote leam- tions between the new knowledge to be gained and
ing, teaching and assessing focus solely on remem- their prior knowledge. More specifically, the in-
bering elements or fragments of knowledge, often in coming knowledge is integrated with existing sche-
isolation from any context. When teachers focus on mas and cognitive frameworks. Cognitive processes
meaningful learning, however, remembering knowl- in the category of Understand include interpreting,
edge is integrated within the larger task of con- exemplifying, classifying, summarizing, inferring,
structing new knowledge or solving new problems. comparing, and explaining.
In other words, when meaningful learning is the Interpreting (also called clarifying, para-
goal, then remembering becomes a means to an phrasing, representing, or translating)occurs when
end, rather than the end itself. The two associated a student is able to convert information from one
cognitive processes are recognizing and recalling. form of representation to another. In mathematics,

228
Mayer
Rote Versus Meaningful Learning

for example, a sample objective could be "Learn Comparing (also called contrasting, mapping,
to translate number sentences expressed in words or matching) involves detecting similarities and
into algebraic equations expressed in symbols." A differences between two or more objects, events,
corresponding assessment item involves asking stu- icleas, problems, or situations. In the field of social
dents to write an equation (using B for the number studies, for example, an objective may be "Under-
of boys and G for the number of girls) that corre- stand historical events by comparing them to fa-
sponds to the statement, "There are twice as many niiliar situations." A corresponding assessment
boys as girls in this class." question is "How is the American Revolution like
Exemplifying (also called illustrating or in- a family fight or an argument between friends?"
stantiating) occurs when a student finds a specific Explaining (also called constructing models)
example or instance of a general concept or princi- occurs when a student mentally constructs and uses
ple. In art history, an objective might be "Learn to a cause-and-effect model of a system or series. In
identify various artistic painting styles." A corre- natural science, an objective could be "Explain
sponding assessment involves asking students to observed phenomena in terms of basic physics
find a new example of the impressionist style (with laws." Corresponding assessments involve asking
new meaning an example not included in the text- students who have studied Ohm's Law to explain
book or used in class). what happens to the rate of the current when a
Classifying (also called categorizing or sub- second battery is added to a circuit, or asking stu-
suming) occurs when a student determines that dents who have viewed a video on lightning storms
something (e.g., a particular instance or example) to explain how differences in temperature are in-
belongs to a certain category (e.g., concept or prin- volved in the formation of lightning.
ciple). In social studies, an objective may be "Learn
to classify observed or described cases of mental Apply
disorders." A corresponding assessment item is to Apply involves using procedures to perform
ask students to observe a video of the behavior of exercises or solve problems and is closely linked
a mental patient and then indicate the mental dis- with Procedural Knowledge. The Apply category
order that is being displayed. consists of two cognitive processes: executing-
Summarizing (also called abstractingor gen- when the task is an exercise (i.e., familiar to the
eralizing) occurs when a student produces a short learner), and implementing-when the task is a
statement that represents presented information or problem (i.e., unfamiliar to the learner).
abstracts a general theme. The length of the summa- Executing (also called carrying out) occurs
ry depends to a certain extent on the length of the when a student applies a procedure to a familiar
presented material. For example, a sample objective task. For example, a sample objective in elementa-
in history could be "Learn to write summaries of ry level mathematics could be "Learn to divide
events portrayed pictorially." A corresponding as- one whole number by another, both with multiple
sessment item involves asking students to watch a digits." To assess the objective, a student may be
videotape about the French Revolution and then given a worksheet containing 15 whole number
write a cohesive summary. division exercises (e.g., 784/15) and asked to find
Inferring (also called concluding, extrapolat- their quotients.
ing, interpolating, or predicting) involves drawing a Implementing (also called using) occurs when
logical conclusion from presented information. For a student applies one or more procedures to an
example, in learning Spanish as a second language, a unfamiliar task. In natural science, a sample ob-
sample objective could be "Students will be able to jective might be "Learn to use the most effective,
infer grammatical principles from examples." To as- efficient, and affordable method of conducting a
sess this objective a student may be given the article- research study to address a specific research ques-
noun pairs, "la casa, el muchacho, la senorita, el pero," tion." A corresponding assessment is to give students
and asked to formulate a principle for when to use a research question and have them propose a research
the article la and when to use the article el. study that meets specified criteria of effectiveness,

229
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

efficiency, and affordability. Notice that in this Organizing (also called finding coherence, in-
assessment task, students must not only apply a tegrating, outlining, parsing, or structuring) involves
procedure (i.e., engage in implementing) but also determining how elements fit or function within a
rely on conceptual understanding of the problem and structure. An objective in social studies could be
procedure. Thus, unlike executing, which relies al- "Learn to structure a historical description into evi-
most exclusively on cognitive processes associated dence for and against a particular explanation." In a
with Apply, implementing involves cognitive processes corresponding assessment students could be asked to
associated with both Understand and Apply. prepare an outline showing which facts in a passage
on American history support and which facts do not
Analyze support the conclusion that the American Civil War
Analyze involves breaking material into its was caused by differences in the rural and urban com-
constituent parts and determining how the parts position of the North and the South.
are related to each other and to an overall struc- Attributing (also called deconstructing) occurs
ture. This category includes the cognitive process- when a student is able to determine the point of view,
es of differentiating, organizing, and attributing. biases, values, or intent underlying presented materi-
Therefore, objectives classified as Analyze include al. For example, in social studies, a sample objective
learning to determine the relevant or important could be "Learn to determine the point of view of the
pieces of a message (differentiating), the ways in author of an essay on a controversial topic in terms
which the pieces of a message are configured (or- of his or her theoretical perspective." A correspond-
ganizing), and the underlying purpose of the mes- ing assessment task could ask students whether a re-
sage (attributing). Although learning to Analyze port on Amazon rain forests was written from a
may be viewed as an end in itself, it is probably pro-environment or pro-business point of view. A
more defensible educationally to consider analysis corresponding assessment in the natural sciences
as an extension of Understanding or as a prelude could be to ask a student to determine whether a
to Evaluating or Creating. behaviorist or a cognitive psychologist wrote an
Improving students' skills in analyzing educa- essay about human learning.
tional communications can be found as a goal in many
fields of study. Teachers of science, social studies, Evaluate
the humanities, and the arts frequently express "learn- Evaluate is defined as making judgments based
ing to analyze" as one of their important objectives. on criteria and standards. The criteria most often used
They may, for example, wish to develop in their stu- are quality, effectiveness, efficiency, and consisten-
dents the ability to (a) connect conclusions with sup- cy. They may be determined by the student or given
porting statements; (b) distinguish relevant from to the student by others. The standards may be either
extraneous material; (c) determine how ideas are con- quantitative (i.e., is this a sufficient amount?) or qual-
nected to one another; (d) ascertain the unstated as- itative (i.e., is this good enough?). This category in-
sumptions involved in what is said; (e) distinguish cludes the cognitive processes of checking (which
dominant from subordinate ideas or themes in poetry refers to judgments about internal consistency) and
or music; and (f) find evidence in support of an au- critiquing (which refers to judgments based on exter-
thor's purposes for writing an essay. nal criteria).
Differentiating (also called discriminating, Checking (also called coordinating, detect-
selecting, distinguishing, orfocusing) occurs when a ing, monitoring, or testing) occurs when a student
student discriminates relevant from irrelevant parts detects inconsistencies or fallacies within a process
or important from unimportant parts of presented or product, determines whether a process or product
material. In mathematics, an objective could be "Dis- has internal consistency, or detects the effectiveness
tinguish between relevant and irrelevant numbers in of a procedure as it is being implemented. When
a word problem." An assessment item could require combined with planning (a cognitive process in the
that students circle the relevant numbers and cross category, Create) and implementing (a cognitive
out the irrelevant numbers in a word problem. process in the category, Apply), checking involves

230
Mayer
Rote Versus Meaningful Learning

determining how well the plan is working. A sam- is followed by a convergent phase, in which a so-
ple objective in social science could be "Learn to lution method is devised and turned into a plan of
detect inconsistencies within persuasive messag- action (planning). Finally, the plan is executed as
es." A corresponding assessment task could involve the solution is constructed (producing). Not sur-
asking students to listen to a television advertise- prisingly, then, Create can be broken down into
ment for a political candidate and point out any three cognitive processes: generating,planning, and
logical flaws in the persuasive message. A sample producing.
objective in science could be "Learn to determine Generating (also called hypothesizing) in-
whether a scientist's conclusion follows from the volves inventing alternative hypotheses based on
observed data." An assessment task could involve criteria. When generating transcends the bound-
asking students to read a report of a chemistry ex- aries or constraints of prior knowledge and exist-
periment in order to determine whether the con- ing theories, it involves divergent thinking and
clusion follows from the results of the experiment. forms the core of what can be called creative think-
Critiquing (also called judging) occurs when a ing. In generating, a student is given a description
student detects inconsistencies between a product or of a problem and must produce alternative solu-
operation and some external criteria, determines tions. For example, in social science, an objective
whether a product has extemal consistency, or judg- could be "Learn to generate multiple potentially
es the appropriateness of a procedure for a given useful solutions for social problems." A correspond-
prob]em. Critiquing lies at the core of what has been ing assessment item could ask students to suggest
called critical thinking. In critiquing, students judge as many ways as possible to assure that everyone
the merits of a product or operation based on speci- has adequate medical insurance. An objective from
fied or student-determined criteria and standards. In the field of mathematics could be "Generate alter-
social science, an objective could be "Learn to eval- native methods for achieving a particular end re-
uate a proposed solution (e.g., eliminate all grading) suilt." A corresponding assessment could be to ask
to a social problem (e.g., how to improve K-12 edu- students to list alternative methods they could use
cation) in terms of its likely effectiveness." tc find which whole numbers yield 60 when multi-
plied together. For each of these assessments, ex-
Create p]icit scoring criteria are needed.
Create involves putting elements together to Planning (also called designing) involves de-
form a coherent or functional whole; that is, reor- vising a method for accomplishing some task. How-
ganizing elements into a new pattern or structure. ever, planning stops short of carrying out the steps
Objectives classified as Create involve having stu- to create the actual solution for a given problem.
dents produce an original product. Composition (in- In planning, a student may establish subgoals (i.e.,
cluding writing), for example, often, but not always, break a task into subtasks to be performed when
involves cognitive processes associated with Cre- sclving the problem). Teachers often skip stating
ate. It can, in fact, be simply the application of planning objectives, instead stating their objectives
procedural knowledge (e.g., "Write this essay in in terms of producing, the final stage of the creative
this way"). The creative process can be broken into process. When this happens, planning is either as-
three phases: (a) problem representation, in which sumed or is implicit in the producing objective. In
a student attempts to understand the task and gen- this case, planning is likely to be carried out by
erate possible solutions; (b) solution planning, in th.w student covertly, in the course of constructing
which a student examines the possibilities and de- a product (i.e., producing). In planning, a student
vises a workable plan; and (c) solution execution, develops a solution method when given a problem
in which a student successfully carries out the plan. statement. In mathematics, an objective could be
Thus, the creative process can be thought of as "List the steps needed to solve geometry problems."
starting with a divergent phase in which a variety An assessment task may ask students to devise a
of possible solutions are considered as the student plan for determining the volume of the frustum of
attempts to understand the task (generating). This a pyramid (a task not previously considered in

231
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

class). The plan may involve computing the volume Note


of a large pyramid, then computing the volume of a I. This article is based on Chapter 5, The Cognitive
Process Dimension in A Taxonomy for Learning,
small pyramid, and, finally, subtracting the smaller
Teaching, and Assessing: A Revision of Bloom's
from the larger. Taxonomy of Educational Objectives (Anderson,
Producing (also called constructing) involves Krathwohl, et al., 2001) and is reproduced by per-
inventing a product. In producing, a student is given mission of the publisher. I am pleased to acknowl-
a functional description of a goal and must create a edge that the following authors contributed to this
article: Lorin W. Anderson, David R. Krathwohl,
product that satisfies the description. In science, for
Paul Printrich, and Merlin Wittrock. I also grateful-
example, an objective might be "Learn to design hab- ly acknowledge the assistance of the entire team of
itats for certain species and certain purposes." A cor- Taxonomy authors.
responding assessment task may ask students to design
the living quarters of a space station. References
Baxter, G.P., Elder, A.D., & Glaser, R. (1996). Knowl-
Conclusion edge-based cognition and performance assessment
The primary goal of this article has been to in the science classroom. Educational Psycholo-
gist, 31, 133-140.
examine how teaching and assessing can be broad- Bransford, J.D., Brown, A.L., & Cocking, R. (1999).
ened beyond an exclusive focus on the cognitive How people learn: Brain, mind, experience, and
process of Remember. The revised Taxonomy con- school. Washington, DC: National Academy Press.
tains descriptions of 19 specific cognitive process- Detterman, D.K., & Sternberg, R.J. (Eds.). (1993).
es associated with six process categories. Two of Transfer on trial: Intelligence, cognition, and in-
struction. Norwood, NJ: Ablex.
these cognitive processes are associated with Re-
Haskell, R.E. (2001). Transfer of learning. San Diego:
member; 17 are associated with the five more com- Academic Press.
plex cognitive process categories: Understand, Lambert, N.M., & McCombs, B.L. (Eds.). (1998). How
Apply, Analyze, Evaluate, and Create. students learn. Washington, DC: American Psy-
Our analysis has implications for teaching and chological Association.
Mayer, R.E. (1992). Thinking, problem solving, cogni-
assessing. On the teaching side, two of the cognitive
tion (2nd ed.). New York: Freeman.
processes help to promote retention of learning, Mayer, R.E. (1995). Teaching and testing for problem
whereas 17 of them help foster transfer of learning. solving. In L.W. Anderson (Ed.), International
Thus, when the goal of instruction is to promote trans- encyclopedia of teaching and teacher education
fer, objectives should include the cognitive processes (2nd ed., pp. 4728-4731). Oxford, UK: Pergamon.
associated with Understand, Apply, Analyze, Evalu- Mayer, R.E. (1999). The promise of educational psy-
chology. Upper Saddle River, NJ: Prentice-Hall.
ate, and Create. The descriptions in this chapter are Mayer, R.E. (2001). Changing conceptions of learn-
intended to help educators generate a more complete ing: A century of progress in the scientific study
range of educational objectives that are likely to re- of learning. In L. Corno (Ed.), Education across
sult in both retention and transfer. the century: The centennial volume-One hun-
On the assessment side, our analysis of cog- dredth yearbook of the National Society for the
Study of Education (pp. 34-75). Chicago: National
nitive processes is intended to help educators (in- Society for the Study of Education.
cluding test designers) broaden the way they assess Mayer, R.E. (2002). Teaching for meaningful learn-
learning. When the goal of instruction is to pro- ing. Upper Saddle River, NJ: Prentice-Hall.
mote transfer, assessment tasks should involve cog- Mayer, R.E., & Wittrock, M.C. (1996). Problem-solv-
nitive processes that go beyond recognizing and ing transfer. In D.C. Berliner & R.C. Calfee (Eds.),
Handbook of educational psychology (pp. 47-62).
recalling. Although assessment tasks that use these
New York: Macmillan.
two cognitive processes have a place in assess- McKeough, A., Lupart, J., & Martini, A. (Eds.). (1995).
ment, these tasks can, and often should, be sup- Teaching for transfer. Mahwah, NJ: Erlbaum.
plemented with those that utilize the full range of Phye, G.D. (Ed.). (1997). Handbook of classroom as-
cognitive processes required for transfer of learning. sessment. San Diego: Academic Press.

232
James Raths

Improving Instruction

W HILE PRESERVICE TEACHER education pro- rectly with the first variable (time on task) and
grams often focus almost exclusively on inversely with the second (time needed to learn).
preparing teacher candidates to cope with the chal- This formula can be written in shorthand form as
lenges faced during their first year in the class- follows:
room, many master's-level programs for teachers
Learning = Time on task/Time needed to learn
emphasize improving instruction. Teachers who
enroll in such programs are encouraged to accept Carroll's model, so simple and obvious,
the reasonable assumption that all teachers, includ- spawned a great deal of research in the decades
ing the professors in the program, are not perfect after his essay was published. Within the context
in their practice, and that all can improve. Some of the Carroll model, the following can be taken as
programs, such as the Master of Instruction pro- evidence that instruction has improved:
gram at the University of Delaware, require candi- 1.If the amount of learning that takes place in a
dates to write personal goals having to do with class increases, all things being equal, then one
improving their instruction as a consideration at might reasonably infer that instruction has im-
the admissions point into the program. This em- proved.
phasis certainly begs the question: What counts as 2. If students increase their time on task within a
improved instruction? Stated somewhat different- lesson or a unit of study, all things being equal,
ly, if instruction were improved, how would we then one might reasonably infer that instruction
know it? has improved.
3. If the time students need to learn the objectives
What Counts as Improved Instruction? of the lesson or unit is reduced because of teach-
One answer to this question is reflected in er interventions (e.g., scaffolding), all things
the Carroll (1963) model of school learning.' This being equal, then one might reasonably infer that
model posits that student learning is dependent on instruction has improved.
two variables: the amount of time a student spends 4. If the complexity of the objectives addressed
learning a task and the amount of time a student increases across lessons or units, all things be-
needs to spend on the task in order to learn or ing equal, then one might infer that instruction
master it. Thus, the amount of learning varies di- has improved.
James Raths is a professor of education at the University 5. If the activities assigned to students and the as-
of Delaware. sessments given to students are more closely

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright C) 2002 College of Education, The Ohio State Univetsity
THEORY INTO PRACTICE/ Autumn 2002
Revising Bloom's Taxonomy

aligned with a lesson's or unit's objectives, all set about to collect appropriate descriptions of
things being equal, then one might reasonably teaching. We were not seeking descriptions of ex-
infer that instruction has improved. cellent teaching or descriptions authored by teach-
ers who were considered "master teachers" or
Certainly there may be other ways for im- "national board certified teachers" (although our
proving instruction. Examples would include en-
teachers may well fit into these categories). Rath-
gaging students in increasingly more worthwhile
er, we wanted teachers whose descriptions of their
educational experiences; increasing the dispositions
everyday teaching could be used to clarify the cate-
of the teacher to convey caring attitudes toward
gories and classifications of the revised Taxonomy.
students; linking the topics and objectives of one
As we collected the drafts of the vignettes,
unit with those of others within the curriculum;
we found two interesting phenomena. First, as
and matching instructional activities to learner char-
teachers cited their unit's goals, they wrote down
acteristics (such as cognitive styles). Of course,
activities, not objectives. For example, for a unit
the Carroll model is so encompassing that even
combining the Parliamentary Acts (ca. 1770) with
these alternatives can be easily subsumed by the
persuasive writing, Ms. Gwen Airasian, a fifth
variables within it. Being more caring, for exam-
grade teacher, wrote as one of her goals "Students
ple, could help increase students' time on task.
will write persuasive editorials stating their opin-
Similarly, providing students with more worthwhile
ions about the Parliamentary Acts." We presumed
educational experiences could increase students'
that the actual objective of the unit would be re-
motivation. Finally, matching instructional activi-
flected in her answer to the question "What do you
ties to students' cognitive styles might reduce the
amount of time students need to meet the lesson or want students to learn as a result of writing these
unit objectives. The point here is that the Carroll editorials?" In short, her real objective is more
model is only one way to derive conceptions of tacit than explicit. It became apparent to us that
what counts as instructional improvement. implicit objectives make the assessment phase of
teaching more difficult.
How Does the Revised Taxonomy Help? A second phenomenon we observed in the
vignettes (and one typically related to the first)
There are at least two ways the revised Tax-
was a misalignment within the planning and deliv-
onomy can help teachers who are interested in im-
ery of the unit between the unit objectives, the
proving their instruction and who adopt the Carroll
instructional activities, and/or the ways in which
model and the inferences derived from it as de-
teachers assessed student learning. Ms. Margaret
scribed above. The first is to align activities and
Jackson's teaching vignette concerning Macbeth il-
assessments with objectives. The second is to raise
lustrates this situation. Our analysis found that "al-
the learning targets themselves.
though most of the instructional activities emphasize
Aligning objectives, activities, and assessments Conceptual Knowledge, they differ in the cognitive
As we met to plan and carry out our work on processes they demand from students. In many cases
the revised Taxonomy, we soon accepted Benjamin these demands are beyond Understanding, which is
Bloom's assessment that very few people actually the target of the second objective" (Anderson, Krath-
read the book in which the original Taxonomy ap- wohl, et al., 2001, p. 149). Similarly, despite this
peared. Instead, they read about the categories of emphasis on Conceptual Knowledge, Ms. Jackson felt
the original Taxonomy in secondary sources, such compelled to administer a traditional FactualKnowl-
as methods texts or assessment texts, where the edge unit test because of district grading requirements.
framework is reproduced. We wanted our revision The preceding observations have two lessons
to be read. There was a consensus among us that for potential users of the revised Taxonomy. First,
by including annotated descriptions of teaching to it is critically important to distinguish between
highlight the general propositions found in the re- objectives and activities. Without this distinction,
vised Taxonomy, we could increase the likelihood it is difficult to know what precisely is to be as-
that the book would be read. Shortly thereafter, we sessed at the end of the unit and how instructional

234
Raths
Improving Instruction

activities and assessment tasks are distinct, yet com- important details about the play, (e.g., specific
plementary. Second, it is important to align in- events, characters, and their relationships). In con-
structional activities and assessment tasks with trast, the second objective was for students to un-
objectives, whether they are implicit or explicit. derstand the meaning and significance of classical
Only with proper alignment, is the efficacy of in- literature in their own lives. It is not that remem-
struction likely to be optimized. bering things is not important (see Mayer, this is-
Teachers interested in improving their instruc- sue). It is that remembering things is not sufficient
tion can use the Taxonomy Table (which is repro- for being a truly educated person-a person who
duced on the inside front cover of the revised can use what he or she has learned previously to
Taxonomy) to review their plans to assure that their learn new things and to solve a variety of academ-
objectives, activities, and assessments are properly ic and nonacademic problems.
aligned. Suppose a teacher holds as an objective In this regard, the revised Taxonomy gives
that students will learn to rigorously apply state us two ways in which the learning target can be
rubrics to their own writing samples. He or she raised. The first is to focus on increasingly more
will need to plan the instruction so students have complex cognitive processes, particularly Analyze,
the opportunity to do this. The instructional activities Evaluate, and Create. For example, rather than
might be organized in a way to scaffold the learning being satisfied with being able to remember or un-
process. For example, the rubrics can be applied to derstand "tourists," "migrants," and "immigrants"
pieces of writing the teacher has selected to illus- as individual concepts, teachers may consider
trate various dimensions of the rubric. Or students whether students should learn to
can be assigned the responsibility of applying only
* analyze concepts such as these in a larger con-
one dimension of the rubric at a time until all of
text (e.g., rights and obligations of nonresidents
the dimensions have been understood. To the ex-
or noncitizens);
tent this is done, the activities are more likely to
* evaluate proposals for dealing with a variety of
be aligned with the stated objective.
social problems (e.g., illegal immigrants or un-
Furthermore, if a teacher wants to assess the
schooled migrants); or
extent to which students have acquired the objec-
* create policies that solve specific social problems
tive, he or she will need to have ways of assessing
without causing other problems (e.g., dealing
the rigor with which students apply state rubrics to
with immigrants without negatively impacting on
their own writing samples. When this is done, the
tourism).
alignment puzzle becomes complete; that is, both
activities and assessments are aligned with objec- A second way the learning target can be
tives. And, as the Carroll model suggests, when raised is to move beyond the three traditional aca-
instruction is aligned with the objectives, students demic types of knowledge (e.g., factual, conceptu-
will need to spend less time learning the objective. al, and procedural) and consider objectives that
Thus, all things being equal, instruction will have ernphasize metacognitive knowledge (see Pintrich,
improved. this issue). One of the primary benefits of meta-
ccgnitive knowledge is that it "connects" students
Raising learning targets to academic learning. That is, armed with meta-
One inference that can be derived from the cognitive knowledge, students can see how aca-
Carroll model is that the learning target itself can demic learning relates to them and how they, in
be raised. It is on this particular point that the turn, relate to academic learning. Through meta-
revised Taxonomy can be of assistance to teach- cognitive knowledge, they gain knowledge of strat-
ers. In combination, the vignettes contain exam- egies they can use to learn science, mathematics,
ples of the range of objectives that can be pursued foreign language, etc. They gain knowledge of sub-
in schools and classrooms. In the previously men- jects in which they are and are not interested.
tioned Macbeth vignette, Ms. Jackson had two ob- Regardless of how this issue is addressed,
jectives. The first was for her students to remember one implication of the Carroll model is that as

235
THEORY INTO PRACTICE/Autumn 2002
Revising Bloom's Taxonomy

teachers are able to raise the learning target of a conceptual understanding of war and resources, and
particular lesson or unit, it can be argued that in- learn how to make comparisons in general. For this
struction has improved. teacher, the activity statement may be a "shortcut"
method of describing what is going on in class. This
The Paradox of Simplicity Versus objective, while clear to the teacher, is implicit.
Complexity in Improving Instruction A second explanation for the conflation of
There is a sense, akin to one of Murphy's objectives and activities is associated with the cur-
Laws, that "nothing is simple." As we prepared rent push toward performance assessment (Wig-
the revised Taxonomy, the principles that emerged gins, 1993). It is, in effect, mistaking the objective
concerning the importance of distinguishing ob- with its indicator. Teachers strive to have their stu-
jectives from activities; aligning objectives, activ- dents do well on a performance task. So, for ex-
ities, and assessments; and raising the learning ample, writing an editorial, a task used to assess
target by introducing more complex objectives are students' understanding, is tranformed into the les-
all logical, simple, and supported by a good deal son objective.
of common sense. At the same time, they are some- The conflation of objectives and activities is
what problematic. Our collective experiences in seen as problematic to some supervisors and eval-
preparing the revised Taxonomy (especially our uators who expect teachers to make distinctions
analysis of the vignettes) caused us to stop and between their objectives and their activities (Popham,
reflect on enduring classroom problems and their 1973). Some teachers write very specific behavioral
contributions to "complexifying" these principal objectives to accommodate the expectations of their
ideas (see Anderson, Krathwohl, et al., 2001, chap. administrators. Although this approach helps clarify
14). In this section I would like to discuss a few of the distinction between objectives and activities, it
the issues that may cause one to pause when con- also tends to narrow the richness of the activities in
sidering the ideas presented in this article. which students are engaged.

The conflation of activities and objectives Assumptions about the learning target
Many teachers, including excellent ones, of- Researchers interested in studying teaching
ten conceive of their objectives as activities stu- and administrators interested in evaluating teach-
dents are invited to complete during an instructional ing like to think they are able to gauge the cogni-
unit. One purpose of a unit on the American Civil tive challenge that particular assignments offer
War, for example, might be "Compare the resourc- students. My application of the Carroll model is
es of the North and the South prior to the outbreak largely based on the assumption, made sometimes
of hostilities." Is this an objective or an activity? by teachers and often by evaluators, that if stu-
In my earlier discussion of Ms. Airasian's unit on dents are addressing an objective or are engaged
the Parliamentary Acts, we classified a similar ob- in a task at the high end of the revised Taxonomy,
jective as an activity, and advanced our belief that they are being cognitively challenged. However,
to use the revised Taxonomy effectively, teachers the "push-down principle," proposed by Merrill
should distinguish between objectives and activi- (1971), raises questions about the validity of this
ties. We learned, however, that this issue is more assumption.
complex than we initially believed. The push-down principle indicates that com-
The conflation, or blending, of objectives and plex tasks become simpler and more automatic with
activities can be explained in part by teachers' be- habit. In essence, it presupposes that students ad-
liefs, based on their experiences, in the education- dressing complex, challenging problems seek ways
al value of particular activities. For example, the to reduce the complexity and minimize the chal-
teacher of the Civil War unit may have learned lenge. Suppose, for example, a student encounters
that by conducting a comparison of prewar resourc- a novel problem. Initially, she selects approaches
es of the North and South in 1860, students ac- or constructs strategies until she finds one that
quire factual knowledge about the Civil War, gain solves it. Subsequently, when she faces a similar

236
Raths
Improving Instruction

problem, one classified as similar in cognitive chal- common sense-they are not so easy to implement.
lenge to the first, the tendency is to use the same Somewhat paradoxically, the conflation of objec-
strategy or approach used the last time, thus di- tives, activities, and assessment tasks makes it dif-
minishing the cognitive challenge of the problem. ficult to properly align objectives, activities, and
As Merrill (1971) pointed out, "Learners have an assessments. In addition, the best intentions may
innate tendency to reduce the cognitive load as not result in expected learning, particularly of more
much as possible; consequently a learner will at- cDmplex objectives. Nonetheless, the revised Tax-
tempt to perform a given response at the lowest onomy helps us understand these potential prob-
possible level" (p. 38). This is problematic for an lems and begin to resolve them.
observer watching students address a problem of
apparently significant cognitive challenge who is Note
unaware that students are actually working at low- 1 My colleague, Frank B. Murray of the University of
er cognitive levels. This problem is the major rea- Delaware, first pointed out to me the potential of
son that we classify intended learning (i.e., Carroll's formulation in this context. Of course, he
objectives) rather than actual learning in the Tax- is not responsible for my treatment of his original
suggestion.
onomy Table. Suffice it to say that as teachers
attempt to improve their instruction by raising their
References
targets, students may be working equally hard to
Anderson, L.W. (Ed.), Krathwohl, D.R. (Ed.), Airasian,
"push down" the targets. Again, teaching is a com- P.W., Cruikshank, K.A., Mayer, R.E., Pintrich, P.R.,
plicated business. Raths, J., & Wittrock, M.C. (2001). A taxonomy for
learning, teaching, and assessing: A revision of
Conclusion Bloom's Taxonomy of Educational Objectives
With an eye on improving instruction, I have (Complete edition). New York: Longman.
Carroll, J.B. (1963). A model of school learning. Teach-
suggested at least two ways in which teachers might ers College Record, 64, 723-733.
use the revised Taxonomy. The first is to properly Merrill, M.D. (1971, August). Necessary psychologi-
align objectives, activities, and assessments. The cal conditions for defining instructional outcomes.
second is to raise the learning targets in terms of Educational Technology, 34-39.
cognitive complexity, type of knowledge (particu- Popham, W.J. (1973). Evaluating instruction. Engle-
wood Cliffs, NJ: Prentice-Hall.
larly metacognitive knowledge), or both. While Wiggins, G.P. (1993). Assessing student performance.
both of these suggestions seem reasonable-almost San Francisco: Jossey-Bass.

nP

237
Chris Ferguson

Using the Revised Taxonomy to Plan


and Deliver Team-Taught, Integrated,
Thematic Units

As IF PLANNING A FAIRLY TRADITIONAL subject-


oriented class, taught by a single teacher, is
The school we worked in was a charter
school, which provided a bit more flexibility for
not challenging enough, the challenge increases great- teachers and students alike. Nonetheless, we were
ly when planning interdisciplinary units to be taught responsible for teaching state standards. The stu-
by two teachers. Based on my experience, this chal- dents in our classes were as diverse in terms of
lenge is reduced to a large extent when both teachers ethnicity and socioeconomic status as any other
understand the structure of the Taxonomy Table and public school in our district. Approximately 28%
use the language of the revised Taxonomy. of our students were minorities; about 10% would
qualify for a gifted and talented program on the
An Integrated Classroom basis of their standardized test scores.
During the 2000-2001 school year, a colleague
Integrating Subject Areas
and I implemented an integrated English and history
course entitled "Western Culture." The course was My colleague and I were aware that much of
based on the South Carolina state standards for En- what we taught in our English II and Western Civ-
glish IT (sophomore English) and Western Civiliza- ilization classes overlapped. In fact, in the past we
tion (a social studies elective). Our 100 sophomores had collaborated on short curriculum units where a
(divided into three sections of about 33 students each) single essay or research paper would count for both
had their English II and Western Civilization classes courses. One of the reasons for moving to a com-
scheduled in back-to-back 50-minute class periods pletely integrated course was to help our students
with a short break in between. In simplest terms, become better thinkers and writers. Although we
then, we taught three 100-minute blocks per day. understood the role of what we referred to as con-
The majority of the students in the first block tent and skills in both of our courses, the connec-
were students with special needs. Consequently, a tions between the two courses became clearer as
trained special needs teacher assisted in the in- we became familiar with the Taxonomy Table.
struction. In the other two blocks, students were The knowledge and cognitive process dimen-
grouped heterogeneously, differing widely in aca- sions enabled us to more clearly focus and explain
demic ability and motivation. our course integration. South Carolina's English II
Standards are divided into five general areas, or
Chris Ferguson is a teacher at the Hickory Tavern strands: reading, writing, research, listening, and
Middle School in Laurens, SC. speaking. We took from the revised Taxonomy the

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright (D 2002 College of Education, The Ohio State University
Ferguson
The Revised Taxonomy and Thematic Units

perception that initial learning in several of these WC 1. Understand and be able to explain the
areas-particularly writing, research, and speak- causes of the French Revolution;
ing-often takes the form of applying procedural WC2. Remember the major characters, events,
knowledge. In other words, there is a sequence of and dates related to the French Revolu-
steps students must learn and use to engage suc- tion; and
cessfully in basic writing, research, and speaking. WC3. Compare the three phases of the French
Once this procedural knowledge has been mastered, Revolution.
students can move on to analyzing, evaluating, or
For English II, students were expected to
even creating [based on] factual, conceptual knowl-
edge, and even metacognitive knowledge. El. Understand the meaning of the terms serial
South Carolina's Social Studies Standards (in- writing, historicalfiction, and novel;
cluding those for Western Civilization) contain large E2. Understand literary elements (specifically,
amounts of factual and conceptual knowledge at the character, plot, and setting) and literary de-
outset. In fact, remembering factual knowledge and vices (e.g., foreshadowing and personification
understanding conceptual knowledge are the two most as used in Dickens' A Tale of Two Cities);
dominant categories of the South Carolina Social E3. Use a variety of writing forms (e.g., descrip-
Studies Standards. Interestingly, therefore, when stu- tive, expository, persuasive) and structures
dents are expected to employ more complex cogni- (e.g., letters, outlines, essays) depending on
tive processes in social studies, they almost always the writing purpose;
need skills in written or oral expression. E4. Be able to make and evaluate oral presenta-
Thus, we came to the realization that West- tions, according to prespecified criteria.
ern Civilization and English II courses are best
As we began planning the integrated unit, we placed
combined when teachers are able to focus on the
these seven objectives in the Taxonomy Table as
factual and conceptual knowledge of history and,
shown in Table 1.
at the same time, develop the procedural knowl-
The reasoning for the placement of the ob-
edge of English. Furthermore, once students have
jectives in the Taxonomy Table is fairly obvious.
mastered the procedural knowledge of writing and
Note, however, that two of the objectives were
speaking, they have a basis for analyzing, evaluat-
placed in multiple cells. Objective E3 requires stu-
ing, and creating knowledge from both subject ar-
dents to understand various writing forms, struc-
eas simultaneously. This, in fact, was the overall
tures, and purposes (conceptual knowledge), as well
goal of our Western Culture class.
as write in accordance with a suggested set of teach-
er-given procedures (procedural knowledge). Sim-
Planning the Unit:
Specifying the Objectives ilarly, Objective E4 involves both making and
e-valuating oral presentations. Making presentations
One of the more interesting thematic units
is a creative act; evaluating them is, of course, an
we designed and implemented late in the school
evaluative act. The reason conceptual knowledge
year focused on the French Revolution. Students
was chosen is because the criteria (i.e., categories)
read the Dickens novel A Tale of Two Cities and
were given to the students.
studied the historical content of the French Revo-
lution. In addition to enhancing their understand-
ing of historical fiction, students were able to use Planning the Unit: Determining
the Instructional Activities
their content knowledge later to complete some
assessments that were both enjoyable and cogni- Over the course of the school year, my col-
tively challenging. league and I discovered that because projects active-
Working together, my colleague and I creat- ly involve students, they are the most effective way
ed separate objectives for Western Civilization and of maximizing student participation and learning.
English II for the French Revolution Unit. For However, traditional teaching methods-such as
Western Civilization, students were expected to lecture, discussions, and textbook assignments-

239
THEORY INTO PRACTICE/Autumn 2002
Revising Bloom's Taxonomy

Table 1
An Analysis of the Unit Objectives in Terms of the Taxonomy Table
The Cognitive Process Dimension
The Knowledge 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create
Dimension
A. Factual WC2
Knowledge
B. Conceptual WCI E4 E4
Knowledge WC3
El
E2
E3
C. Procedural
Knowledge
D. Metacognitive
Knowledge
Key
WC 1.Understand and be able to explain the causes of the French Revolution.
WC2. Remember the major characters, events, and dates related to the French Revolution.
WC3. Compare the three phases of the French Revolution.
El. Understand the meaning of the terms serial writing, historicalfiction, and novel.
E2. Understand literary elements (specifically, character, plot, and setting) and literary devices (e.g., foreshad-
owing and personification).
E3. Use a variety of writing forms (e.g., descriptive, expository, and persuasive) and structures (e.g., letters,
outlines, or essays) depending on writing purpose.
E4. Be able to make and evaluate oral presentations, in accordance with prespecified criteria.

are necessary to introduce students to the factual three, were responsible for summarizing the plot of
and conceptual knowledge they'll need to complete A Tale of Two Cities, identifying new characters or
the projects. Specifically, this factual and concep- settings, and continuing to develop familiar charac-
tual knowledge enables students to work together ters and settings. As they read the corresponding chap-
and use more complex cognitive processes while ter in the history textbook, students were expected to
working on their projects. Therefore, the initial in- take notes about characters, events, and dates (Ob-
structional activities for the first eight days of this jective WC2). The discussions in the textbook fo-
unit resembled a traditional classroom setting, in- cused on the causes and phases of the French
cluding very familiar forms of instruction. Revolution (Objectives WCI and WC3).
By the end of the eighth day, students were
Days 1-8 expected to have completed reading the novel and
During his initial lecture, Mr. Gillespie, the En- the textbook chapter, and written a complex set of
glish instructor, reviewed the concepts that would be notes.
used by students throughout their reading of A Tale
of Two Cities (Objectives El and E2). During this Days 9-14
period, large blocks of time were devoted to reading Students, working in groups of four, were as-
both the novel and the chapter in the history text on signed a historical or fictional character to prosecute
the French Revolution. To facilitate reading the nov- or defend in a trial, and were given an assignment
el, Mr. Gillespie divided it into sections, as if stu- sheet to guide them through the project (see Fig-
dents were "watching" an old-fashioned serial. After ure 1). Because the class would also serve as the
each installment, students, working in groups of jury, students designed rating scales to determine,

240
Ferguson
The Revised Taxonomy and Thematic Units

Figure 1
French Revolution/Charles Dickens Trial Assignment Sheet
Introduction: Trials were a major part of both the French Revolution and the novel A Tale of Two Cities.
In this project, you and your group members will assurme the role of prosecutors and defenders of major
characters, both historical and fictional.
Goal: The goal of the project is for you to apply the knowledge you have learned to either convict or
liberate your character. You may attempt to manipulate the information to benefit your cause, but you
must stick closely to the facts you have seen or read. Lying, or perjury, will not be tolerated and will
drastically harm your grade.
Here is the process we will use:
1. Divide into groups of four. Characters will be randomly assigned to two opposing groups. There will
be no changing of groups once the characters have been assigned. The possible characters and the
charges against them are as follows:
Louis XVI - Treason Marquis St. Evremonde - Murder
Marie Antoinette - Treason M. and Md. Defarge - Murder
Robespierre - Treason/Murder Miss Prosser - Murder
2. Working with your group, you will choose witnesses to call, items of evidence to introduce, and
strategies to convict or defend. You must convince a jury consisting of all of your classmates that your
client is either guilty or innocent. Mr. Gillespie and Mr. Ferguson will act as the judges for alternate
cases, and we will determine if testimony, evidence, and arguments are consistent with the facts.
3. A witness list will be turned in one week prior to the trial. Witnesses that appear on both lists will be
role-played by either Mr. Gillespie or Mr. Ferguson. We will attempt to remain neutral during question-
ing by both sides.
4. Witnesses that appear on only one side's list will be role-played by a person from your group. Again,
the judge will determine if testimony is acceptable or not. Feel free to object to the other group's
questions, but do so in an organized manner.
5. The class will develop some guidelines for determining the outcome of the trial based on the proof
presented. These guidelines will help ensure neutrality by the jury.
Good luck! Be creative, but be ethical!

based on the evidence presented during the trial, revolution.' Is this true for the French Revolution?
which side had won its case. A conglomeration of On what do you base your answer?" Essays of this
the rating scales created by students in all three sort often prove to be the most interesting aspect
classes is shown in Figure 2. Preparation for the of the unit because they provide insight into how
trials took place on Days 9-11; the trials took place students have integrated new information into their
on Days 12-14. existing schemas. They also enable us to deter-
mine the effects of this new knowledge on stu-
Day 15 dents' outlook on life-what we believe is the most
An important step in all integrated units is to exciting aspect of teaching!
allow students to summarize their knowledge in
some type of writing. For this unit, we asked stu- Planning the Unit: Assessments
dents to write a response to the following prompt: The authors of the revised Taxonomy clearly
"Former Communist Chinese leader Mao Tse Tung differentiated between formative and summative
wrote, 'The greater the suppression, the greater the assessments, and we believe that this is a critically

241
THEORY INTO PRACTICE/ Autumn 2002
Revising Bloom's Taxonomy

Figure 2 gained previously, as well as the knowledge they


Burden of Proof-Prosecution gain while doing the research for the projects them-
selves. By combining formative with summative
1. Did the prosecution present evidence that was assessment, then, we are able to address all six
consistent or at least plausible? categories of the Taxonomy Table.
YES One indirect outcome of this assessment pat-
5 4 3 2 1 tern is that we have completely shifted our outlook
2. Were the prosecution's witnesses believable? on why we ask students to complete certain tasks.
NO Similarly, and perhaps more importantly, students
YES come to view assessment as a more personalized
5 4 3 2 1
event, rather than an attempt to compare them with
3. Were the prosecution's closing arguments more other students. They also seem to enjoy assignments
effective than the defense's? where they are asked to create a product, and appre-
YES NO ciate the personalized feedback they receive from us
5 4 3 2 1 as teachers.
Finally, we took great care in ensuring that our
4. Did the prosecution prove the charges beyond assessments were aligned with our objectives. In the
a reasonable doubt? sample assessment in Figure 3, for example, students
YES NO are asked to determine whether given titles were se-
5 4 3 2 1 rials, historical fiction, or neither. This assessment
5. Which side do you believe best proved their case? was aligned with the first Objective El (see Table 1).
Another example of formative assessment is
PROSECUTION DEFENSE
1 having students write a business letter to King Louis
5 4 3 2
XVI from the perspective of a member of the Third
Why? Briefly explain your rating.
Estate in France prior to the Revolution. Students
should identify themselves and their occupation,
important distinction. Formative assessment is and describe their living conditions. Finally, they
"gathering information about learning as learning should ask the King for some relief, citing exam-
is taking place, so that 'in-flight' instructional ples from the French Enlightenment philosophers
modifications may be made to improve the quality to suggest changes that Louis could make to pre-
or amount of learning" (Anderson, Krathwohl, et vent violence. This assessment is aligned with two
al., 2001, pp. 101-102). In summative assessment, objectives: WCI and E3.
on the other hand, we "gather information about Two of the summative assessments were a
learning after learning should have occurred, usu- matching quiz on factual knowledge (WC2) and a
ally for the purpose of assigning grades to stu- written outline describing the three changes in gov-
dents" (p. 102). ernment during the French Revolution (WC3 and
As mentioned earlier, we believe students E3). As mentioned earlier, however, the mock trials
need a solid foundation of factual and conceptual are the major summative assessment, and constitute
knowledge before beginning work on projects. 60% of a student's grade. These trials, primarily
Therefore, our focus early in the unit was on for- targeted toward Objective E4, involved several of
mative assessments (see Figure 3 for an example). the other objectives as well as several of the cells
We used information gained from these assessments of the Taxonomy Table not specified as objectives
to adjust our instruction to focus on those areas in (e.g., analyze, metacognitive knowledge). Serving
which students were experiencing difficulties. as members of the jury, the class must evaluate
We rely heavily on the projects themselves [based on] factual, conceptual, and procedural
as summative assessments. This is appropriate since knowledge. And those students who are witnesses
projects require students to apply, analyze, evalu- must create a persona based on factual knowledge.
ate, and create based on the knowledge they have This assessment, then, is truly summative in the

242
Ferguson
The Revised Taxonomy and Thematic Units

Figure 3
Serials, Historical Fiction, and Novel Worksheet
Using the definition of a serial (or series), indicate whether each of the following items is an example
of a serial by writing yes or no in the blank next to it.
_ Superman comic book _ Reader's Digest
Survivor Vogue
-_____A
Tale of Two Cities Star Wars
______ Titanic Days of Our Lives
List any two serials you have seen or read.

Using the definition of historical fiction, indicate whether each of the following items is an example of
historical fiction by writing yes or no in the blank next to it.
______ Titanic ____ Autobiography of Malcolm X
______ The Patriot A Tale of Two Cities
-_____Julius
Caesarby Shakespeare _____ Forrest Gump
_ The Hunt for Red October _____ JFK

List one example of historical fiction you have seen or read. Also, give one example of a work you
have seen or read that is either nonfiction or pure fiction.

On a separate sheet of paper, write an answer to the following question:


Using what you know about the novel as a form of entertainment, social commentary, self-expression, and
a financial undertaking, discuss the role of modem movies as novels. Are movies better than novels? Why?

sense that it "sums up" student learning in a com- sessment and has allowed us to create assignments
prehensive, integrative way. and projects that require students to operate at more
complex levels of thinking. These benefits alone
Conclusion have helped us develop a course that is enjoyable
The Taxonomy Table has helped us develop arid challenging for our students and ourselves.
our integrated, thematic course in three very spe-
cific ways. First, it has given us a common lan-
guage with which to translate and discuss state References
standards from two different subject areas. Sec- Anderson, L.W. (Ed.), Krathwohl, D.R. (Ed.), Aira-
ond, it has helped us understand how our subjects sian, P.W., Cruikshank, K.A., Mayer, R.E., Pin-
trich, P.R., Raths, J., & Wittrock, M.C. (2001). A
overlap and how we can develop conceptual and taxonomy for learning, teaching, and assessing: A
procedural knowledge concurrently. Third, the Tax- revision of Bloom's Taxonomy of EducationalOb-
onomy Table has given us a new outlook on as- jectives (Complete edition). New York: Longman.

243
? Ann Byrd

The Revised Taxonomy and


Prospective Teachers

OVER THE NEXT TEN YEARS, an additional 2.2 tion to the teaching profession. Participation in TCP
0 million teachers will be needed in the United gives high school students insights into the nature
States. Increases in student enrollment, reductions in of teaching, the problems of schooling, and the
class sizes at the primary grades, implementation critical issues affecting the quality of education in
of full-day kindergarten programs, and increases America's schools. The primary goal of TCP is to
in the requirements for high school graduation are encourage academically talented or capable students
just some of the contributing factors to the tre- who possess exemplary interpersonal and leader-
mendous teacher shortage. In South Carolina, even ship skills to consider teaching as a career. An
though the number of teachers has increased by important secondary goal is to provide those who
30% since the 1980s, the state's teacher education choose not to enter the teaching profession with
programs will produce only about three-fourths of sufficient understanding about teaching and schools
the teachers that will be needed during the next so they will be civic advocates of education, regard-
decade (South Carolina Center for Teacher Recruit- less of what occupation or profession they enter.
ment, 1998).
With the national and state statistics in mind, A Brief Introduction to the
South Carolina has proactively addressed teacher Teacher Cadet Program
recruitment challenges by targeting precollegiate Piloted in four South Carolina high schools
audiences as part of an ongoing campaign to pro- in 1985-1986, the TCP has grown to include ap-
mote teaching as an attractive option for academi- proximately 150 of the 200 high schools in the
cally talented high school students. By offering a state. Currently, TCP enrolls approximately 2,500
survey education course called Teacher Cadet, ap- high school juniors and seniors each year. To be
proximately 75% of the high schools in South Caro- eligible for TCP, students must maintain at least a
lina provide these students with opportunities to 3.0 average (on a 4.0 scale) in a college preparato-
explore the role of the teacher and the importance ry curriculum, receive written recommendations
of education-to themselves and to society. from five teachers, and submit an essay giving their
The Teacher Cadet Program (TCP) is an in- reasons for wishing to participate in the class.
novative teacher recruitment strategy that provides TCP instructors serve as facilitators of learn-
high school students with a challenging introduc- ing, rather than the traditionally stereotypical "foun-
P. Ann Byrd is the executive director of the South Caro- tains of knowledge." Their role is to raise questions
lina Center for Teacher Recruitment. and engage in a meaningful dialogue with their

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright 3 2002 College of Education, The Ohio State University
Byrd
The Revised Taxonomy and Prospective Teachers

students about possible answers to these questions. Unit 4 - SAY (Science and Youth), MAY (Math
The Cadets, as they are called, are viewed as ac- and Youth), and FLAY (Foreign Language
tive participants in the learning process, capable and Youth)
of constructing their own knowledge. The curricu- Unit 5 - The Real Thing
lum provides a balance of information and oppor-
tunities for discovery. The use of technology, After completing an initial series of focused
opportunities for problem solving, and student in- observations in early childhood, elementary, mid-
teractivity are key elements in making the curricu- dle, and high school classrooms, students study
lum appealing to both students and teachers. what is known about teachers and teaching. The
The curriculum for TCP, Experiencing Edu- culminating activity for this section, which occurs
cation, is divided into three major sections: The in Unit 5, is for students to serve as teacher interns
Learner, The School, and The Teacher and Teach- in a classroom for at least three weeks. While do-
ing. The text is designed to introduce students to ir[g so, students analyze their own work, their co-
the field of education. The first unit, The Learner, operating teacher's work, and the work of their
helps students become better acquainted with them- students to enhance and reinforce the knowledge
selves as individuals, learners, and community and skills gained throughout the TCP course.
members. The second unit, The School, helps stu-
dents develop a greater understanding of the histo- Using the Revised Taxonomy
ry of education in South Carolina and in the nation, to Examine Unit 3
as well as insights into the structure and functions To illustrate the use of the revised Taxono-
of American schools and school systems. The third my, objectives for Unit 3, Methods of Teaching,
unit, The Teacher and Teaching, is designed to will be used. According to the standard curricu-
acquaint students with the art and science of teach- lum, Unit 3 contains a single goal and a single
ing, as well as focus the attention of students on terminal objective. The goal states that "students
the teacher as both a person and a professional. will become familiar with the various methods to
After having studied themselves and others as learn- deliver lessons creatively and effectively." The ter-
ers in Section I, and examining the history, orga- minal objective, which in the context of the re-
nization, and personnel of the school in Section II, vised Taxonomy is actually an activity (see Raths,
students engage in the observation, analysis, and, this issue), states that "students will produce a log
ultimately, the practice of classroom teaching while documenting the various teaching methods they
working through Section III. observe used in their different classes throughout
The primary purpose of this article is to illus- a period of one week." Immediately, we have the
trate how TCP teachers can use the revised Taxono- opportunity to discuss the key differences between
my to plan the units included in Section III, and also objectives and activities. Note that this discussion
how the revised Taxonomy enables the Cadets to can be approached from either the teacher's or stu-
acquire a conceptual framework they can use to dent's point of view.
better understand teachers and teaching. Further- From the teacher's perspective, the fundamen-
more, because the major objective of Section III is tal question is "What are students expected to learn
for students to examine the art and science of teach- by producing a log documenting the various teach-
ing as a profession-from both sides of the desk-
ing methods they observed during the week?" From
the language of the revised Taxonomy can facilitate
the student's perspective, the fundamental ques-
communication between teachers and students.
tion is "What did you learn by producing a log
Section III contains the following five units,
documenting the various teaching methods you
each of which is defined by explicit objectives and
observed during the week?" In addition to focus-
sets of connected activities:
ing on the distinction between objectives and ac-
Unit I - The Teacher tivities, this discussion also leads to a realization
Unit 2 - The Process of Teaching on both parts that expectations do not always be-
Unit 3 - Methods of Teaching come realities.

245
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

The curriculum guide for the course includes we may be dealing with the Conceptual Knowl-
suggested activities, rationales for the various activi- edge cells of the Taxonomy Table. The activity
ties, student and/or instructor handouts, and assess- could also serve to illustrate the importance of us-
ment options. Because the Teacher Cadet course is ing written rather than oral communication in the
what has traditionally been called a "survey" classroom to provide equal opportunity for all stu-
course, the instructor has the option of choosing dents and minimize the likelihood of one or two
the particular activities and assessments he or she students dominating the discussion. Once again, we
will use. Unit 3 takes place during the third quar- are likely dealing with Conceptual Knowledge.
ter of the course, so the instructor is often able to The "correct" placement of the activity in the
explore most, if not all, of the 11 suggested activ- Taxonomy Table is not the issue here; the issue is
ities within a three-week period. Each activity re- the purpose for which the activity was chosen by
quires approximately one or two days to complete, the teacher (i.e., the activity-objective connection).
depending on the depth of discussion that follows Rather than having an activity for activity's sake,
each activity. Due to space limitations, it is impos- the revised Taxonomy makes it clear that activi-
sible to describe and consider all 11 activities in ties are selected primarily for their effect on stu-
this paper. Two activities, "An Overview of Meth- dent learning.
odology" (which is the introductory activity for In terms of assessment, students are asked to
the unit) and "It's a Matter of Style," will be used generate a list of pros and cons about "Silent Graf-
to illustrate the points to be made. fiti" as a teaching methodology, and list examples
of ways this technique might be used in other class-
An Overview of Methodology es. In terms of the Taxonomy Table, the focus of
The teacher begins by writing on the board: this assessment is on analyzing metacognitive
"Teaching methods: What works?" Students are knowledge (i.e., what each individual student be-
asked to think about and then "discuss" this ques- lieves the pros and cons to be in some larger con-
tion with one another. However, students are told text), and applying procedural knowledge
they must remain silent during the "discussion." (particularly item Cc within the Knowledge Dimen-
They may go to the board to write their responses, sion, "knowledge of criteria for determining when
but they cannot communicate orally with anyone. to use appropriate procedures").
If they wish to respond to another student's com-
ments, they can do so physically (for example, by It's a Matter of Style
shaking their heads) or by returning to the board The teacher opens the lesson by announcing
to write their reaction. to students that some changes are going to be made
Once all students have had the opportunity in the classroom to enhance their learning. The
to express their views, the teacher calls on several teacher explains that two possible changes are be-
students to read aloud the comment from the board ing considered and that he or she would like the
that they find most meaningful to them and ex- students' input before making the decision. Using
plain why they chose that comment. This typically an overhead, the teacher presents the two possible
leads to a "real" discussion of teaching methods. scenarios.
The teacher concludes the discussion by explain- In Classroom 1, soft music will be playing
ing that, during this unit, they will be studying continuously while students are working. Harsh flu-
several frequently used teaching methods. orescent lighting will be replaced with softer, low-
In terms of the revised Taxonomy, this activ- er lighting. The room will be kept at a comfortable,
ity can serve several functions. As an overview, it cool temperature throughout the school year. The
can serve a motivational function. If this is the room will be carpeted. Desks will be replaced with
case, we are dealing with the Metacognitive Knowl- enough sofas and comfortable easy chairs and rock-
edge cells of the Taxonomy Table. Or it can serve ing chairs around the room to accommodate every-
to illustrate the importance of verbalization in com- one. Laptop desk pads can be used for students to
munication, an important principle. In that case, work on. Time will be allowed throughout the day

246
Byrd
The Revised Taxonomy and Prospective Teachers

for students to work on several projects at a time, dress the learning needs of all students, whether
alone or in groups. Students will be permitted to they be analytical or global. The descriptions of
take breaks as the need arises. Chewing gum, so- the ideal classroom and mini lesson plan are eval-
das, and snacks will also be permitted while stu- uated by their classmates and the teacher based on
dents are studying. a predetermined set of criteria that relate to previ-
In contrast, Classroom 2 will be a quiet zone otis studies of effective classroom cultures and les-
in which noise will be kept to a minimum in order sons. Students are assessed on their ability to create
to allow students to study. Full use will be made arn ideal classroom and lesson plans as defined by
of natural light, bright outdoor style lighting with the criteria established.
skylights and recessed lighting over study areas. In terms of the Taxonomy Table, the initial
Passive radiant heat will keep the room comfort- reaction is that we are dealing with Create as the
ably warm. New desks and individual study cubi- primary cognitive process. However, it is not the
cles will be placed in the room. Desks will be process but the result or outcome of that process
arranged in the central portion of the room with a that is being assessed and evaluated. Consequently,
study cubicle placed around the perimeter of the the assessment emphasis is on Understanding Con-
room. A schedule will be set up to allow students ceptual Knowledge, where the relevant conceptual
uninterrupted study time for each subject. A break knowledge is defined by the evaluation criteria.
will be scheduled after study time. Snacks will be
permitted during break time. Conclusion
Students are then asked to select the class- The use of the revised Taxonomy, particularly
room option they consider to be the best and to the Taxonomy Table, can assist both teachers and
give reasons for their choices. Next, the teacher sttLdents in Teacher Cadet Programs. Perhaps its
poses the question of what types of learners may greatest value is in its ability to give teachers and
do better in the two classrooms. The teacher guides stLudents something to reflect on. For years we have
the discussion to ensure that issues pertaining to heard about the value of reflection as part of effec-
the analytical (left-brained) learners (Classroom 2 tive teaching. Quite clearly, reflection is a process.
scenario) and the global (right-brained) learners The issue becomes, "About what should teachers
(Classroom 1 scenario) are considered. To facili- retlect?" The revised Taxonomy provides one an-
tate this discussion, the teacher distributes copies swer to this question. Teachers should reflect on
of the characteristics of global and analytic learn- the fundamental questions that have plagued them
ers. Following the discussion, the teacher reminds for some time (see Anderson, Krathwohl, et al.,
students that they will encounter both types of stu- 2001, chap. 14). Within this larger context, teach-
dents in an ordinary classroom, and asks them to ers who engage in reflection (given sufficient time
describe in writing how they can design a class- an(d opportunity to do so) will gain a deeper un-
room that accommodates the needs and preferences derstanding of what is truly known about class-
of both types of students. rocom practice and, ultimately, what they can do to
Like the Overview of Methodology activity, improve classroom practice.
this activity reinforces the need to connect activi- The rather unique setting in which Teacher
ties to objectives. When this is done, we see that Calet instructors work includes their being able to
the emphasis is on understanding conceptual knowl- reflect on their classroom practice while working
edge (e.g., types of classrooms, types of students) with potential preservice students who are also en-
first, but later shifts to creating [based on] factual, gaged in thinking about classroom practice. When
conceptual, and, perhaps, procedural knowledge. one considers that the activities included in the
In terms of assessment, students work in TCP curriculum are much too numerous to be cov-
small, mixed groups of global and analytical learn- ered in their entirety, the revised Taxonomy pro-
ers to create an ideal classroom and mini lesson vides a framework for determining what should
plan for operating within that classroom. Both the and, perhaps, must be addressed if the desired cog-
classroom organization and lesson plan must ad- nitive processes and types of knowledge are to be

247
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

acquired or constructed. Because the course is standards, instructional activities, and assessments
taught in approximately 150 of the 200 high schools of the course in terms of the revised Taxonomy
in South Carolina by teachers with varying degrees provides yet another lens through which to exam-
of knowledge and expertise, this reflection and self- ine the effectiveness of the course content in its
awareness (within the context of the revised Tax- ultimate goal to attract high schools students to
onomy) has great potential to produce a desired enter the teaching profession.
consistency across sites.
In addition, the Taxonomy Table provides a References
framework within which TCP teachers can model Anderson, L.W. (Ed.), Krathwohl, D.R. (Ed.), Airasian,
not only the way they teach but also the way they P.W., Cruikshank, K.A., Mayer, R.E., Pintrich, P.R.,
examine and analyze their teaching. In this regard, Raths, J., & Wittrock, M.C. (2001). A taxonomy
for learning, teaching, and assessing: A revision
Cadets should learn that they can only judge the qf Bloom's Taxonomy of Educational Objectives
effectiveness of their teaching in terms of what (Complete edition). New York: Longman.
students actually learn. Simply stated, the revised South Carolina Center for Teacher Recruitment.
Taxonomy moves prospective teachers away from (1998a). Experiencing education: Teacher cadets.
a "best practice" approach to teaching. Rock Hill, SC: Author.
Ultimately, applying the revised Taxonomy South Carolina Center for Teacher Recruitment.
to the objectives of the TCP curriculum will be (1998b). Strengthening the profession that shapes
South Carolina'sfuture-Teaching. Rock Hill, SC:
useful in revising the curriculum to more specifi- Author.
cally address the overall purpose of the course and South Carolina Center for Teacher Recruitment. (2001).
the present and future needs of those who enroll in SCCTR Annual Report 2000-2001. Rock Hill, SC:
it. For curricular alignment, examining the core Author.

up

248
Peter WAirasian
Helena Miranda

The Role of Assessment in the


Revised Taxonomy

A S MENTIONED PREVIOUSLY, one of the major plications. Finally, the Taxonomy Table reinforces
A differences between the original Taxonomy the perspective of the authors of the original Tax-
and the revised Taxonomy is that the original Tax- oromy that different types of objectives require
onomy consisted of a single dimension; the revised diFferent types of assessment, whereas similar types
Taxonomy reflects a dual perspective on learning of objectives (regardless of subject matter) require
and cognition. Having two dimensions to guide the similar approaches to assessment.
processes of stating objectives and planning and The Cognitive Process dimension calls our
guiding instruction leads to sharper, more clearly attention to the need to find ways of validly and
defined assessments and a stronger connection of re]iably assessing so-called "higher-order" process-
assessment to both objectives and instruction. The es One of the purposes of the original Taxonomy
power of assessments, regardless of whether they was to illustrate how multiple-choice test items
take the form of a classroom quiz, a standardized could be used to test various taxonomic levels. Are
test, or a statewide assessment battery, resides in these tests still useful in this regard, or are new
their close connection to objectives and instruc- assessment techniques needed? The Knowledge
tion. The Taxonomy Table is a useful tool for care- dimension emphasizes the need to find ways of
fully examining and ultimately improving this validly and reliably assessing metacognitive knowl-
connection. edge. Knowledge of cognitive strategies, cognitive
tasks, and self not only requires different ways of
Assessment Implications of thinking about assessment, but, in the latter case,
the Revised Taxonomy reintroduces the need to engage in affective as-
Regarding assessment, the two-dimensional sessment. The need to assess higher-order cogni-
Taxonomy Table emphasizes the need for assess- tive processes and metacognitive knowledge poses
ment practices to extend beyond discrete bits of challenges for all who are engaged in the assess-
knowledge and individual cognitive processes to ment field.
focus on more complex aspects of learning and It is generally understood, but it bears repeat-
thinking. It also provides a way to better under- ing, that the information obtained during the assess-
stand a broad array of assessment models and ap- ment process is influenced to a great extent by what
has preceded it during the instructional process,
Peter W. Airasian is a professor of education and Helena paiticularly as both processes (instruction and as-
Miranda is a graduate assistant, both at Boston College. sessment) are aligned with the stated objective. If

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright 2002 College of Education, The Ohio State University
THEORY INTO PRACTICE/Autumn 2002
Revising Bloom's Taxonomy

the three components are well aligned, the assess- ticular types of objectives. Consider, for example,
ment results are likely to be reasonably valid. Con- the following three objectives:
versely, if the three components are not well
* Students can remember addition facts totaling 40.
aligned, the assessment results will be of question- * Students can recall definitions of social studies
able validity.
terms.
Consider an educational objective frequently
* Students can recall important dates in the Civil
given by English teachers: "Students will learn to
War.
state the main idea of a short story." In this objec-
tive, the critical verb is "state" and the noun phrase Each of these objectives focuses on a differ-
is "main idea of a short story." But there are mul- ent subject area: mathematics, social studies, and
tiple ways students can learn to state a main idea. history. Yet, because all three objectives are ex-
For example, students can state the main idea by amples of remembering factual knowledge, the ap-
remembering what the teacher has told them about propriate test items or assessment tasks will all be
the story's main idea during instruction (e.g., "This quite similar. For example:
is the main idea of short story A."). Students can
also state the main idea based on inferences they * List all pairs of whole numbers that sum to 40.
make from key information provided in the short * List the social studies terms that match the fol-
story. In this case, students learn by understanding lowing definitions.
(since inferring lies within Understand in the Tax- * List the dates on which the following events in
onomy Table). Alternatively, students can state a the Civil War took place.
story's main idea by following a set of steps the Thus, objectives as varied as remembering the al-
teacher has taught them to help find main ideas, or phabet, remembering the names for parts of a cell,
applying procedural knowledge. Finally, students remembering the location of cities on a map, re-
can state the main idea by differentiating key points membering key facts about various countries, and
from supporting details. In this case, because dif: other "remember factual knowledge" objectives will
ferentiating lies within Analyze in the Taxonomy
typically be assessed by asking students to "state,"
Table, students would learn by analyzing. In a class- "list," "label," or "name" the relevant factual
room or statewide assessment, then, test items or as-
knowledge.
sessment tasks for the objective "Students will learn
There are similar generalized assessment for-
to state the main idea of a short story" could focus
mats and approaches for understanding conceptual
on remembering factual knowledge, understanding,
knowledge and applying procedural knowledge. We
applying procedural knowledge, or analyzing.
know from the revised Taxonomy that conceptual
To avoid this confusion, we have suggested that
knowledge includes categories, principles, and
the 19 cognitive processes identified in the revised
models. One way to determine if students under-
Taxonomy (or, alternatively, the six process catego-
stand a particular category, for example, is to have
ries) should be used as the verbs when stating ob-
them determine whether a particular instance or
jectives. Ambiguous verbs such as "state," "list,"
"demonstrate," and so on, should be used with great example falls within the category. In the revised
care because many of these terms are more appli- Taxonomy, this cognitive process would be termed
classifying, which lies within Understand. It is
cable to assessment than to learning. For example,
students can demonstrate that they have remem- important to note that this approach to assessment
bered what they should have remembered. At the is applicable regardless of the specific category
other end of the spectrum, they can demonstrate included in the objective (e.g., rational numbers,
the results of an extremely creative process. In be- sonnets, arachnids, civil law, or impressionist paint-
tween, they can demonstrate their ability to under- ings). One possible assessment format for all of
stand, apply, analyze, and evaluate. these would be: "Here is an example. Is this an
Another benefit of the revised Taxonomy is example of X?" where X could be replaced by a
to focus on methods of assessment linked with par- rational number, sonnet, and so on.

250
Airasian and Miranda
Role of Assessment in the Revised Taxonomy

Using the Taxonomy Table The final piece of the vignette concerns the
to Examine Assessment assessments. The placement of the assessments used
In order to critically examine and refine the by the teacher in terms of the Taxonomy Table is
revised Taxonomy, we asked six teachers, working shown in Figure 3. The placement of both the ob-
at a variety of grade levels, to describe actual in- jectives and instructional activities in the Taxono-
structional units they had taught in their main subject fry Table as shown in Figure 1 and Figure 2 are
area. A great deal of information about the teachers' reproduced in Figure 3.
units and the usefulness of the revised Taxonomy, As the key at the bottom of Figure 3 indicates,
particularly the Taxonomy Table, derived from our the teacher used three assessments: classroom ques-
examination of these written vignettes. In particu- tions and informal observations (Assessment A), a
lar, the use of the Taxonomy Table on the teach- quiz (Assessment B), and a performance assess-
ers' vignettes provides useful information about ment (namely, the writing of a persuasive editori-
the validity of classroom and statewide assessments al) (Assessment C). As shown in the figure, the
as evidenced by the alignment of the assessments quiz was intended to assess student mastery of the
with both objectives and instructional activities. first objective ("Remember specific parts of the
We illustrate this feature of the Taxonomy Parliamentary Acts"). Classroom questions and in-
Table by analyzing the Parliamentary Acts vignette formal observations were intended to assess stu-
in terms of the stated objectives, the instructional dent mastery of the second objective ("Explain the
activities, and the assessments. Figure I summa- consequences of the Parliamentary Acts for differ-
rizes the placement of the teacher's four stated erit colonial groups"). And, the performance as-
objectives in the Taxonomy Table. Note that one sessment was intended to assess student mastery
of the objectives is placed in two cells of the Tax- of the third objective ("Choose a colonial charac-
onomy Table. This objective states that students te r or group and write a persuasive editorial stat-
should be able to choose a colonial character or ing his/her/its position").
group and write a persuasive editorial stating his/ The completed Taxonomy Table shown in
her/its position. Writing such an editorial is a cre- Figure 3 indicates strong alignment of assessment,
ative process that requires two types of knowledge: objectives, and instruction in the unit, particularly
factual knowledge (e.g., specific details about var- evidenced in cells Al, A6, B2, and B6. It is note-
ious colonial characters) and conceptual knowledge worthy that the performance assessment is in mul-
(e.g., criteria that define good persuasive writing). tiple cells because 10 criteria are involved in
Brief statements of all four objectives are included evaluating the editorial. One or more of the crite-
at the bottom of Figure 1. ria are placed in A6, one or more in B6, and one
Subsequent to identifying the intended ob- or more in C3.
jectives, the teacher turned her attention to instruc- In light of this high degree of alignment, two
tion. The planned instructional activities required of the other cells, C3 and B5, are worthy of com-
10 days to complete. Since instructional activities ment. In Cell C3, we have some activities and one
are not the primary focus of this article, they are or more criteria related to the persuasive essay,
simply listed in terms of the sequence and number but we do not have an explicitly stated objective.
of days for sets of activities. These are shown in In B5, on the other hand, we have an explicitly
Figure 2. To examine the connection between the stated objective and several days of activities, but
activities and objectives, the objectives shown in we do not have any direct assessment. Finally, we
Figure 1 are repeated in Figure 2. co jld envision a cell in which we have an explicit-
In most cases, the instructional activities are ly stated objective and a direct assessment, but no
closely aligned with the objectives. Specifically, instructional activities. These three cells indicate
there are instructional activities related to each of three types of misalignment involving assessment.
the four objectives (cells Al, A6, B2, B5, and B6). Cell C3 illustrates what has been termed "instruc-
There are two cells of the table (B4 and C3) that tional sensitivity" (i.e., the assessment is "sensi-
have instructional activities but no stated objectives. tivz" to instruction) (Haladyna & Roid, 1981). Cell

251
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

The Cognitive Process Dimension

The Knowledge 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create


Dimension
A. Factual Objective 1 Objective 3
Knowledge
B. Conceptual Objective 2 Objective 4 Objective 3
Knowledge
C. Procedural
Knowledge
D. Metacognitive
Knowledge
Key
Objective 1: Remember the specific parts of the Parliamentary Acts.
Objective 2: Explain the consequences of the Parliamentary Acts for different colonial groups.
Objective 3: Choose a colonial character or group and write a persuasive editorial stating his/her/its position on
the Acts.
Objective 4: Self- and peer edit the editorial.
Figure 1. An analysis of the Parliamentary Acts vignette based on stated objectives.

The Cognitive Process Dimension

The Knowledge 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create


Dimension
A. Factual Objective 1 Objective 3
Knowledge Days 2, 3, & 5 Days 8-10
Activities Activities
B. Conceptual Objective 2 Days 6-7 Objective 4 Objective 3
Knowledge Days 1, 4-7 Activities Days 8-10 Days 8-10
Activities Activities Activities
C. Procedural Day 4
Knowledge Activities
D. Metacognitive
Knowledge
Key
Objective 1: Remember the specific parts of the Parliamentary Acts.
Objective 2: Explain the consequences of the Parliamentary Acts for different colonial groups.
Objective 3: Choose a colonial character or group and write a persuasive editorial stating his/her/its position on
the Acts.
Objective 4: Self- and peer edit the editorial.
Figure 2. An analysis of the Parliamentary Acts vignette based on stated objectives and instructional
activites.

252
Airasian and Miranda
Role of Assessment in the Revised Taxonomy

The Cognitive P'rocess Dimension


The Knowledge 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create
Dimension
A. Factual Objective 1 Objective 3
Knowledge Days 2, 3, & 5 Days 8-10
Activities Activities
Assessment B Assessment C
B. Conceptual Objective 2 Days 6-7 Objective 4 Objective 3
Knowledge Days 1, 4-7 Activities Days 8-10 Days 8-10
Activities Activities Activities
Assessment A Assessment C
C. Procedural Day 4
Knowledge Activities
Assess-
_______________ ~~~ment C
D. Metacognitive
Knowledge
Key
Objective 1: Remember the specific parts of the Parliamentary Acts.
Objective 2: Explain the consequences of the Parliamentary Acts for different colonial groups.
Objective 3: Choose a colonial character or group and write a persuasive editorial stating his/her/its position on
the Acts.
Objective 4: Self- and peer edit the editorial.
Assessment A: Classroom Questions and Informal Observations
Assessment B: Quiz
Assessment C: Performance Assessment (editorial, with 10 evaluation criteria)

Figure 3. An analysis of the Parliamentary Acts vignette based on stated objectives, instructional
activites, and assessments.

B5 illustrates what might be termed "assessment- In addition to its use in classroom instruction
free" curriculum and instruction. The "envisioned anti assessment, the Taxonomy Table can also be
cell" illustrates the traditional concept of "content used to analyze the results of statewide assessments
validity," where concerns for students' opportuni- in terms of their possible and likely impact on cur-
ties to learn the content are minimal. riculum and instruction. Increasingly, teachers and
their students are confronted with statewide stan-
Conclusion daids and corresponding statewide assessments.
Severe misalignment of assessment, objec- These high-stakes assessments have become con-
tives, and instruction can cause numerous difficul- sequential for both students and teachers. Using
ties. If, for example, instruction is not aligned with the Taxonomy Table to increase the alignment of
assessment, even the highest quality instruction will school-wide or district-wide curriculum and instruc-
likely not lead to high student performance on the tion with state standards and state-mandated as-
assessments. As mentioned previously, by focus- sessments will enable teachers to focus on the
ing on the Taxonomy Table we can increase the standards without "teaching to the test."
alignment of assessment with both objectives and Because the Taxonomy Table focuses on stu-
instruction. dent learning rather than student performance, it

253
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

emphasizes the need to focus on the cognitive process- struction that are needed to improve the effective-
es and types of knowledge required to achieve the ness of the entire educational system.
standards, rather than the specific or general types
of items included on the statewide assessments. Reference
Once determined, this knowledge of relevant cog- Haladyna, T. & Roid, G. (1981). The role of instructional
nitive processes and types of knowledge (a kind of sensitivity in the empirical review of criterion-refer-
educator metacognitive knowledge) can be used to enced test items. Journal of EducationalMeasure-
make necessary adjustments in curriculum and in- ment, 18, 39-53.

iI

254
Lorin W Anderson

Curricular Alignment: A Re-Examination

THERE IS A STORY that needs to be told. . . It is


.

a story about children and also about curricu-


Content Coverage, Opportunity to
Learn, and Curriculum Alignment
la-curricula transforming national visions and aims
into intentions that shape children's opportunities for Figure 1 contains three primary components
learning through schooling. (Schmidt & McKnight, of curriculum: objectives (also known in today's
1995, p. 346) vocabulary as content standards or curriculum stan-
We must "[change] the question from 'What stu- dards), instructional activities and supporting ma-
dents know and can do' to 'What students know and terials, and assessments (including standardized
can do as a result of their educational experiences."' tests). The sides of the triangle represent relation-
(Burstein & Winters, 1994)
ships between pairs of components: objectives with
During the past half-century there has been a assessments (side A), objectives with instructional
growing body of evidence supporting a fundamen- activities and materials (side B), and assessments
tal educational truism: that what and how much with instructional activities and materials (side C).
students are taught is associated with, and likely Traditionally, the issue of the relationship be-
influences, what and how much they learn. In fact, tween objectives and assessments (side A) has fallen
the results of several fairly recent studies suggest under the "tests and measurement" umbrella of con-
that, in terms of measured student achievement, tent validity. That is, to what extent does the test
what students are taught is more important than measure the important curricular objectives? This re-
how they are taught (Alton-Lee & Nuthall, 1992;
mains an important question, as evidenced by recent
Breitsprecher, 1991; Gamoran, Porter, Smithson, stucies conducted by Buckendahl, Plake, Impara, and
& White, 1997). Over time, different terminology
Irwin (2000), Kendall (1999), and Webb (1999).
has been used to denote the "what" of teaching.
Both content coverage and opportunity to
The three terms that have generated the most re-
learn, as defined by Burstein (1993), have to do
search interest are "content coverage," "opportunity
with the relationship of instructional activities and
to learn," and "curriculum alignment." Important-
materials with assessments (side C). The primary
ly, these are not just different labels for the same
difference between the two concepts is where the
basic idea; there are important conceptual distinc-
tions underlying them. These distinctions can be
analysis begins. Studies of content coverage typi-
understood by examining Figure 1. callv begin with an examination of the instructional
activ/ities and materials (particularly the materials).
Lorin W. Anderson is a professor of education at the The question is, "Is what we are teaching being test-
University of South Carolina. ed?' Examples of early studies of content coverage

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright 2002 College of Education, The Ohio State University
THEORY INTO PRACTICE / Autumn 2002
Revising Bloom's Taxonomy

Standards/Objectives (S/0)

C
Assessments/Tests (A/T) Instructional Activities
and Materials (IAM)
Figure 1. Relationships Among Standards/Objectives, Instructional Activities and Materials, and Assess-
ments/Tests.

include Good, Grouws, and Beckerman's (1978) study ment test. In a related study, Leinhardt, Zigmond,
of the relationship of the number of textbook pages and Cooley (1981) asked teachers to indicate
covered with mathematics achievement test scores, whether each student or sample of students had
and Anderson, Evertson, and Brophy's (1979) study been taught the information required to answer spe-
of the number of basal readers completed by first- cific test items. Similarly, Winfield (1993) asked
grade reading groups in relation to reading achieve- teachers to rate each of 34 test items on a five-
ment test scores. More recent studies of content point scale in terms of "(a) the number of times a
coverage have been reported by Elia (1994), Gamo- mathematics concept was taught, (b) the frequency
ran, Porter, Smithson, and White (1997), Kim of review or reteaching the concept, (c) the num-
(1993), Muthen et al. (1995), and Schmidt and ber of settings in which the particular test format
McKnight (1995). was used to teach the concept, (d) the frequency of
In contrast to content coverage, studies of usage of the format, (e) the extent to which the
the opportunity to learn typically begin with an concept was emphasized in the school reading pro-
examination of the assessment tasks or test items. gram, and (f) the teachers' perceptions of students'
The question is, "Are we teaching what is being test- mastery of the concept" (p. 292).
ed?" Cooley and Leinhardt (1980), for example, asked If content validity studies focus on side A of
teachers to estimate the percentage of their students the triangle depicted in Figure 1, and content cov-
who had been taught the minimum material neces- erage and opportunity to learn studies focus on
sary to pass each item on a standardized achieve- side C of the triangle, then two questions remain.

256
Anderson
CurricularAlignment

First, what about side B of the triangle? Second, analytical frameworks exist for making sense of
where does curriculum alignment fit into all of this? the data collected from curricular alignment stud-
With respect to the first question, there have been ies. Without an appropriate framework, the inter-
several studies of the relationship of objectives to pretation of the data remains rather problematic.
instructional activities and materials. However, no Consider, for example, questions often asked of
general term has been used to group these studies. teachers in curricular alignment studies:
Ippolito (1990), for example, examined the rela-
tionship between instructional materials and "cri- * What percent of students have been taught the
terion objectives" (p. 1). Similarly, NC HELPS minimum material needed to pass this item?
(1999) focused on the way the curriculum was (Cooley and Leinhardt, 1980)
taught to ensure that it was consistent with the * To what extent is this item/objective empha-
content of the curriculum as specified in the North sized in the school mathematics curriculum for
Carolina "Standard Course of Study." Finally, Pick- fourth grade? (Winfield, 1993)
reign and Capps (2000) compared the "geometry * Have you taught the mathematics material need-
language" used in K-6 textbooks with the language ed to answer the item correctly? If you have not
found in mathematics standards documents. taught it, was it because (a) the topic had been
With respect to the second question, curricu- taught the prior year, (b) the topic will be taught
lum alignment is represented by the entire triangle later, (c) the topic is not in the school curricu-
in Figure 1. That is, curriculum alignment requires lum at all, or (d) the topic was not taught for
a strong link between objectives and assessments, other reasons? (McDonnell, 1995)
between objectives and instructional activities and Terms and phrases such as "minimum material,"
materials, and between assessments and instruc- "mathematics material," "topic," and "item/objec-
tional activities and materials. In other words, con- tive" are certainly open to multiple interpretations.
tent validity, content coverage, and opportunity to A few attempts have been made to design
learn are all included within the more general con- appropriate analytic frameworks (see, for exam-
cept of "curriculum alignment." ple, Webb, 1999). Gamoran and his colleagues
Over the years, researchers have come to real- (1997) developed one of the most comprehensive
ize the importance of designing studies of sufficient frameworks in this regard. Their framework con-
complexity to examine the complete set of interrela- sists of 10 general areas of mathematics, with each
tionships included in Figure 1. However, only a few area divided into 7-10 specific topics, and six lev-
such studies currently exist. One noteworthy ex- els of "cognitive demand." Overall, this framework
ample, a study conducted by Breitsprecher (1991), "yielded 558 specific types of content that might
examined the relative effects of two instructional have been taught and/or tested" (p. 329). Although
activity variables (verbal mediation and feedback this framework clearly moves us in the right direc-
monitoring) and two levels of content validity (high tioII, it suffers from at least three major problems.
and low) on student achievement. The results of First, with 558 cells, it is too cumbersome to be
the study suggest that all three variables-verbal useful to most teachers. Second, it is likely to re-
mediation, feedback monitoring, and content va- sulb in an underestimate of curriculum alignment.
lidity-were significantly related to student For example, Gamoran and his colleagues found
achievement. However, content validity exerted a thai: only 19 of the 558 cells were included on the
slightly greater influence than either of the instruc- primary test they examined. This initial finding led
tional activity variables. them to a more detailed examination of the cells
thai were included on the test. Third, the frame-
A Framework for Analyzing work is limited to mathematics. Thus, similar al-
Curriculum Alignment ternative frameworks would be needed for all other
Although there are several methods used to subject matters.
collect data on curriculum alignment (Harskamp The Taxonomy Table is a useful framework
& Surhre, 1994; Winfield, 1993), relatively few for estimating curriculum alignment in all subject

257
THEORY INTO PRACTICE/ Autumn 2002
Revising Bloom's Taxonomy

matters at virtually every grade or school level. It priately. Fourth, the three completed Taxonomy
addresses each of the three problems associated Tables, one each derived from the analysis of the
with the Gamoran et al. framework. First, it con- objectives, instructional activities and materials,
tains 24 cells (not 558). Furthermore, as illustrated and assessments, are compared. Complete align-
by the vignettes included in the revised Taxonomy ment is evidenced when there are common cells
volume and the Ferguson and Byrd articles (this included on all three completed Taxonomy Tables.
issue), teachers can use the framework to examine That is, the objective, instructional activities and
and enhance curriculum alignment. Second, because materials, and assessments all fall into the same
alignment is estimated in terms of the relation- cell (e.g., understand conceptual knowledge). Par-
ships of objectives, instructional activities and tial alignment also exists. For example, the objec-
materials, and assessments with the Taxonomy tive, instructional activities and materials, and
Table, rather than with each other, the alignment assessments may all fall into the same row (i.e.,
process (a) focuses quite directly on student learn- type of knowledge), but differ in terms of the col-
ing and (b) yields reasonably valid estimates of umn in which they are classified (i.e., cognitive
alignment. Third, as mentioned earlier, the Taxon- process category). Similarly, the objective, instruc-
omy Table is generic. By replacing topics with tional activities and materials, and assessments may
types of knowledge, the Taxonomy Table can be all fall into the same column, but differ in terms of
used with all subject matters. the row in which they are classified. Partial align-
ment provides potentially useful diagnostic infor-
Using the Taxonomy Table to mation to teachers who want to improve their
Estimate Curriculum Alignment curricular alignment. Moving an instructional ac-
The vignettes included in the revised Taxono- tivity from an emphasis on factual knowledge to
my volume and the articles written by Ferguson and an emphasis on procedural knowledge, or from
Byrd (this issue) illustrate quite nicely the process understand to analyze may be worth the effort if
used to estimate curriculum alignment with the aid alignment is substantially improved.
of the Taxonomy Table. Before the process is de- Before concluding, two final points must be
scribed, it must be emphasized that alignment esti- made. First, there is increasing evidence that estimat-
mates using the Taxonomy Table are based on ing curriculum alignment based on both knowledge
curriculum units or entire courses, not individual les- and cognitive processes is superior to other methods
sons. Thus, the analysis involved a group of objectives, of estimating alignment. This research is summarized
a variety of instructional activities, and, generally, concisely by Gamoran and his colleagues (1997).
more than one assessment (both formal and infor- "Clearly, to predict student achievement gains from
mal). Having said this, the alignment process involves knowledge of the content of instruction, a micro-
four steps. level description of content that looks at cognitive
First, each objective is placed in its appro- demands by [type of knowledge] is the most use-
priate cell or cells of the Taxonomy Table. The ful approach considered to date" (p. 331).
verbs and nouns included in the statement of the Second, alignment, using the Taxonomy Ta-
objective are used to place the objective in the ble, is based on considering what teachers intend
proper cell. Second, each instructional activity (and in terms of student learning. This is particularly
accompanying support materials) is similarly placed important to keep in mind when analyzing instruc-
in its appropriate cell, based once again on clues tional activities. When examining instructional ac-
provided by verbs and nouns included in the de- tivities, one must ask, "What is the student
scription of the activity. Third, using clues from supposed to learn from his or her participation in
included verbs and nouns, each assessment task this activity? What knowledge is to be acquired or
(whether it be a performance assessment or one of constructed? What cognitive processes are to be
a series of test items) is placed in its appropriate employed?" Without answers to these questions, it
cell. In the case of traditional tests, each item is is impossible to properly classify instructional ac-
considered an assessment task and placed appro- tivities in terms of the Taxonomy Table.

258
Anderson
CurricularAlignment

The Value of Curriculum Alignment research, students learn more in the college-prepa-
Even if the reader is convinced that the Tax- ratory classes" (p. 333). Consequently, "low-
onomy Table is a useful tool for estimating and achieving high school students are capable of
increasing curriculum alignment, one question re- learning much more than is typically demanded of
mains: Why should teachers be concerned about them. The key is to provide a serious, meaningful
curriculum alignment? At least four answers to this curriculum: 'hard content for all students"' (p. 336).
question can be given. A third reason for the importance of curricu-
The first is foreshadowed by the quotations with lum alignment is that poorly aligned curriculum
which this article began. Leigh Burstein was correct. results in our underestimating the effect of instruc-
We need to be more concerned with what students tion on learning. Simply stated, teachers may be
have learned as a result of their schooling experience "teaching up a storm," but if what they are teach-
than with what they know and can do regardless of ing is neither aligned with the state standards or
the source of that knowledge or those skills. Bill the state assessments, then their teaching is in vain.
Schmidt and Curtis McKnight also were right. Pro- Tlhis is the educational equivalent of a tree falling
viding or denying opportunities to learn results in a in the forest with no one around . . . no demon-
very different education for different students. In sum- stiated learning, no recognized teaching.
marizing the results of their research in New Zealand, A fourth, and final, reason for the importance
Adrienne Alton-Lee and Graham Nuthall stated: of curriculum alignment stems from the current
"Our exploratory studies revealed that the curricu- concern for educational accountability. Actually,
lum excluded or marginalized people by race and current is probably not the correct word to use
gender . . . and that these processes led to different here. Over the past quarter century, the responsi-
experiences for different . . . students" (p. 6). Or, bility for accountability has shifted from students
in the words of Linda Winfield, opportunity to learn (and their home backgrounds) to schools. Regard-
"emphasizes the importance of instruction and less of the focus, however, curriculum alignment
school factors in student achievement, and it avoids is central to the success of accountability programs.
the 'blame the victim' mentality which focuses More than 20 years ago, the NAACP filed a law-
solely on students" (p. 307). In this regard, there is suit against the state of Florida (Debra P. v. Turl-
increasing evidence that the impact of opportunity ington, 1979) arguing that it was unconstitutional
to learn on student achievement is considerably to deny high school diplomas to students who had
greater for minority students than for their "advan- nor: been given the opportunity to learn the materi-
taged" counterparts (Elia, 1994). al covered on a test that was a requirement for
A second reason for the importance of cur- graduation. The court placed a four-year moratori-
riculum alignment is that proper curriculum align- um on administration of the test for diploma deni-
ment enables us to understand the differences in al, arguing that this additional period of time was
the effects of schooling on student achievement. necessary to allow students to have an opportunity
This is clearly evidenced by the research reported to learn the necessary knowledge and skills. Al-
by Gamoran and his colleagues. The study focused though the emphasis has shifted from student to
on the success of so-called "transition" mathemat- school, the issue has not changed substantially. As
ics courses in California and New York. These tran- Ba:ratz-Snowden (1993) has asserted: "If students
sition courses were designed to bridge the gap are to be held accountable for their learning, then
between elementary and college-preparatory math- schools must be held accountable as well by dem-
ematics and to provide access to more challenging onstrating that they provide students with opportu-
and meaningful mathematics for students who en- nities to learn to meet the standards that have been
ter high school with poor skills. Based on their set" (p. 317).
study, Gamoran et al. conclude that: "More rigor-
ous content coverage distinguishes college-prepa- References
ratory math classes from general-track math classes, Alton-Lee, A., & Nuthall, G. (1992). Children's learn-
and it also shows that, consistent with previous ing in classrooms: Challenges in developing a

259
THEORY INTO PRACTICE/ Autumn 2002
Revising Bloom's Taxonomy

methodology to explain "opportunity to learn." Harskamp, E., & Suhre, C. (1994). Assessing the op-
Journalof Classroom Interaction, 27(2), 1-2. portunity to learn mathematics. Evaluation Review,
Anderson, L., Evertson, C., & Brophy, J. (1979). An 18, 627-642.
experimental study of effective teaching in first Ippolito, T.J. (1990). An instructional alignment pro-
grade reading groups. Elementary School Journal, gram for eighth grade criterion referenced math
79, 193-223. objectives. Unpublished manuscript. (ERIC Docu-
Baratz-Snowden, J.C. (1993). Opportunity to learn: ment Service No. ED326432)
Implications for professional development. Jour- Kendall, J.S. (1999). A report on the matches between
nal of Negro Education, 62, 311-323. the South Dakota standards in mathematics and
Breitsprecher, C.H. (1991). Relative effects of verbal selected Stanford Achievement Tests. Unpublished
mediation, feedback monitoring, and alignment on manuscript. (ERIC Document Service No.
community college learners' achievement. Unpub- ED447170)
lished doctoral dissertation, University of San Fran- Kim, H. (1993). A comparative study between an Amer-
cisco. (ERIC Document Service No. ED333914) ican and a Republic of Korean textbook series'
Buckendahl, C.W., Plake, B.S., Impara, J.C., & Irwin, coverage of measurement and geometry content in
P.M. (2000, April). Alignment of standardized first through eighth grades. School Science and
achievement tests to state content standards: A Mathematics, 93(3), 123-126.
comparison of publishers' and teachers' perspec- Leinhardt, G., Zigmond, N., & Cooley, W. (1981).
tives. Paper presented at the annual meeting of the Reading instruction and its effects. American Ed-
National Council on Measurement in Education, ucational Research Journal, 18, 343-361.
New Orleans. (ERIC Document Service No. McDonnell, L.M. (1995). Opportunity to learn as a re-
ED442829) search concept and a policy instrument. Educa-
Burstein, L. (1993). Studying learning, growth, and in- tional Evaluation and Policy Analysis, 17, 305-322.
struction cross-nationally: Lessons learned about Muthen, B., Huang, L-C., Jo, B., Khoo, S-T, Goff, G.,
why and why not engage in cross-national studies. Novak, J., & Shih, J. (1995). Opportunity-to-learn
In L. Burstein (Ed.), The IEA study of mathemat- effects on achievement: Analytical aspects. Edu-
ics III: Student growth and classroom processes cational Evaluation and Policy Analysis, 17, 371-
(pp. 27-49). Oxford, England: Pergamon. 403.
Burstein, L., & Winters, L. (1994, June). Workshop on NC HELPS. (1999). Curriculum alignment. Unpub-
models for collecting and using opportunity to lished manuscript. (ERIC Document Service No.
learn at the state level. Unpublished material, Al- ED439526)
buquerque, NM. Pickreign, J., & Capps, L.R. (2000). Alignment of ele-
Cooley, W.W., & Leinhardt, G. (1980). The instruc- mentary geometry curriculum with current stan-
tional dimensions study. Educational Evaluation dards. School Science and Mathematics, 100,
and Policy Analysis, 2, 7-25. 243-245.
Elia, J. (1994). An alignment/transfer experiment with Schmidt, W.H., & McKnight, C.C.(1995). Surveying
low socioeonomic level students. Teacher Educa- educational opportunity in mathematics and sci-
tion Quarterly, 21, 113-124. ence: An international perspective. Educational
Gamoran, A., Porter, A.C., Smithson, J., & White, P.A. Evaluation and Policy Analysis, 17, 337-353.
(1997). Upgrading high school mathematics in- Webb, N.L. (1999). Alignment of science and mathe-
struction: Improving learning opportunities for matics standards and assessments in four states.
low-achieving, low-income youth. Educational Unpublished manuscript. (ERIC Document Service
Evaluation and Policy Analysis, 19, 325-338. No. ED440852)
Good, T., Grouws, D.A., & Beckerman, T. (1978). Winfield, L.F. (1993). Investigating test content and
Curriculum pacing: Some empirical data in math- curriculum content overlap to assess opportunity
ematics. Journal of Curriculum Studies, 10, 75- to learn. Journal of Negro Education, 62, 288-
82. 310.

it

260
Additional Resources for Classroom Use
Krathwohl, A Revision of Bloom's Taxonomy: Presented here is Marzano's taxonomy, which is
An Overview (pp. 212-218) based on a flow of processing model that succes-
1. Hannah, L.S., & Michaelis, J.U. (1977). A sively passes through three hierarchically related
comprehensive framework for instructional ob- systems of thinking, and constitutes the six levels
jectives: A guide to systematic planning and of what would be most comparable to our process
evaluation. Reading, MA: Addison-Wesley. dimension: Self system, Metacognitive system,
and, finally, the four levels of the Cognitive sys-
The authors posit three major categories: Intel-
tem: Retrieval, Comprehension, Analysis, and
lectual Processes, which is their cognitive do-
Knowledge Utilization. The author applies the
main; Skills, their psychomotor domain; and
taxonomy to curriculum assessment design.
Attitudes and Values, their affective domain. All
three are supported by the category of Data Pintrich, The Role of Metacognitive Knowledge in
Gathering, which includes Observing and Re- Learning, Teaching, and Assessing (pp. 219-225)
membering. Their Intellectual Processes category
1. Bransford, J., Brown, A., & Cocking, R. (1999).
includes many of the cognitive processes pre-
fMow people learn: Brain, mind, experience, and
sented in this issue of TIP. The authors claim
these Intellectual Processes are arranged in hi- school. Washington, DC: National Academy Press.
erarchical order; they did not reverse the order rhis book reviews recent cognitive science re-
of evaluation and synthesis as done in the re- .search on learning and teaching in a nontechnical
vised Taxonomy. Included are sample objectives and easily understood style. While there are few
and test items for each category. specific practical suggestions for teaching, the
book as a whole provides a good introduction
2. Hauenstein, A.D. (1988). A conceptualframework of current cognitive science and its applications
for educational objectives: A holistic approachto to learning and teaching.
traditional taxonomies. Lanham, MD: University
Press of America. 2. Zimmerman, B.J., Bonner, S., & Kovach, R.
Like Hannah and Michaelis (above), Hauenstein (1996). Developing self-regulated learners: Be-
sought to bring consistency to all three domains yond achievement to self-efficacy. Washington,
by establishing a base definition and set of cri- I)C: American Psychological Association.
teria for the Taxonomy. He also uses verbs or This short guide for teachers is part of the Psy-
gerunds and many of the original criteria and chology in the Classroom series of the American
categories. As discussed in this issue, the au- P'sychological Association, which focuses on
thor inverts evaluation and synthesis. In addi- applying principles and findings from education-
tion, he adds a new domain, the Behavioral al psychology. It outlines how a self-regulatory
Domain, which "capsulizes and summarizes the lIarning cycle can be implemented to enable
co-requisite objectives of the cognitive, affec- rniddle and secondary school students to develop
tive and psychomotor domains" (p. 115). The five essential academic skills: planning and using
text also describes the process of learning over study time, understanding and summarizing text
time in five categories: acquisition, assimilation, material, note taking, anticipating and prepar-
adaptation, performance, and aspiration. ing for exams, and effective writing.
3. Marzano, R.J. (2001). Designing a new taxonomy 3. Jones, B., Rasmussen, C., & Moffitt, M. (Eds.).
of educational objectives. Thousand Oaks, CA: (1997). Real-life problem solving: A collabora-
Corwin Press. tive approach to interdisciplinary learning.

THEORY INTO PRACTICE, Volume 41, Number 4, Autumn 2002


Copyright 2002 College of Education, The Ohio State University 261
THEORY INTO PRACTICE / Winter 2002
Promoting Thinking Through Peer Learning

Washington, DC: American Psychological As- of objectives. While the book is indeed helpful,
sociation. the complexity of teaching for understanding is
underscored in the narratives included here.
Part of a series on the application of education-
al psychology to the classroom, this book dis- 2. Wiggins, G., & McTighe, J. (1998). Understand-
cusses problem-based learning and how to ing by design. Alexandria, VA: ASCD.
implement it in the classroom. Because the book
A magnificent supplement to the accounts of
and the series are aimed at teachers, there are
Bloom's taxonomy, the narrative spells out how
plenty of pragmatic suggestions for classroom
teachers can plan "backwards," beginning with
instruction.
the assessment and working back toward the
Mayer, Rote Versus Meaningful Learning (pp. design of learning activities. Alignment is the
226-232) key here.
1. Anderson, L.W., Krathwohl, D.R., Airasian, 3. Marzano, R.J., Pickering, D.J., & Pollock, J.E.
P.W., Cruikshank, K.A., Mayer, R.E., Pintrich, (2001). Classroom instruction that works. Alex-
P.R., Raths, J., & Wittrock, M.C. (2001). A tax- andria, VA: ASCD.
onomy for learning, teaching, and assessing: A
A key to improving instruction is for teachers to
revision of Bloom's taxonomy of educational
attempt to reduce the time it takes students to ac-
objectives. New York: Longman.
quire the learning targets. This book describes nine
Chapter 5, The Cognitive Process Dimension, teaching strategies that can do just that. While not
provides an in-depth description of the cogni- all of the strategies are new-some might even be
tive processes involved in meaningful learning. familiar-there is a variety presented here to stim-
ulate and challenge all teachers.
2. Mayer, R.E. (1999). The promise of educational
psychology, Volume I: Learning in the content 4. Carroll, J.B. (1963). A model of school learn-
areas. Upper Saddle River, NJ: Prentice Hall. ing. Teachers College Record, 64, 723-733.
Mayer, R.E. (2001). The promise of educational Teachers should be interested in reading the
psychology, Volume II: Teaching for meaning- original source of the model that has guided so
ful learning. Upper Saddle River, NJ: Prentice many instructional improvement efforts for the
Hall. past 40 years or so. Carroll's model, elegant in
its parsimony, suggests that teachers must find
This two-volume set examines how children
ways to reduce the time students need to learn
learn from different methods of instruction. It
and increase the time students spend on task.
profiles methods such as feedback, guided ex-
The presentation here is clear and compelling.
ploration, cognitive apprenticeship, problem-
based learning, and teaching of problem-solving 5. Marzano, R.J. (2001). A step toward redesign-
strategies that allow learners to take what they ing Bloom's taxonomy. Thousand Oaks, CA:
have learned and apply it to new situations. The Corwin Press.
author presents research on learning and instruc-
Marzano's book is an "attempt to articulate a tax-
tion for meaningful learning and discusses how
onomy of educational objectives that uses the best
to apply this information to teaching.
available research and theory accumulated since
Raths, Improving Instruction (pp. 233-237) the publication of Bloom's taxonomy" (p. viii).
The heart of Marzano's taxonomy is his analysis
1. Wiske, M.S. (Ed.). (1998). Teaching for under- of six levels of thinking: retrieval, comprehension,
standing. San Francisco: Jossey Bass. analysis, knowledge utilization, metacognition,
This volume reports on the findings of Project and self-system thinking. He further divides in-
Zero, a Harvard Graduate School of Education formation into details and organizing ideas, and
effort to explore ways of teaching to higher levels mental procedures into skills and process. In many

262
Additional Resources

respects, Marzano's taxonomy is similar to the or helping beginning teachers learn to teach.
revision described in this issue of TIP. At the same East Lansing, MI: National Center for Research
time, there are notable differences that should be on Teacher Education.
evident to those reading both volumes.
Feinman-Nemser and Parker present the results
Ferguson, Using the Revised Taxonomy to Plan of conversations with experienced and begin-
and Deliver Team-Taught, Integrated, Themat- ning teachers concerning the role of subject
ic Units (pp. 238-243) matter content in learning to teach. Based on
these conversations, the authors identified four
1. Meinbach, A.M., Rothlein, L., & Fredericks,
aspects of learning to teach academic content:
A.D. (2000). The complete guide to thematic
(a) deepening one's own understanding of sub-
units: Creating the integrated curriculum (Rev.
ject matter, (b) learning to think about academ-
ed.). Norwood, MA: Christopher-Gordon.
ic content from the student's perspective, (c)
Aimed at teachers of primary through interme- learning to represent subject matter in appropri-
diate grades, this guide is divided into two parts. ate and engaging ways, and (d) learning to or-
Part I contains information about the value of a ganize students for the purposes of teaching and
thematic approach to teaching, practical strate- learning academic content.
gies for success, options for assessment (includ-
ing the use of portfolios), and suggestions for 2. Feinman-Nemser, S. (2001). From preparation
involving parents and the community. Part II to practice: Designing a continuum to strengthen
contains outlines of 19 sample units for primary and sustain teaching. Teachers College Record,
and secondary classrooms accompanied by sto- 103, 1013-1055.
ries that demonstrate their use in actual class- The author proposes a curriculum for teacher
rooms for each sample unit. Teachers can either learning over time. She examines the "fit" among
use the projects as they are or adapt them to fit conventional teacher education, induction into
their needs. the profession, and continual professional de-
velopment, with an eye on the challenges of
2. Short, K.G., Schroeder, J., Laird, J., Kauffman,
improving one's teaching during one's career.
G., Ferguson, M.J., & Crawford, K.M. (1996).
.Feinman-Nemser examines the central tasks of
Learning together through inquiry: From Co-
teacher preparation, induction, and professional
lumbus to integratedcurriculum. Portland, MA:
development; how well conventional approach-
Stenhouse Publishers.
es to teacher education address these tasks; and
This book tells the story of how six teachers col- promising programs and practices at each stage
laborated with each other and with their students of learning.
to explore and negotiate curriculum as inquiry. As
a result of this process, the teachers found they Airasian and Miranda, The Role of Assessment
had moved from textbook-based curriculum to the- in the Revised Taxonomy (pp. 249-254)
matic units, ones in which students were involved 1. Airasian, P.W. (2000). Classroom assessment:
in a range of activities and a range of topics and Concepts and applications (4th ed.). New York:
issues. Students engaged in inquiries about Chris- MJcGraw-Hill.
topher Columbus, changes in families over time,
Airasian conceives of classroom assessment more
personal and family history, slavery, human rights,
broadly than the authors of many other classroom
cultures, space, and nature cycles.
assessment texts. The focus is not only on the
Byrd, The Revised Taxonomy and Prospective assessment needs of testing, grading, interpreting
Teachers (pp. 244-248) standardized tests, and performance assessments,
but also on assessment concerns in organizing a
1. Feinman-Nemser, S., & Parker, M.B. (1990). classroom at the start of school, planning and im-
Making subject matter part of the conversation plementing instruction, and strategies of teacher

263
THEORY INTO PRACTICE / Winter 2002
Promoting Thinking Through Peer Learning

self-reflection. Airasian views classroom assess- hensive approach to teaching and testing. This
ment as an everyday, ongoing, integral part of highly practical book helps educators design a
teaching, not something that is separated from deeply aligned curriculum that produces academic
life in classrooms. The organization of the text results and a level playing field for all students.
follows the natural progression of teacher deci- Each chapter covers principles of testing and
sion making-from organizing the class as a curriculum building, and concludes with a
learning community to planning and conducting summary of the key concepts presented. The re-
instruction to the formal evaluation of learning, sults of various studies are surveyed, ethical di-
and, finally, to grading. lemmas involved in testing are discussed, and a
step-by-step guide to pedagogical parallelism
2. Stiggins, R.J. (2001). Student-involved class- and alignment is presented.
room assessment (3rd ed.). Upper Saddle River,
NJ: Prentice Hall. 2. Herman, J.L., Klein, D.C., & Abedi, J. (2000).
Assessing students' opportunity to learn: Teacher
Using a jargon-free writing style, Stiggins shows and student perspectives. Educational Measure-
teachers how to create high-quality classroom ment: Issues and Practices, 19(4), 16-24.
assessments and use them to build student con-
fidence, thereby maximizing (not just document- Herman, Klein, and Abedi explore various meth-
ing) student achievement. This emphasis is on ods of assessing opportunity to learn, using both
teacher and student reports. They investigate the
what teachers need to know to manage day-to-
integrity of various dimensions of opportunity
day classroom assessment effectively and effi-
to learn, analyze the relationship between teacher
ciently. The author offers practical guidelines
and student estimates of opportunity to learn,
on how to construct all types of assessments,
and draw implications for policy and practice.
providing clear and understandable explanations
The conceptual link between opportunity to learn
of how to match achievement targets to assess-
and test validity is explored and recommenda-
ment methods. Traditional concepts of validity
tions are offered.
and reliability are integrated within his overall
assessment framework. 3. Relearning by Design web site
www.relearning.org
Anderson, Curricular Realignment: A Re-exam-
ination (pp. 255-260) This website, initiated by Grant Wiggins, fo-
cuses on performance assessment, rubrics for
1. English, F.W., & Steffy, B.E. (2001). Deep cur- evaluating the quality of student performances,
riculum alignment: Creating a level playing field and the way in which assessment information
for all children on high-stakes tests of educa- can be used to inform teachers and improve in-
tional accountability. Lanham, MD: Scarecrow struction. This is an excellent resource for teach-
Press, Inc. ers who are interested in improving their
English and Steffy explore the flaws in state- knowledge and skills in the area of the nexus of
mandated testing, advocating a more compre- instruction and assessment.

lip

264
COPYRIGHT INFORMATION

TITLE: Revising Blooms Taxonomy


SOURCE: Theory into Practice 41 no4 Aut 2002
WN: 0228800374001

The magazine publisher is the copyright holder of this article and it


is reproduced with permission. Further reproduction of this article in
violation of the copyright is prohibited. To contact the publisher:
http://coe.ohio-state.edu/.

Copyright 1982-2003 The H.W. Wilson Company. All rights reserved.

Вам также может понравиться