Академический Документы
Профессиональный Документы
Культура Документы
V I E W
E
R
S
Review in Advance first posted online
on July 7, 2009. (Minor changes may
C E
I N
A
D V A
Innovations in Teaching
Undergraduate Biology
and Why We Need Them
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
William B. Wood
by University of Colorado - Boulder on 07/07/09. For personal use only.
5.1
ANRV389-CB25-05 ARI 25 June 2009 16:3
Contents
DEFINING THE CHALLENGE . . . . 5.2 In-Class Learning Activities:
HISTORY AND CURRENT STATE Listening and Note-Taking
OF DISCIPLINE-BASED versus Active Engagement . . . . . . . 5.11
EDUCATIONAL RESEARCH . . . . 5.3 Out-of-Class Learning Activities:
HOW STUDENTS LEARN . . . . . . . . . 5.3 Instructor versus Student
APPLICATION TO THE COLLEGE Responsibility for Learning . . . . . . 5.13
CLASSROOM . . . . . . . . . . . . . . . . . . . . 5.5 Student-Faculty Interaction in Class:
EVIDENCE THAT Making Pedagogy Explicit . . . . . . . 5.14
RESEARCH-BASED TEACHING Student-Faculty Contact Out of
AT THE COLLEGE LEVEL Class: Office Hours versus
INCREASES STUDENT Enhanced Communication . . . . . . 5.15
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
DEFINING THE CHALLENGE The second driving force for reform is re-
cent research from educators and cognitive sci-
Two principal forces are generating momen-
entists into how students learn. This research,
tum for a revolution in the way biology and
discussed further below, provides strong ev-
other sciences are taught in high schools, col-
idence that the traditional teaching methods
leges, and universities (DeHaan 2005). First,
employed in most secondary-school and under-
there are deep concerns about American inter-
graduate introductory courses are far from opti-
national competitiveness, amid indications that
mal for promoting student learning. Alternative
the U.S. is doing a relatively poor job at retain-
research-based teaching methods have been de-
ing and training students in the science, tech-
veloped and shown to be more effective, and a
nology, engineering, and mathematics (STEM)
small but growing number of informed STEM
disciplines (Glenn 2000, NAS 2004). Too many
faculty and administrators are pushing for their
talented students get the impression from intro-
adoption.
ductory courses that science is simply a collec-
Beyond the general findings about how stu-
tion of facts to be memorized and consequently
dents learn, there is now a substantial body of
STEM: science, drop out of STEM majors, with little under-
discipline-based educational research (DBER),
technology, standing or appreciation of what science is all
engineering, and dealing with teaching and learning of specific
about (Seymour & Hewitt 1997). For students
mathematics STEM disciplines. This review refers to some
who do major in life sciences, there is concern
DBER: discipline- of the more important general findings on how
that future research biologists are being inad-
based educational students learn, but it primarily highlights re-
equately trained (NRC 2003, AAMC-HHMI
V I E
research sults and applications from recent DBER and,
E W 2009).
R
5.2 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
more specifically, life sciences education re- Many DBE researchers doing this work are
search. It focuses on teaching and learning for practicing scientists trained in their disciplines,
undergraduates, particularly in large courses, who have also learned educational research
FCI: force concept
where innovation is most needed. methods and taken up DBER as a sideline. inventory
Some schools of education have added DBER
practitioners trained as educators to their fac-
HISTORY AND CURRENT STATE ulties. In addition, some university science de-
OF DISCIPLINE-BASED partments, particularly in physics but increas-
EDUCATIONAL RESEARCH ingly in other STEM disciplines, now include
DBER grew out of the efforts of physicists in the staff or tenure-track DBE researchers (NAS
mid-1980s, who discovered that most under- 2005) and are beginning to offer graduate train-
graduate students in their introductory courses ing and degrees in DBER.
were gaining only very superficial knowl- DBER is published in a variety of edu-
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
edge from traditional methods of instruction cation journals, some general and some that
(Halloun & Hestenes 1985, Hestenes et al. are discipline-specific, sponsored by STEM
by University of Colorado - Boulder on 07/07/09. For personal use only.
1992). Rather than integrated conceptual un- professional societies. A few scientific jour-
derstanding and creative problem solving, nals, including Nature, Science, PLoS Biology,
students were learning fragmented factual in- and Genetics, have also begun publishing
formation and rote problem solving methods, DBER articles, generally in an education
while retaining many misconceptions about section. Table 1 lists some of the more
physical phenomena. To gain some measure widely read general and discipline-specific
of student understanding, physicists developed educational journals that publish DBER in life
the Force Concept Inventory (FCI), a simple sciences.
multiple-choice test of basic concepts and com-
mon misconceptions about Newtonian physics
of everyday events, written in simple language HOW STUDENTS LEARN
and requiring no sophisticated mathematics New ideas about teaching and learning began
(Hestenes et al. 1992). By administering the to receive public attention in the 1960s. Popular
FCI at the beginning and the end of an in- iconoclasts such as Holt (1964, 1967) and Kozol
troductory course, instructors could obtain a (1967), building on earlier ideas (Dewey 1916,
measure of gains in student conceptual learn- Ausubel 1963), pointed out the shortcomings
ing. They could then experiment with different of passive learning environments for learners
instructional approaches and test them for ef- of all ages, and advocated instead more student-
ficacy. These physicists showed that adopting a centered, open classrooms that promoted active
small number of nontraditional promising prac- learning through hands-on experience, by do-
tices in course design and implementation could ing rather than by simply listening, reading, and
substantially increase student learning gains. watching. These writers, considered radicals in
These practices, and their basis in more gen- their time, articulated ideas about optimal con-
eral educational research on how people learn, ditions for meaningful learning that have since
are described in the following sections. been tested and validated by a large body of ed-
After a lag of several years, instructors in ucational research. Also during the past three
other STEM disciplines began to make simi- decades, advances in cognitive science have be-
lar observations about their students and to ini- gun to elucidate the neural activities and synap-
tiate similar efforts at improving instruction. tic changes that accompany learning. Results
The empirical approach of varying instruc- of research in both education and cognition
tional methods and measuring effects on stu- were reviewed in the seminal National Research
dent learning has been called “scientific teach- Council (NRC) report How People Learn: Brain,
V I E
ing” (Handelsman et al. 2004, Wieman 2007). Mind, Experience, and School (NRC 1999). The E W
R
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
Table 1 A partial list of journals that publish life sciences education researcha
General scientific journals
Genetics
Nature
Science
PLoS Biologyb
a
For additional journal listings, see Dolan (2007).
b
Open access.
c
Higher standards: research articles require assessment and outcome evidence for efficacy of a new course
or intervention, rather than simple descriptions of practice.
Constructivist: the
view that individual major conclusions from this research can be Learning is promoted by frequent
learners must build summarized as follows: feedback, that is, ongoing testing of
their own knowledge
structures, from Learning involves the elaboration of new knowledge as students are acquir-
experience and knowledge structures in long-term mem- ing it. Educators call this formative
instruction, on a ory. According to this constructivist view assessment, as opposed to summative
foundation of prior of education (Dewey 1916; Ausubel 1963, assessment, which refers to high-stakes
knowledge exams given after an extended period
2000), effective instruction must begin
Formative at the level of a student’s prior knowl- of instruction. Formative assessment
assessment: frequent, provides valuable feedback to both
ongoing testing,
edge (which may include misconcep-
usually during class, tions). New information unrelated to instructor and students: Do students
with the goal of prior knowledge is difficult to learn and understand the concept just presented or
monitoring remember. discussed? Can they transfer this under-
understanding and No two learners are the same: Learn- standing to apply the concept in a new
providing feedback situation?
ers differ in previous experience, previous
rather than judging
instruction, preferred styles of learning, Effective learning requires awareness and
performance
family background, cultural background, questioning of one’s own learning pro-
Summative
and so on. Diversity is an asset for col- cess: How well do I understand this?
assessment: high-
stakes testing at the laborative work because different mem- What information do I need to under-
end of an instructional bers of a group bring different perspec- stand it better? What do I not under-
unit or course to judge tives and skills to bear, but it can hamper stand yet? Do I understand it well enough
student performance, to transfer it, that is, apply it to a new
learning for some students unless the level
e.g., mid-term and
and mode of instruction are appropriate situation? Educators call this awareness
final exams
for all. metacognition.
V I E
E W
R
5.4 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
fort to solve an intriguing problem, will dents should spend time actively engaged
be better retained than learning from with the subject matter, for example, dis-
relatively passive activities such as read- cussing, diagramming, solving problems,
ing a text or listening to a lecture. working on a research project, etc., in ad-
Learning in a particular area of knowl- dition to or in place of listening passively
edge such as life sciences can be viewed to a lecture, reading the textbook, or con-
as a continuum from novice to expert sta- sulting Web sites.
tus, along which we would like to help Most undergraduate college STEM classes,
our students progress. The knowledge of particularly in large introductory courses, are
an expert constitutes a coherent struc- not designed around these principles, and it can
ture into which new concepts can easily fit be argued that this is one reason for the high
and from which relevant information can attrition rates and generally superficial learn-
be efficiently retrieved. In contrast, new ing among introductory students in STEM dis-
knowledge for the novice often appears to ciplines. Educators have shown that effective
be a collection of unrelated facts, which instruction requires not only disciplinary con-
are difficult to memorize and retain. In tent knowledge, for example, expertise in life
other words, experts see and make use sciences, but also pedagogical content knowl-
of meaningful patterns and relationships edge, that is, understanding of and ability to
in the information they possess, whereas apply known educational principles. Because
novices cannot. graduate and postdoctoral training in STEM
disciplines seldom includes any instruction in
APPLICATION TO THE COLLEGE pedagogical practice, most university faculty
CLASSROOM are unaware of new knowledge about learn-
These general conclusions apply to teaching ing that could make their teaching more effec-
and learning of STEM disciplines at the un- tive. Therefore, they simply teach the way they
dergraduate level: were taught in large classes, by traditional lec-
Effective instruction must build on stu- turing. We need to improve the way we teach
dents’ prior knowledge (which may undergraduates. The remainder of this article
include misconceptions that require discusses evidence that applying the above prin-
correction). ciples to college classrooms can make a differ-
Instructors should be aware of the stu- ence in how much and how well our students
dent diversity in their classrooms and use learn.
V I E
E W
R
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
ing skills, and consequently learn very little. Is the University of Oregon showed that students
there evidence that changes in teaching prac- in the traditional introductory course learned
by University of Colorado - Boulder on 07/07/09. For personal use only.
tices at the college level can significantly en- substantially less than students in a workshop
hance student learning? biology course, in which lecturing was almost
Physicists were the first to obtain such ev- entirely replaced by student group problem
idence, using the Force Concept Inventory solving and other projects during class time
(FCI; Hestenes et al. 1992) described above. (Udovic et al. 2002). Knight & Wood (2005)
The FCI became nationally accepted among showed in a quasi-controlled study that even
physics instructors during the 1990s as a way an incremental change, substituting 30–40% of
to gauge student learning of Newtonian me- lecturing during class time with more engaging
chanics. Administering the FCI as a pre-test at student-centered activities (described below),
the start of a course and then again as a post- led to increases in normalized learning gains
test at the end yielded a raw learning gain for averaging about 30% in a large upper-division
each student. For comparison of students with developmental biology course. Similar results
different levels of incoming knowledge, each have been reported in large introductory biol-
raw gain was divided by the maximum possible ogy courses (e.g., Smith et al. 2005, Armstrong
gain for that student, to arrive at a percentage et al. 2007, Freeman et al. 2007).
normalized gain: <g> = 100(post-test score – Clearly, concept inventories in life sciences
pre-test score)/(100 – pre-test score). would be valuable for continuation of this re-
In attempts to increase the generally low search (Garvin-Doxas et al. 2007), and sev-
normalized gains seen in traditional intro- eral have recently been published for vari-
ductory courses, physics education researchers ous subdisciplines, including general biology
transformed their courses with new teaching (Klymkowsky et al. 2003), genetics (Bowling
approaches following the principles described et al. 2008, Smith et al. 2008), and natural selec-
above: more class time devoted to active learn- tion (Anderson et al. 2002). Libarkin (2008) has
ing, more group problem solving, frequent for- compiled a comprehensive current listing and
mative assessment, and so on. They carried comparison of concept inventories in STEM
out controlled studies, for example, the same disciplines.
instructor teaching the same syllabus through
traditional lectures in one semester and then
PROMISING PRACTICES FOR
using the new approaches in the following
INCREASING STUDENT
semester (e.g., Beichner 2008). Study after
LEARNING
study indicated that students in the transformed
courses substantially outperformed those in Many college faculty use Socratic dialog and
V I E
E W traditional courses. In a compelling landmark student-centered group work in small classes
R
5.6 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
and seminars, but they believe there is no alter- Froyd (2008) has introduced a useful rat-
native to lecturing when confronted with hun- ing of promising practices based on two crite-
dreds of students in an auditorium with fixed ria: (a) practicality of implementation (breadth
seats. However, innovative instructors pursuing of applicability to STEM courses, freedom
DBER have developed and tested alternative from resource constraints, ease of transition
teaching approaches that prove to be substan- for instructors), and (b) evidence for efficacy
tially more effective than traditional lectures. in promoting increased student learning (from
This research has identified several promising strongest evidence, i.e., multiple high-quality
practices for transforming large classes in ways comparison studies, to weakest evidence, i.e.,
that enhance student learning and conceptual descriptive application studies only). The fol-
understanding (reviewed in Handelsman et al. lowing paragraphs, summarized in Table 2,
2007). compare these practices with their counterparts
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
Table 2 Comparison of traditional practices with corresponding research-based promising practices for nine aspects of
large course design and implementation in STEM disciplines
by University of Colorado - Boulder on 07/07/09. For personal use only.
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
in traditional instruction and rate them on require deeper conceptual understanding. The
Froyd’s two criteria. The practices are orga- verbs employed (Figure 1) describe an action
nized under nine aspects of course organization. or ability that can be assessed by asking students
Instructor-centered:
designed around the to carry it out. Importantly, statements such
knowledge the as “students should understand,” “appreciate,”
instructor wishes to Content Organization: The Syllabus or “be aware of ” are inappropriate learning
transmit to students; versus Specific Learning Goals objectives because their achievement cannot
focused on the
The difference between preparing a course syl- be tested without more explicit performance-
instructor’s teaching
process labus and formulating learning objectives is based criteria. Because lower Bloom’s levels
more profound than it may appear (Allen & are easier to assess with multiple-choice and
Student-centered:
designed around the Tanner 2007). The typical syllabus is instructor- short-answer exams, many instructors in large
needs, abilities, prior centered; it lists the topics on which the instruc- STEM courses neither demand nor test for
knowledge and tor will lecture and assign out-of-class work, higher levels of understanding. In a survey of
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
diversity of students; but it gives students little information about the over 500 final exams from a variety of introduc-
focused on the
level of understanding they should strive for or tory undergraduate and medical school biology
by University of Colorado - Boulder on 07/07/09. For personal use only.
student’s learning
process the skills they are to learn. In molecular biology, courses, most questions were rated at Bloom’s
for example, the process of transcription can levels 1 and 2, and questions on the Medical
MCAT: medical
college admission test be understood at many levels, which are gen- College Admissions Test (MCAT) and Grad-
erally not distinguished in a syllabus. In con- uate Record Examination (GRE) ranked only
trast, learning objectives are student-centered slightly higher (Zheng et al. 2008). Another
and more explicit; they describe what a success- ongoing research study on assessment in in-
ful student should be able to do at the end of troductory biology courses indicates that the
the course or unit. For example, students should overwhelming majority of test items on final
be able to: “name the principal enzyme that cat- exams are Bloom’s level 1 (D. Ebert-May, per-
alyzes transcription,” or “explain the nucleotide sonal communication). Because most students
sequence relationships between the two strands learn at the level assessed on summative ex-
of the template DNA and the RNA transcrip- ams, it is small wonder that they derive only
tion product,” or “diagram a step in the elon- superficial knowledge from such courses. In-
gation of an RNA transcript, showing the local structors can remedy this situation by aiming
nucleotide sequences and strand polarities of for higher Bloom’s levels in formulating course
both DNA strands and the RNA,” or “predict learning goals and assessing student knowledge
the consequences for the transcription process with appropriately challenging questions on ex-
if one of the four nucleoside triphosphates is ams (Crowe et al. 2008).
unavailable.” Course design around learning goals follows
The learning objectives above demand dif- the principle of backward design (Wiggins &
ferent levels of understanding. A half century McTighe 1998). The instructor first formulates
ago, the American educator Benjamin Bloom broad learning goals for students in the course,
developed a convenient scheme for classifying and then more specific learning objectives.
these levels (Bloom & Krathwohl 1956), which Once these are defined, she designs assessments
became known as Bloom’s taxonomy of the cog- (both formative and summative) to test for their
nitive domain (Figure 1). Each of Bloom’s six achievement. Only then does she choose the
levels of understanding can be associated with most appropriate text or other reference ma-
verbs appropriate for a learning goal at that terials and plan the learning activities in and
level. For example, the ability to name an en- outside of class that will most effectively lead
zyme or describe a process requires only mem- to fulfillment of the objectives. At the start of
orization of the relevant information (level 1), the course, she will explicitly apprise students
whereas ability to predict an outcome (level 3) of the learning objectives, which may include
V I E
E W or defend a principle based on evidence (level 6) rubrics (Allen & Tanner 2006) demonstrating
R
5.8 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
Judge
6 Justify
Evaluation: Defend
think critically Criticize
about and defend Evaluate
a position
Develop
Create 5
Propose Synthesis:
Design transform and combine ideas to
Invent create something new
4 Compare
Analysis: Contrast
break down concepts into parts Distinguish
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
Apply
Use 3
Diagram
by University of Colorado - Boulder on 07/07/09. For personal use only.
Compute Application:
Solve apply comprehension to unfamiliar situations
Predict
Restate
2 Explain
Comprehension: Summarize
demonstrate understanding of ideas and concepts Interpret
Describe
Define
List 1
State Factual knowledge:
Name remember and recall factual information
Cite
Figure 1
Bloom’s levels of understanding. Originally termed Bloom’s taxonomy of the cognitive domain, this schema defines six levels of
conceptual understanding, according to the intellectual operations that students at each level are capable of (Bloom & Krathwohl
1956). The italicized verbs have been added to the original hierarchy; they indicate performance tasks that test achievement of learning
goals at each level. Fine distinctions in the hierarchy are difficult, and some educators prefer to classify goals on only three levels: low
(1, 2), medium (3, 4) and high (5, 6). (Based on Allen & Tanner 2002.)
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
understanding and require that students of the same name, What Matters in College are
demonstrate achievement of these goals on ex- the relationships students build with each other
ams and other course work. and with their instructors. Moreover, the de-
velopment of group-work skills is important in
preparing students for the real world. When
Student Organization: Individual students who are comfortable with the tra-
versus Group Work ditional individual and generally competitive
Organizing students into small groups for in- learning mode object to group work, the in-
class and out-of-class work can transform the structor can point out that when they join the
course experience from competitive to collabo- workforce, they will probably be part of a team,
rative, allow students to learn from each other whose members they did not choose, and that
as well as from instructors, and help to involve they need to learn how to work effectively with
students who might not otherwise become ac- a group as an important part of their education.
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
5.10 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
as clickers, developed originally for TV game change the way they teach to obtain occasional
shows, have made this kind of formative as- feedback during class, although the results of
sessment more convenient and powerful (Wood such feedback may well change their teaching
2004, Caldwell 2007, Bruff 2009). Each stu- approaches as discussed further below. Clickers
dent has a clicker, generally with five buttons are an added expense for students, who gener-
labeled A–E, and a receiver is connected to the ally purchase a clicker at the bookstore and can
instructor’s computer. When students answer resell it if they wish at the end of the course
a multiple-choice question using the clickers, (Barber & Njus 2007). With regard to evidence
their answers are recorded electronically, and for efficacy, formative assessment is generally
a histogram of the results is displayed to the coupled with in-class activities and so cannot
instructor and, eventually, to the class. How be easily evaluated in isolation. Studies demon-
the instructor can respond to this information strating the value of both these practices in
is discussed in the following section on active combination are discussed in the following
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
Table 3 Comparisons between presentation of topics in traditional lecture format and corresponding active learning
activities
Concept Passive lecture Active class
Differential gene Every cell in an organism has the same DNA, but If every cell in an animal has the same DNA, then how
expression different genes are expressed at different times can cells of different tissues be so different? Discuss this
and in different tissues. This is called differential question with your neighbor and generate a hypothesis.
gene expression.
DNA structure and Complementary base pairing is the basis for the What do you know about the structure of DNA that
replication mechanism of DNA replication. suggests a mechanism for replication? Think about this
for a minute, and then discuss it with your neighbor.
Data analysis and Based on the data shown in this slide, researchers Consider these data from the experiment I just described.
interpretation concluded that Snarticus inferensis is the causal Which of the following conclusions can you draw from
agent of the disease. them? Think about it for a minute, and then we will
take a vote and discuss the results.
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
Biology and society Many people have concerns about genetically I would like to split the class into two groups. One group
by University of Colorado - Boulder on 07/07/09. For personal use only.
modified organisms (GMOs). Some of these will brainstorm about the potential benefits of GMOs
concerns are well founded, and others are not. and the other about possible harmful consequences.
You have to decide for yourself. Then we will have a debate.
In-class concept questions, particularly but a recent study indicates that, on the con-
when used with clickers, can be a power- trary, students are actually learning during the
ful active learning tool. When a challenging discussion, even when no one in a group initially
multiple-choice concept question is presented knows the correct answer (Smith et al. 2009).
to the class, and the initial response is about Clicker questions, to be effective, must be
evenly split between the correct choice and one conceptual and challenging. Ideally they should
or more incorrect choices (distracters), a teach- include distracters based on known student
able moment occurs: Students may be amused misconceptions, and they should assess higher
or surprised, but they want to know who is right Bloom’s levels of understanding (Modell et al.
and who is wrong, and they have become emo- 2005, Lord & Baviskar 2007, Crowe et al. 2008).
tionally involved (Wood 2004). Rather than re- Writing good questions is challenging but es-
vealing the correct answer, or trying to explain sential; questions that simply test factual recall
the concept again, the instructor, if interested in of recently presented information do not en-
promoting active learning, should ask the stu- gage students and are of little pedagogical use.
dents to discuss their answers in small groups, Clicker questions are also not helpful if the in-
trying to convince their neighbors of the cor- structor, after the initial vote, simply indicates
rect choice. Following a few minutes of discus- the correct answer and then moves on. Student
sion, the instructor calls for another vote, and discussion before revealing the correct answer
almost invariably, the majority of students will as well as after is key to learning. For addi-
now choose the correct answer, which is then tional guidance on writing good clicker ques-
revealed and discussed. Students are often bet- tions and their effective use, see Beatty et al.
ter able than the instructor to identify flawed (2006), Wieman et al. (2008), and Bruff (2009).
reasoning by their peers and convince them Clicker questions generally pose well-
of the correct reasoning. Mazur named this defined, discrete problems that are directly re-
phenomenon peer instruction in his delightful lated to the immediate class content. Other
book of the same name (Mazur 1997, Crouch valuable problem-based activities can be based
Distracters: the & Mazur 2001). It could be argued that less on larger, more open-ended questions that
incorrect choices in a
knowledgeable students are simply influenced groups of students may work on for a larger
multiple-choice
V I E
question during discussion by peer pressure from neigh- fraction of the class period and continue out-
E W
bors they perceive to be more knowledgeable, side of class (see following section). But all
R
5.12 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
are examples of building instruction around in-class activities and formative assessments.
student engagement with a problem, rather Another problem is that traditional auditorium-
than around a body of factual information. style classrooms with fixed seating are poorly
Transmissionist: the
Prince & Felder (2007) have contrasted de- suited for interactive group work. A few institu- view that learning can
ductive teaching—transmitting facts, abstract tions have installed large classrooms with café- or must occur by
concepts, and, finally, (maybe) discussing their style seating, which greatly facilitates student- transmission of
application to real-world problems—with in- centered teaching (see Beichner 2008), and knowledge from an
instructor to the
ductive teaching—posing a real-world problem more such classrooms are needed to encourage
learner
to students at the start, and letting them un- course transformation. A final problem, per-
cover the relevant concepts and facts in the pro- haps most difficult for some instructors, is that
cess of solving it. When teaching is deductive, teaching effectively in the new mode requires
student motivation to learn facts and concepts is both a willingness to let go of some control
often primarily extrinsic, driven by desire to ob- in the classroom and a change in perspective,
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
tain a good grade, and the instructor must try from instructor-centered teaching to student-
to keep students engaged with assertions that centered learning. Instructors must give up the
by University of Colorado - Boulder on 07/07/09. For personal use only.
this knowledge will be important in their future widely held transmissionist view that students
studies or careers. By contrast, when teaching is must be told everything they need to know, and
inductive, the students are presented with a real instead realize that not only are students in a
world scenario (relevant to the particular group stimulating and supportive environment capa-
of students being taught) that they are likely to ble of learning a great deal on their own (the
find interesting, and their motivation is intrin- constructivist viewpoint), but that they must
sic, based on desire to find a solution. Induc- develop this ability in order to become either
tive approaches have been given a variety of la- successful scientists or well-informed citizens.
bels, including inquiry-based, problem-based, Balanced against the above potential diffi-
project-based, case-based, question-driven, and culties is the clear evidence from DBER that
discovery learning (reviewed in Prince & Felder moving toward more active learning in a more
2007). Their scope can range from a series of student-centered classroom can substantially
related clicker questions in a single class period increase student learning gains. And complete
(Beatty et al. 2006) to a complex problem re- restructuring is not necessary; even incremen-
quiring several weeks of work, in which new in- tal changes can have a significant effect (e.g.
formation is provided in response to requests Knight & Wood 2005). Other evidence from
from students for data or results of specific the life sciences has been mentioned (Udovic
experimental tests. Disease-related, problem- et al. 2002, Armstrong et al. 2007, Freeman
based, and case-based activities, in which stu- et al. 2007), and additional references can be
dents are presented with a set of symptoms found in Froyd (2008).
and asked to arrive at a diagnosis, are used
extensively in medical education (Albanese &
Mitchell 1993). Out-of-Class Learning Activities:
Instructors who wish to introduce more ac- Instructor versus Student
tive learning into their classes may confront Responsibility for Learning
several problems. Implementing this mode A frequent concern of instructors contemplat-
of teaching can involve more up-front effort ing introduction of clickers and other active-
than the promising practices discussed above. learning activities into their classrooms is that
Although designing a new course around the ac- they will no longer be able to cover all the nec-
tive learning model may require no more effort essary content. First of all, this may not be a
than preparing the lectures for a new traditional bad thing. More coverage does not necessarily
course, transforming a traditional course re- mean more learning, and it can be argued that
V I E
quires the additional work of creating effective deep student understanding of a few important E W
R
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
concepts is more valuable than superficial expo- assimilating factual information, but in trans-
sure to many concepts. Nevertheless, the con- formed courses designed to help students
tent issue is real because it can affect student achieve higher Bloom’s levels of understanding,
MCAT: medical
college admission test preparation for subsequent courses and stan- homework assignments that require students to
dardized tests such as the MCAT. A solution to practice applying concepts, solving problems,
this dilemma lies in placing more of the respon- predicting outcomes, analyzing data, and de-
sibility on the students themselves for learning signing experiments can be an invaluable sup-
basic concepts, and again, recent technology plement to similar in-class exercises. In addition
makes this solution more practical. Using an ap- to more traditional forms of homework, inter-
proach that physicists have called Just-in-Time active simulations (e.g., http://phet.colorado.
Teaching ( JiTT) (Novak et al. 1999), students edu/index.php) and educational video games
are assigned reading and required to submit (Mayo 2009) seem likely to become increasingly
homework online to a course Web site before a useful as out-of-class learning activities.
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
5.14 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
The active learning activities discussed have gained a new kind of teaching experi-
above greatly increase the amount of student- ence that can serve them well in the future if
faculty interaction in comparison with tradi- they should go on to become faculty them-
tional lecture settings. Use of clickers with peer selves. Many institutions, for example those
instruction, in particular, is an easy way to move involved in the Center for the Integration of
classes from one-way transmission of informa- Research, Teaching, and Learning (CIRTL)
tion to interactive dialogs between instructor Network (http://www.cirtl.net/), provide such
and students, and between students, with in- training to STEM graduate students in Prepar-
structional benefits that have been documented ing Future Faculty programs (e.g., Miller et al.
by research as described in the preceding para- 2008). This practice is quite easy to imple-
graphs above. ment, and research to evaluate its efficacy is
in progress at the author’s institution and else-
Student-Faculty Contact Out of Class: where (personal communications).
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
Traditional
verification
(cookbook) Open inquiry Apprenticeship
lab courses lab courses in a faculty lab
Less student More student
autonomy and autonomy and
responsibility responsibility
Guided inquiry Research
lab courses project lab
courses
Figure 3
The range of student laboratory experiences, from verification exercises (“cookbook labs”) to apprenticeship
in a faculty research laboratory. Levels of student responsibility and autonomy increase from left to right.
(Adapted from Weaver et al. 2008.)
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
resources, including more extensive training for search stars of the future. The other is to help
TAs. Although Froyd (2008) rates this promis- the large majority of our students who will not
ing practice low in terms of evidence for effi- become biologists or even scientists to achieve
cacy, several studies, in addition to the two cited minimum biological literacy and to understand
above, have shown that engagement of stu- the nature of science, the importance of empir-
dents with real research problems is one of the ical evidence, and the basic principles that un-
most effective ways to move students along the derlie biological systems. They will need this
path from novice to expert (Nagda et al. 1998, knowledge as twenty-first century citizens of
Lopatto 2004, Luckie et al. 2004, Seymour the United States and the world to make in-
et al. 2004). Compared to students who ex- telligent decisions about issues such as personal
perience only traditional lab courses, reported health, conflicting claims in the media, energy
benefits to students in inquiry-based curricula policy, climate change, and conservation of nat-
include deeper understanding of content, in- ural resources.
creased confidence in their ability to understand Traditional teaching methods do not
and perform science, more positive attitudes prevent the progress of superior students
about science, and lower attrition rates. These from introductory courses to upper-level
gains are particularly evident among under- courses to graduate training, where they may
represented minority students (Nagda et al. become experts in their fields and develop
1998, Russell et al. 2007). Thus, the benefits into skilled researchers. But the traditional
of this promising practice can include not only methods fail the majority of students, who
increased student learning and higher retention leave our introductory courses viewing biology
of students in the major (especially if inquiry- as a large collection of disconnected facts that
based labs are introduced early in the curricu- have little relevance to their daily lives and
lum), but also contributions to faculty research. will soon be forgotten. Part of the problem,
as described in this review, lies not in what
we teach these students (though this is also
CONCLUSION: THE DUAL a concern; see NRC 2003, AAMC-HHMI
FUNCTIONS OF BIOLOGY 2009), but in how we teach it. We must do
EDUCATION better! Widespread adoption of the research-
There are two important purposes for the in- based promising practices described here will
troductory biology courses we teach. One is help.
V I E
E W
R
5.16 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
SUMMARY POINTS
1. We must improve the undergraduate teaching of biology and other STEM disciplines
to remain competitive in the global economy and educate American citizens adequately.
2. Recent research in educational psychology, cognitive science, and neurobiology has
yielded important new insights into how people learn and the optimal conditions for
learning.
3. Discipline-based educational research (DBER) has led to the development of teaching
approaches based on these insights (promising practices), and has provided extensive evi-
dence that these approaches can be substantially more effective than traditional lecturing,
even in large classes.
4. These promising practices vary in their ease of implementation, but even their partial
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
5. Applying these promising practices widely in STEM classes can have a major impact on
better preparing our undergraduate biology students for their future endeavors.
DISCLOSURE STATEMENT
The author is Editor-in-Chief of CBE-Life Sciences Education.
LITERATURE CITED
AAMC-HHMI Committee. 2009. Scientific Foundations for Future Physicians. Washington, DC: Assoc. Amer.
Med. Coll. and Howard Hughes Med. Inst.
Albanese M, Mitchell S. 1993. Problem-based learning: a review of the literature on its outcomes and imple-
mentation issues. Acad. Med. 68:52–81
Allen D, Tanner K. 2002. Approaches to cell biology teaching: questions about questions. Cell Biol.
Educ. 1:63–67
Allen D, Tanner K. 2003a. Approaches to cell biology teaching: learning content in context–problem-
based learning. Cell Biol. Educ. 2:73–81
Allen D, Tanner K. 2003b. Approaches to cell biology teaching: mapping the journey-concept maps
as signposts of developing knowledge structures. Cell Biol. Educ. 2:133–36
Allen D, Tanner K. 2005. Infusing active learning into the large-enrollment biology class: seven
strategies, from the simple to complex. Cell Biol. Educ. 4:262–68
Allen D, Tanner K. 2006. Rubrics: tools for making learning goals and evaluation criteria explicit for
both teachers and learners. CBE-Life Sci. Educ. 5:197–203
Allen D, Tanner K. 2007. Putting the horse back in front of the cart: using visions and decisions about The articles by Allen &
high-quality learning experiences to drive course design. CBE-Life Sci. Educ. 6:85–89 Tanner, plus another by
Anderson DL, Fisher KM, Norman GJ. 2002. Development and evaluation of the conceptual inventory of Tanner et al. 2003,
provide excellent
natural selection. J. Res. Sci. Teach. 39:952–78
practical introductions
Angelo TA, Cross PK. 1993. Classroom Assessment Techniques: A Handbook for College Teachers. San Francisco:
to several of the
Jossey-Bass promising practices
Armstrong N, Chang SM, Brickman M. 2007. Cooperative learning in industrial-sized biology classes. CBE- discussed in the text.
Life Sci. Educ. 6:163–71
Astin AW. 1993. What Matters in College: Four Critical Years Revisited. San Francisco: Jossey-Bass
Ausubel D. 1963. The Psychology of Meaningful Verbal Learning. New York: Grune and Stratton
Ausubel D. 2000. The Acquisition and Retention of Knowledge: A Cognitive View. Boston: Kluwer Acad. Publ.
V I E
Barber M, Njus D. 2007. Clicker evolution: seeking intelligent design. CBE-Life Sci. Educ. 6:1–8 E W
R
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
Beatty ID, Leonard WJ, Gerace WJ, Dufresne RJ. 2006. Question driven instruction: teaching science (well)
with an audience response system. In Audience Response Systems in Higher Education: Applications and Cases,
ed. DA Banks. Hershey, PA: Inf. Sci. Publ.
Beichner R. 2008. The SCALE-UP Project: a student-centered active learning environment for undergraduate pro-
grams. Presented at BOSE Conf. Promis. Pract.—Innov. Undergrad. STEM Educ., Washington, DC.
http://www7.nationalacademies.org/bose/PP Commissioned Papers.html
Bloom BS, Krathwohl DR. 1956. Taxonomy of Educational Objectives: The Classification of Educational Goals.
Handbook 1: Cognitive Domain. New York: Longmans
Bowling BV, Acra EE, Wang L, Myers MF, Dean GE, et al. 2008. Development and evaluation of a genetics
literacy assessment instrument for undergraduates. Genetics 178:15–22
Boyer Commission on educating undergraduates in the research university. 1998. Reinventing Undergraduate
Education: A Blueprint for America’s Research Universities. Stony Brook, NY: Carnegie Found.
Brophy DR. 2006. A comparison of individual and group efforts to creatively solve contrasting types of
problems. Creativity Res. J. 18:293–315
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
Bruff D. 2009. Teaching with Classroom Response Systems: Creative Active Learning Environments. San Francisco:
Jossey-Bass
by University of Colorado - Boulder on 07/07/09. For personal use only.
Caldwell JE. 2007. Clickers in the large classroom: current research and best-practice tips. CBE-Life Sci. Educ.
6:9–20
Cox J. 1993. Cultural Diversity in Organizations: Theory, Research, and Practice. San Francisco: Berrett-Koehler
Publ.
Crouch CH, Mazur E. 2001. Peer instruction: ten years of experience and results. Am. J. Phys. 69:970–77
Crowe A, Dirks C, Wenderoth MP. 2008. Biology in bloom: implementing Bloom’s taxonomy to enhance
student learning in biology. CBE-Life Sci. Educ. 7:368–81
DeHaan RL. 2005. The impending revolution in undergraduate science education. J. Sci. Educ. Technol. 14:253–
59
Dewey J. 1916. Democracy and Education. New York: Macmillan
Dolan EL. 2007. Grappling with the literature of education research and practice. CBE-Life Sci. Educ. 6:289-96
Freeman S, O’Connor E, Parks JW, Cunningham M, Hurley D, et al. 2007. Prescribed active learning increases
performance in introductory biology. CBE-Life Sci. Educ. 6:132–39
A good summary of the Froyd J. 2008. White paper on promising practices in undergraduate STEM education. Pre-
evidence with additional sented at BOSE Conf. Promis. Pract.—Innov. Undergrad. STEM Educ., Washington, DC.
references for most of http://www7.nationalacademies.org/bose/PP Commissioned Papers.html
the promising practices Garvin-Doxas K, Klymkowsky M, Elrod S. 2007. Building, using, and maximizing the impact of concept
described in this review.
inventories in the biological sciences: report on a National Science Foundation sponsored conference on
the construction of concept inventories in the biological sciences. CBE-Life Sci. Educ. 6:277–82
Glenn J. 2000. Before it’s too late (the Glenn Report). Dept. Educ., Washington DC. http://www.ed.
gov/americacounts/glenn
Guimera R, Uzzi B, Spiro J, Amaral LA. 2005. Team assembly mechanisms determine collaboration network
structure and team performance. Science 308:697–702
Hake RR. 1998. Interactive-engagement versus traditional methods: a six-thousand-student survey of me-
chanics test data for introductory physics courses. Am. J. Phys. 66:64–74
Halloun IA, Hestenes D. 1985. Common-sense concepts about motion. Am. J. Phys. 53:1056–65
Hanauer DI, Jacobs-Sera D, Pedulla ML, Cresawn SG, Hendrix RW, Hatfull GF. 2006. Inquiry learning.
Teaching scientific inquiry. Science 314:1880–81
Handelsman J, Ebert-May D, Beichner R, Bruns P, Chang A, et al. 2004. Scientific teaching. Science 304:521–22
An excellent, brief Handelsman J, Miller S, Pfund C. 2007. Scientific Teaching. New York: W.H. Freeman
practical guide to most Hestenes D, Wells M, Swackhamer G. 1992. Force concept inventory. Phys. Teach. 30:141–58
of the promising Holt J. 1964. How Children Fail. New York: Pitman
practices described in Holt J. 1967. How Children Learn. New York: Pitman
this review. Highly Hrepic Z, Zollman DA, Rebello SJ. 2007. Comparing students’ and experts’ understanding of the content of
recommended for all
a lecture. J. Sci. Educ. Technol. 16:213–24
STEM instructors.
Johnson DW, Johnson RT, Smith KA. 1998. Cooperative learning returns to college: What evidence is there
V I E
E W that it works? Change 30:26–35
R
5.18 Wood
I N
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
Karpicke JD, Roediger HL III. 2008. The critical importance of retrieval for learning. Science 319:966–68
Klionsky D. 2004. Talking biology: teaching outside the textbook, and the lecture. Cell Biol. Educ. 3:204–11
Klionsky D. 2008. The quiz factor. CBE-Life Sci. Educ. 7:265–66
Klymkowsky MW, Garvin-Doxas K, Zeilik M. 2003. Bioliteracy and teaching efficacy: what biologists can
learn from physicists. Cell Biol. Educ. 2:155–61
Knight JK, Wood WB. 2005. Teaching more by lecturing less. Cell Biol. Educ. 4:298–310
Kozol J. 1967. Death at an Early Age. Boston: Houghton-Mifflin
Lage MJ, Platt GJ, Treglia M. 2000. Inverting the classroom: a gateway to creating an inclusive learning
environment. J. Econ. Educ. 31:30–43. http://www.sba.muohio.edu/plattgj/eco201
Libarkin J. 2008. Concept inventories in higher education science. Presented at BOSE Conf.
Promis. Pract.—Innov. Undergrad. STEM Educ., Washington, DC. http://www7.nationalacademies.
org/bose/PP Commissioned Papers.html
Lopatto D. 2004. Survey of undergraduate research experiences (SURE): first findings. Cell Biol. Educ. 3:270–77
Lord T, Baviskar S. 2007. Moving students from information recitation to information understanding: ex-
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
curriculum increases student learning: a four-year study of “Teams and Streams”. Adv. Physiol. Educ.
28:199–209
Mayo MJ. 2009. Video games: a route to large-scale STEM education? Science 323:79–82
Mazur E. 1997. Peer Instruction: A User’s Manual. Saddle River: Prentice Hall
McLeod PO, Lobel SA, Cox TH. 1996. Ethnic diversity and creativity in small groups. Small Group Res.
27:248–65
Miller S, Pfund C, Pribbenow CM, Handelsman J. 2008. Scientific teaching in practice. Science 322:1329–30
Modell HM, Michael J, Wenderoth MP. 2005. Helping the learner to learn: the role of uncovering miscon-
ceptions. Am. Biol. Teach. 67:20–26
Nagda BA, Gregerman SR, Jonides J, von Hippel W, Lerner JS. 1998. Undergraduate student-faculty research
partnerships affect student retention. Rev. Higher Educ. 22:55–72
Natl. Acad. Sci. 2004. Rising Above the Gathering Storm: Energizing and Employing America for a Brighter Economic
Future. Washington DC: Natl. Acad. Press. http://books.nap.edu/catalog/11463.html
Natl. Acad. Sci. 2005. Natl. Acad. Worksh. Educ. Res. Positions STEM Discipl. Dep. Washington, DC.
http://www7.nationalacademies.org/cfe/STEM Disciplines Agenda.html
Natl. Res. Counc. 1999. How People Learn: Brain, Mind, Experience, and School. Bransford JD, Brown Classic review of
AL, Cocking RR, eds. Washington, DC: Natl. Acad. Press educational and
Natl Res. Counc. 2003. Bio2010: Transforming Undergraduate Education for Future Research Biologists. Stryer L, cognitive science
ed. Washington, DC: Natl. Acad. Press research on how
learning occurs and the
Novak G, Gavrin A, Christian W, Patterson E. 1999. Just-in-Time Teaching: Blending Active Learning with Web
conditions that foster it.
Technology. San Francisco: Pearson Benjamin Cummings. http://webphysics.iupu.edu/jitt/jitt.html
Prince M, Felder R. 2007. The many faces of inductive teaching and learning. J. Coll. Sci. Teach.
36:14–20 Review of instructional
Russell SH, Hancock MP, McCullough J. 2007. The pipeline. Benefits of undergraduate research experiences. approaches that present
Science 316:548–49 real-world problems to
students and challenge
Seymour E, Hewitt S. 1997. Talking About Leaving: Why Undergraduates Leave the Sciences. Boulder, CO:
them to discover the
Westview Press
facts and concepts they
Seymour E, Hunter AB, Laursen SL, Diatonic T. 2004. Establishing the benefits of research experiences for
need for a solution.
undergraduates in the sciences: first findings from a three-year study. Science Educ. 88:493–534
Silverthorn DU. 2006. Teaching and learning in the interactive classroom. Adv. Physiol. Educ. 30:135–40
Smith AC, Stewart R, Shields P, Hayes-Klosteridis J, Robinson P, Yuan R. 2005. Introductory biology courses:
a framework to support active learning in large enrollment introductory science courses. Cell Biol. Educ.
4:143–56
Smith MK, Wood WB, Adams WK, Wieman C, Knight JK, et al. 2009. Why peer discussion improves student
performance on in-class concept questions. Science 323:122–4
Smith MK, Wood WB, Knight JK. 2008. The genetics concept assessment, a new concept inventory for
V I E
gauging student understanding of genetics. CBE-Life Sci. Educ. 7:422–30 E W
R
E
C
A
D V A N
ANRV389-CB25-05 ARI 25 June 2009 16:3
Springer L, Stanne ME, Donovan SS. 1999. Effects of small-group learning on undergraduates in science,
mathematics, engineering, and technology: a meta-analysis. Rev. Educ. Res. 69:21–51
Stead DR. 2005. A review of the one-minute paper. Active Learn. Higher Educ. 6:118–31
Tanner K, Chatman LS, Allen D. 2003. Approaches to cell biology teaching: cooperative learning in the
A good review of science classroom—beyond students working in groups. Cell Biol. Educ. 2:1–5
inquiry-based curricular Udovic D, Morris D, Dickman A, Postlethwait J, Wetherwax P. 2002. Workshop biology: demonstrating the
innovations and their effectiveness of active learning in an introductory biology course. Bioscience 52:272–81
utility for introducing Umbach PD, Wawrzynski MR. 2005. Faculty do matter: the role of college faculty in student learning and
more students to the engagement. Res. Higher Educ. 46:153–84
process of research.
Weaver GC, Russell DB, Wink DJ. 2008. Inquiry-based and research-based laboratory pedagogies in
undergraduate science. Natl. Chem. Biol. 4:577–80
A useful introductory Wieman C. 2007. Why not try a scientific approach to science education? Change 39:9–15
guide to clickers and
Wieman C, Perkins K, Gilbert S, Benay F, Kennedy S, et al. 2008. Clicker Resource Guide: An Instructors
their effective use to
Guide to the Effective Use of Personal Response Systems (Clickers) in Teaching. Vancouver BC, Can.:
promote active learning
Annu. Rev. Cell Dev. Biol. 2009.25. Downloaded from arjournals.annualreviews.org
through in-class
Univ. British Columbia. http://www.cwsei.ubc.ca/resources/files/Clicker guide CWSEI CU-
concept questions. SEI 04-08.pdf
by University of Colorado - Boulder on 07/07/09. For personal use only.
Wiggins G, McTighe J. 1998. Understanding by Design. Alexandria, VA: Assoc. Superv. Curric. Dev.
Wood WB. 2004. Clickers: a teaching gimmick that works (resource review). Dev. Cell 7:796–98
A book for educators on
Zheng AY, Lawhorn JK, Lumley T, Freeman S. 2008. Application of Bloom’s taxonomy debunks the “MCAT
the neurobiology of
learning.
myth.” Science 319:414–15
Zull JE. 2002. The Art of Changing the Brain. Sterling, VA: Stylus Publ. Co.
V I E
E W
R
5.20 Wood
I N
E
C
A
D V A N