2012 WASC ARC

Twyla Tanaka| Director of Accreditation and Assessment

Laurie Dodge| Associate Vice Chancellor of Institutional Assessment and Planning
Kathy Theuer| Associate Dean, School of Education and Director of Accreditation
Carla Piper| Associate Professor, Education
Lindsay Yossef | Assessment Coordinator
The ABCs of Course Embedded Assessment

What is Course Embedded Assessment?
Direct evidence of student learning at the course
and program level
Aligns Course Learning Outcomes (CLOs) to
Program Learning Outcomes (PLOs)
Inclusion of adjunct faculty in curriculum
development and assessment
Brandman University | Assessment Journey
Twyla Tanaka
Brandman University | Assessment Journey
Why do we use Course Embedded Assessment?
Sets clear expectations for student learning
Targets curriculum intervention
Include entire student population
Eliminates double-grading



Twyla Tanaka
Revised Program Learning Outcomes (PLOs)
Used Blooms Digital Taxonomy (Church 2008)



Brandman University |Assessment Journey
Kathy Theuer
Brandman University | Program Learning Outcomes
Action Verbs
Remembering: define, duplicate, list, memorize, recall, repeat,
reproduce state
Understanding: classify, describe, discuss, explain, identify,
locate, recognize, report, select, translate, paraphrase
Applying: choose, demonstrate, dramatize, employ, illustrate,
interpret, operate, schedule, sketch, solve, use, write.
Analyzing: appraise, compare, contrast, criticize, differentiate,
discriminate, distinguish, examine, experiment, question, test.
Evaluating: appraise, argue, defend, judge, select, support, value,
evaluate
Creating: assemble, construct, create, design, develop,
formulate, write.

Kathy Theuer
Brandman University | Program Learning Outcomes
Masters of Arts in Education

PLO #1 Democratic Schools Apply democratic principles to an authentic
educational context.

PLO #2 Global Perspectives Analyze best practices of global educational systems.

PLO #3 Learning Theory Utilize theories of learning and brain research to
enhance teaching and student learning.

PLO #4 Curriculum Design Evaluate curriculum design and curricular decisions
as they relate to meeting the diverse needs of
students.

PLO #5 Ethics Analyze issues and make ethical decisions within an
educational context

Kathy Theuer
Curriculum Maps Phased Approach
Curriculum Map A (Introduce, Practice, Mastery)
Curriculum Map B (Introduce, Practice, Mastery +
Signature Assignment)



Brandman University |Assessment Journey
Twyla Tanaka & Lindsay Yossef
Brandman University |Assessment Journey
Twyla Tanaka & Lindsay Yossef

Rubrics
For Signature Assignments at the Mastery Level
Brandman University |Assessment Journey
Developed by
Deans and Faculty
Sent to the
Assessment Office
for reviewing/
maintaining records
Rubrics were built
into the
assessment
systems
Laurie Dodge
Rubrics
Brandman University |Assessment Journey
For example:
Laurie Dodge
Brandman University |Assessment Journey
Content Areas Extraordinary
(4)
Good
(3)
Satisfactory
(2)
Needs Improvement
(1)
Bread Texture
Bread is freshly baked
with a fluffy texture,
holding all ingredients
together.
Bread is fresh and does
not fall apart.
Bread is stale but still holds
the burger together.
Bread is soggy, stale, and falls apart.
Cheese
Cheese melts well over
the meat, and
complements the
burger perfectly.
Cheese is melted and
has a good flavor.
Cheese does not melt
thoroughly.
Cheese is cold, hard, and offers no
flavor to the burger.
Quality of the
Meat
Meat is USDA Prime
beef that has the ideal
lean-fat ratio of 20/80.
Meat is cooked
perfectly.
Meat is USDA Select
beef that is tender and
juicy.
Meat is a standard grade of
beef mixed with other beef
byproduct.
Meat is lower grade of an unknown
meat and is either overcooked/dry or
completely undercooked/bloody. Not
the right fat proportion.
Condiments
Burger has the perfect
proportion of ketchup,
mustard, and pickles to
complement the rest of
the ingredients.
Burger has a decent
amount of condiments
that offer flavor.
Burger is weighed down by
condiments.
Burger has too many condiments that
overwhelms the flavor, aesthetics, and
texture.
Produce
Tomato and lettuce are
organic, fresh, and
clean tasting, as well as
aesthetically pleasing.
Tomato and lettuce are
fresh tasting and do not
fall off the burger.
Tomato and lettuce seem
to be getting old and tend
to not stay entirely on the
burger.
Lettuce is completely wilted and the
tomato slices are slimy. Slides off the
burger.
Laurie Dodge
How We Collect Data
LiveText
Turnitin (GradeMark)
Master spreadsheet
of all PLOs for
managing records

Brandman University |Assessment Journey
Carla Piper & Kathy Theuer
Twyla Tanaka & Lindsay Yossef
Signature Assignments
Program Portfolios
Rubric Assessments
Data Reporting

Brandman University |Assessment Journey
Kathy Theuer & Carla Piper
Program Assessment Report
Description of Program and Mission
Assessment Plan
Curriculum Maps, Program Learning Outcomes
and Rubrics
Program Learning Assessment Results (Data
Reports)
Performance Indicators
Faculty Analysis and Review Process
Brandman University |Assessment Journey
Laurie Dodge
Data Reports
Aggregated results (all locations including blended
and online)
Disaggregated Results (separate for locations)

Brandman University |Assessment Journey
PLO Exemplary Proficient Developing Emerging
Bread Texture
(n = 34)
57.1% 32.8% 8.0% 0.4%
Cheese
(n = 39)
61.5% 50% 15% 5%
Quality of the Meat
(n = 95)
40% 41.6% 7.9% 0.5%
Condiments
(n = 54)
39.4% 35.2% 11.6% 1.3%
Produce
(n = 76)
76.6% 20.9% 2.6% 0.0%
Laurie Dodge
Alignment
Ensure that PLOs and Signature Assignments
are the same for all delivery models
Build
Build Assessment System to Ensure
Disaggregation of PLOs
Close the
Loop
Analyze data and make curricular changes for
continuous improvement
Brandman University | Summary
Laurie Dodge
Strengths
Demonstrate equality of
learning across delivery
systems
Electronic Collection of
Student Learning
(Rubrics)
Ability to
disaggregate/aggregate
by locations and modality
Challenges
Work in Progress
What do you do if you
find out students learn
better in one modality
than the other?
Brandman University | Conclusion
Twyla Tanaka


Brandman University |Working Sessions
Working Sessions
Learning Outcomes
Curriculum Mapping
Rubrics