TargetTrainingInterna+onal

Assessing the Entrepreneurial Mindset in

Undergraduate Engineering Education:
New Methods and Emerging Practices in the
Kern Entrepreneurship Education Network
NCIIA | REE USA | Conference | Saturday, March 26, 2011
David Pistrui, Ph.D., Managing Director - Acumen Dynamics
Assessment Fellow, Kern Family Foundation
dpistrui@acumendynamics.com

Agenda
1 - The Seven KEEN Learning Outcomes for Undergraduate
Engineering Students
2 - Overview of the KEEN - TTI Performance DNA Framework and
Model(s)
3 - Insights into individual school KEEN Assessment Models,
Methods and Frameworks
4 - ABET a-k criteria Assessment Methods Under Development
5 - Discussion, Exchange and Dialog - Advancing the Cause

SevenKEENLearningOutcomes
It is vital that the seven key outcomes are communicated, instilled and reinforced in students as part of the
assessment process. The seven KEEN outcomes include:
A student encountering the KEEN program should be able to:
1. Effectively collaborate in a team setting
2. Apply critical & creative thinking to ambiguous problems
3. Construct & effectively communicate a customer "appropriate value proposition
4. Persist through and learn from failure
5. Effectively manage projects through appropriate commercialization or final delivery process
6. Demonstrate voluntary social responsibility
7. Relate personal liberties and free enterprise to entrepreneurship

TargetTrainingInterna+onal

KEEN - TTI Assessment Methodologies

TTIPerformanceDNA

KEENTTIPerformanceDNA

Retention
DISC - Values

ABET a-k
criteria 23 Soft Skills

Seven

KEEN
Learning
Outcomes
-23 Soft Skills

TargetTrainingInterna+onal

Createsarankorderingof23jobrelatedpersonalandprofessionalskillsand
providesthepar7cipantwithna7onalnormeddatacomparisons

23 Personal Skills or Competencies

Measures level of mastery of personal skills
Measures level of mastery of professional skills
Self assessment
Measures Have you done it?
Job benchmark and personal/coaching reports

TargetTrainingInterna+onal

The23jobrelatedpersonalandprofessionalskills

SevenKEENLearningOutcomesandtheTTI23DNAPersonalandProfessional
Competencies(SoISkills)MeasurementModel

Star&ngPoint
Freshman

MidPoint
Soph./Jr.

EndingPoint
Senior

KEENEME

Time

1.
2.
3.
4.
5.
6.

Measuringchangeinmasteryover&me
Measuringchangeinrankorderover&me
BenchmarkingindividualschoolwithKEENaveragesover&me
Benchmarkingstudents/schools/KEENwithprac&cingEMEs*over&me
Compara&veanalysiswithotherassessmenttoolsandtechniques
MeasuringKEENprogramini&a&vesabilitytoins&lltheSevenKEENLearning
Outcomes

*EME=EntrepreneurialMindedEngineer|KEEN/TTIwillbuildbenchmarkdatabase

Source: Pistrui, 2011

Prac*cing
EME

TargetTrainingInterna+onal

KEEN Fall 2010 Winter 2011 Update

ARubricBasedApproachto
AssessingEntrepreneurial
MindsetLearningOutcomes
RobKleine,Ph.D.
OhioNorthernUniversity
NCIIA2011

KEENProgramEntrepreneurialMindsetLearning
Outcomes
AstudentencounteringtheKEENprogramshouldbeableto:
Eec&velycollaborateinateamseXng
Applycri&cal&crea&vethinkingtoambiguousproblems
Construct&eec&velycommunicateacustomerappropriate
valueproposi&on
Persistthroughandlearnfromfailure.
Eec&velymanageprojectsthroughappropriate
commercializa&onornaldeliveryprocess
Demonstratevoluntarysocialresponsibility
Relatepersonalliber&esandfreeenterpriseto
entrepreneurship

KEENProgramEntrepreneurialMindset
Cul7va7onandAssessmentProcess

Connec&ngONUsGeneralEduca&on
andtheKEENProgram

ONUGenEdLearning
Outcomes
1.
2.
3.
4.
5.
6.
7.

Eec+vecommunica+on
Cri+calandcrea+vethinking
Scien&candquan&ta&veliteracy
Anunderstandingofdiversecultures
andtheireectsonhumaninterac&on
Integra&onofconceptsacross
disciplines
Informedandethicalresponsesto
personal,civic,andglobalneeds
Informedresponsestoaesthe&csin
artornature

KEENLearningOutcomes
1.
2.
3.
4.
5.
6.
7.

Eec&velycollaborateinateam
seXng
Applycri+cal&crea+vethinkingto
ambiguousproblems
Construct&eec+velycommunicate
acustomerappropriatevalue
proposi&on
Persistthroughandlearnfromfailure.
Eec&velymanageprojectsthrough
appropriatecommercializa&onornal
deliveryprocess
Demonstratevoluntarysocial
responsibility
Relatepersonalliber&esandfree
enterprisetoentrepreneurship

LetsCon&nuetheConversa&on
Toreceive
Awhitepaperontheentrepreneurialmindset
assessmentprocess
Copiesoftheentrepreneurialmindsetrubrics

EmailRobKleineatrkleine@onu.edu

AssessingtheEntrepreneurial
MindsetatLawrenceTech

May13,2010
DonaldCarpenter

LawrenceTechnologicalUniversity

SoutheldMichiganCohort1KEENSchool
MissionStatement
LawrenceTechdevelopsleadersthroughinnova*veand
agileprogramsembracingtheoryandprac*ce.
VisionStatement
In2015,LawrenceTechnologicalUniversityisthe
regionspreeminentprivateUniversityproducing
leaderswithanentrepreneurialspiritandaglobalview.
UndergraduateEnrollment:
LTU~3200
Engineering~1800

ProgramAssessment
Entrepreneurial
Internship(students&
employers)
LeadershipSurvey
PBL/ACLSurvey
LTUEntrepreneurial
MindsetSurvey
TTIPerformanceDNA

Problem Solving
Teamwork
Entrepreneurial Skills
(idea generation,
customers, etc.)

ProgramAssessment
Entrepreneurial
Internship(students&
employers)
LeadershipSurvey
PBL/ACLSurvey
LTUEntrepreneurial
MindsetSurvey
TTIPerformanceDNA

Problem Solving
Critical Thinking
Business Skills
Societal Issues

ProgramAssessment
TTIPerformanceDNA
23SodSkills

Seven KEEN
Outcomes

LongitudinalAssessmentStrategy
TTIDNA
Competencies
Direct
Assessment
(Rubrics)&
FocusGroups

Entrepreneurial
MindsetSurvey

KEEN
Outcomes

Rela&ngAssessmentofKEENOutcomes
toABETa)k)
PritpalSingh
ProfessorandChairman
DepartmentOfElectricalandComputerEngineering
VillanovaUniversity
Villanova,PA19085USA
pritpal.singh@villanova.edu

MappingKEENOutcomestoABET
3a)k)Outcomes
1)Eec&velycollabora&nginateamseXng,
ABETOutcome3d)anabilitytofunc&ononmul&disciplinaryteams
2)Applyingcri&calandcrea&vethinkingtoambiguousproblems,
ABETOutcome3c)anabilitytodesignasystem,component,or
processtomeetdesiredneeds
3)Construc&ngandeec&velycommunica&ngacustomer
appropriatevalueproposi&on,
ABETOutcome3g)anabilitytocommunicateeec&vely

MappingKEENOutcomestoABET
3a)k)Outcomes
NoABETequivalenttotheremainingKEENoutcomes
4)Persis&ngandlearningfromfailure,
5)Eec&velymanagingprojectsthroughappropriatecommercializa&on
ornaldeliveryprocess,
6)Demonstra&ngvoluntarysocialresponsibilityand
7)Rela&ngpersonalliber&esandfreeenterprisetoentrepreneurship
OtherrelatedABEToutcomes:
f)anunderstandingofprofessionalandethicalresponsibility
h)thebroadeduca&onnecessarytounderstandtheimpactof
engineeringsolu&onsinaglobalandsocietalcontext
i)arecogni&onoftheneedfor,andanabilitytoengageinlifelong
learning
j)aknowledgeofcontemporaryissues

VillanovasEEAssessmentProcess

AssessingSodSkills
SodSkillsarediculttoassess;presentlywe
useacombina&onofrubricsbasedapproach
andreec&veessays;
TheTTIapproachoersanopportunityto
providecomplementaryinforma&ontorubrics

Assessingthe
EntrepreneurialMindset

Prof.WilliamJ.Rie
KeXeringUniversity
wrie@keXering.edu

Whereisassessmentappropriate?
Thestudent
*beforeanyclasses
*TTIevalua+on
*ATEsurvey

*aIerapar+cularclass
*SSIsurvey

*aIerallclasses
*EventualTTIevalua+onofseniors
*AfollowupATEsurveyforseniors

D-n
D-a
Dominance
(Problem solver)

I-n
I-a
Influence
(Social Interaction)

S-n
S-a
Steadiness
(Methodical)

C-n
C-a
Compliance
(Procedural)

A]tudeTowardEntrepreneurship
(ATEsurvey)
BaseduponworkbyRosemaryAthaydeandMarkHartof
KingstonUniversity,UK.
Asks42ques+onsregardinga]tudestowards:
crea+vity
leadingothers
intui+on
achievement
personalcontrol
nancialrisktaking

Creativity

Leadership

Intuition

Achievement Personal
Control

Financial
Risk-Taking

TheSIISurvey
BaseduponapproachbyDanApplefromPacic
CrestIns+tute.
Itasksforrespondentstogive3responsesto:
WhatweretheStrengthsoftheproject?
WhatareareasofImprovement?
WhatInsightsweregained?

Typical Mind Map

Assessingworkshops
FacultyandSta
Selfecacysurvey(SES)premeasureandpost
measureusingtheeleven(11)traitsofan
entrepreneuraspresentedbyTimmonsandSpinelli.
OnaLikertscaleof15,ratea]tudetoward:
1.necessityoftheaXributeforstudentdevelopment
2.willingnesstoimplement
3.abilitytoimplement

WorkshopSESstudies
Scoresincreasedfor:
Toleranceofuncertaintyability
ToleranceforambiguityabilityPersistence
necessaryandability
Commitmentanddetermina+onability
Scoresdecreasedfor:
Crea+vityability
Leadershipwillingness

Summary
Tooearlytodrawconclusiveevidenceof
change
Con+nuetoassessourprogramsandusethe
feedbacktoimprove
WewillmakeaculturechangeatKeXering
University.

TargetTrainingInterna+onal

Thank You!
NCIIA | REE USA | Conference | Saturday, March 26, 2011