ECI 509: Continuous Improvement of School Technology Initiatives

Evaluation Plan
(Bruns Academy Teacher Development Program)
Why did you do it? (Objective): A. Increase frequency of technology usage among teachers
What did you do?(Strategies):
1. Evenly distribute technology to create more equity among classrooms/grade levels
2. Create professional development based on teacher survey feedback
3. Increase frequency of professional development

Activities:
! Teachers attend weekly Tech Tuesdays sessions that focus on:
o Introduction of these tools and resources by the technology facilitator (TF)/vendors/consultants

Evaluation Questions Measures/Data Sources Results
What do you need to know? How will you find out? What were the results?
Strategy 3
To what extent did teachers feel the
topics were relevant and/or useful?
(quantity)
To what extent did the facilitator support
new participant knowledge and skills?
(quality)

Likert scale




Participant Survey
(Likert Scale Responses
with open ended
responses [qualitative)
In general, teachers felt the topics covered during
the professional development was relevant and/or
useful.
Analysis of the 129 respondents included
56 responding strongly agree, 48 agree, 15
neutral, 5 disagree and 5 strongly disagree.
Teachers stated a need for longer
professional development sessions and/or
one-on-one opportunities.
In general, teachers felt the facilitator supported
new participant knowledge and skills throughout
the 5 professional development sessions.
Roughly, 7 individuals felt the sessions
were unhelpful or relevant. They stated the
strategies could not be implemented with
their middle school student population.


Objective A
To what extent did teachers increase
technology usage? (quantity)

How well did the teachers think the
increase impacted student learning
(quantity)

Observational protocol



Teacher survey (likert
scale responses)


On average, data from weekly walkthrough
data revealed technology-usage implemented
0-1 occurrence a week. Weekly walkthrough
data saw an increase of technology usage
from the months of February-April. Teachers
embedded technology within their curriculum
2-4 days a week.
Decisions (Guiding Questions: What do the results mean? What are you going to do now?)

Summary of Results (Interpretation of Data):

In general, the implementation of professional development over a 5-week span was successful. Teachers felt the
topics were relevant and useful. The technology facilitator was friendly and engaging. The sessions were adequate
and timely. Most importantly, the majority of teachers felt the professional development supported immediate
implementation. The facilitator met with the teachers as a group throughout 5 different sessions.

Overall, teacher usage increased February through April. However, usage was still occasionally isolated or non-
existent.

Next Steps (Action Steps):
Based on the analysis of Strategy 3, some recommendation of improving the professional development for next year
include:
Include more time for individual teacher support
Hire a TF with experience with low-income middle school experience. Teachers felt as though many of the strategies
were too closely associated with elementary-aged students and did not apply to their student population.
Increase the length of each session for teachers to better prepare for immediate implementation within the classroom.
Request the TF attend national conferences to provide the latest, relevant technology-implementation strategies within
the classroom.


Based on the analysis of the data for Objective A, some recommendations for increasing teacher usage:
Provide consistent, relevant professional development throughout the summer and next school year.
Have TF meet with other content area facilitators (Literacy, Math, etc) for additional support in embedding
technology within their curriculum.
Have administrator recognize Technology Teacher of the Month
Have administer express technology usage expectation at the beginning of the year



!"#$"%&'%( *+,%-./%( 01$2(
A. lncrease
frequency of
professlonal
developmenL
8. 8edlsLrlbuLe
Lechnology Lo
creaLe more
equlLy among
classrooms/ grade
levels
C. Survey Leachers on
Lhelr Lechnology-
lnLegrauon sklllseL
and lnLeresLs Lo
creaLe relevanL
professlonal
developmenL
1.lncrease
frequency of
Lechnology usage
among Leachers
2. lncrease
evldence of
1ACk wlLhln
Leacher lesson
plans.
3. lncrease
Leacher buy-ln
or amLude
Loward
Lechnology-
lnLegrauon
l. lncrease
sLudenL
engagemenL
ll. lncrease
sLudenL
achlevemenL by
lncreaslng
quallLy of
Lechnology-
lnLegrauon
34156(17 81&'- 9$6
0 12 24 36 48 60
Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree
No Answer
5
5
15
48
56
# of
Participating
Teachers
To What Extent were the topics relevant and useful?
Number of Participating Teachers
R
e
s
p
o
n
s
e
I
n
d
i
c
a
t
e
d
0
6
12
18
24
30
No
Answer
Strongly
Agree
Agree Neutral Disagree Strongly
Disagree
10
13
12
15
10
33
4
1
4
3
22222
Professional
Development Time
was Adaquate
Professional
Development
provided new
content
Facilitator was
engaging and
friendly
Professional
Development can
immediately be
implemented within
your classroom
You increased your
professional skillset
To What Extent did the Facilitator Support New Participant
Knowledge and Skills?
Session Number
N
u
m
b
e
r
o
f
T
e
a
c
h
e
r
s
0
6
12
18
24
30
No
Answer
Strongly
Agree
Agree Neutral Disagree Strongly
Disagree
15
13
14
15
10
5
7
6
4
5
3 3
1
5
1
22
3
2
1
3
2
3
Professional
Development Time
was Adaquate
Professional
Development
provided new
content
Facilitator was
engaging and
friendly
Professional
Development can
immediately be
implemented within
your classroom
You increased your
professional skillset
To What Extent did the Facilitator Support New Participant
Knowledge and Skills?
Session Number
N
u
m
b
e
r
o
f
T
e
a
c
h
e
r
s
0
6
12
18
24
30
No
Answer
Strongly
Agree
Agree Neutral Disagree Strongly
Disagree
23
22
30
23
24
7
8
1
7
6
11111 11 11
Professional
Development Time
was Adaquate
Professional
Development
provided new
content
Facilitator was
engaging and
friendly
Professional
Development can
immediately be
implemented within
your classroom
You increased your
professional skillset
To What Extent did the Facilitator Support New Participant
Knowledge and Skills?
Session Number
N
u
m
b
e
r
o
f
T
e
a
c
h
e
r
s
0
6
12
18
24
30
No
Answer
Strongly
Agree
Agree Neutral Disagree Strongly
Disagree
1818181818
2
33
22 2
11
22
Professional
Development Time
was Adaquate
Professional
Development
provided new
content
Facilitator was
engaging and
friendly
Professional
Development can
immediately be
implemented within
your classroom
You increased your
professional skillset
To What Extent did the Facilitator Support New Participant
Knowledge and Skills?
Session Number
N
u
m
b
e
r
o
f
T
e
a
c
h
e
r
s
0
6
12
18
24
30
No
Answer
Strongly
Agree
Agree Neutral Disagree Strongly
Disagree
22
24
23
20
26
333
5
1
2
1
2
Professional
Development Time
was Adaquate
Professional
Development
provided new
content
Facilitator was
engaging and
friendly
Professional
Development can
immediately be
implemented within
your classroom
You increased your
professional skillset
To What Extent did the Facilitator Support New Participant
Knowledge and Skills?
Session Number
N
u
m
b
e
r
o
f
T
e
a
c
h
e
r
s