EvaluationProposal

SmartGirlsLifeSkillsTrainingProgram
GuilfordCounty,NC

JenniferMcLean
MoniqueMcLeary
HEA625,Fall2016
Smart Girls Life Skills Training Evaluation 2

TableofContents
SECTION 1. PROGRAM DESCRIPTION...............................................3
PROGRAM COMPONENTS..................................................................................... 3
TARGET AUDIENCE............................................................................................ 3
PROGRAM LOGIC MODEL.................................................................................... 3
PREVIOUS EVALUATION(S)................................................................................... 4
SECTION 2. CONCEPTUALIZATION OF EVALUATION...........................4
EVALUATION PURPOSE........................................................................................ 4
KEY STAKEHOLDERS........................................................................................... 4
ASSUMPTIONS................................................................................................... 4
CONTEXTUAL FACTORS....................................................................................... 4
SECTION 3. EVALUATION PLAN........................................................5
EVALUATION QUESTIONS..................................................................................... 5
EVALUATION DESIGN AND METHODS.....................................................................5
SECTION 3. EVALUATION CROSSWALK.............................................6
SECTION 4. REPORTING PLAN.........................................................6
SECTION 5. DETAILED BUDGET........................................................7
SECTION 6. DETAILED TIMELINE......................................................8
REFERENCES.................................................................................9
APPENDIX A. SMART GIRLS LIFE SKILLS TRAINING PROGRAM LOGIC
MODEL........................................................................................10
Smart Girls Life Skills Training Evaluation 3

Section1.ProgramDescription
TheSmartGirlsLifeSkillsTraining(SGLST)programisasciencebased,teen
pregnancypreventionprogramdevelopedbytheGuilfordCountyDepartmentofPublic
HealthincollaborationwithPlannedParenthoodoftheSouthAtlantic(PPSAT).The
goaloftheprogramistoprovidegirlswiththeinformationandskillsnecessaryforthem
tobecomeSMARTGIRLS,makingSMARTdecisionswhogrowuptobeSMART
womenwhoareultimatelyhappy,healthyandsuccessfulinlife(SmartGirls,2016).
Ultimately,theprogramaimstobuildselfesteemandhealthydecisionmakingtodelay
initiationofsex,increasecondomuseofsexuallyactiveteens,andreducethenumberof
sexualpartnersforthoseteens(OutsideAgencyFundingApplicationPlanned
ParenthoodSouthAtlantic,2015).

Theprogramincludesan8weektrainingcurriculumwithweekly1hourand30minute
meetingsthatcanbeimplementedinavarietyofsettingsincludingcommunityagencies
andyouthgroupswithinfaithbasedinstitutionsandafterschoolprograms.This
curriculumwasdesignedto[encourage]participantstoexploretheirattitudesfeelings
andvaluesaboutselfesteem,relationships,dating,andsexualbehaviortopromote
healthydecisionmaking(SmartGirls,2016).Theprogramawardseachparticipant
witha$50stipendforsuccessfullycompletingthetraining.

ProgramComponents
EnhanceSelfEsteem
SharpenDecisionMakingSkills
SetGoalsfortheFuture
StrengthenFamilyConnections

TargetAudience
SmartGirlstargetaudienceismiddleandhighschoolgirls.Thetrainingalsotargetsthe
parents/guardiansofthegirlswhoareparticipatingintheprogram.Theprogramalso
invitesyoungwomenovertheageofsixteentobecomementorsandfacilitatorsofthe
program.

ProgramLogicModel
TheSmartGirlsprogramlogicmodel(AppendixA)outlinestheresources(inputs),
methods(outputs),andoutcomesoftheprogram.Thelongtermgoalsoftheprogramare
toreduceteenpregnancy,empoweryoungwomen,andincreasegraduationrates.The
moreimmediategoalsoftheprogramfocusonincreasingknowledgeofsexualhealth
andhealthyrelationships,improvingsexualhealthandcommunicationselfefficacy,and
promotingsafersexbehaviors.
Smart Girls Life Skills Training Evaluation 4

PreviousEvaluation(s)
SGLSTwasevaluatedin2003inGreensboro,NCwithanexperimentalandcontrol
groupwhichtotaled854studentsacrossthreetimepointstoassesschangeinsocial
sexualityexpectations,personal/selfsexualityexpectations,perceivedsusceptibilityand
parentandadolescentcommunication(Graves,Sentner,Workman,&Mackey,2011).

TheevaluationfoundthattheSGLSTtrainingwaspartiallyeffectiveatchanging
personal/selfsexualityexpectationsandparentadolescentcommunicationamongmiddle
schoolgirls.Someoftheseconceptsincludedimprovedknowledgeofsexualityand
consequenceofsexualactivity;healthierattitudestowardspostponingsexanduseof
contraception;increaseduseofcontraceptionforthoseparticipantswhoreportedbeing
sexuallyactive;andincreasedcommunicationwithaboutsexuality(GuilfordCounty
Government|SmartGirlsAdolescentPregnancyPreventionPrograms,n.d.)

Section2.ConceptualizationofEvaluation

EvaluationPurpose
ThecorepurposeofthisevaluationistoassesstheimpactandeffectivenessoftheSmart
Girlsprogram.Thisassessmentwillbeguidedbythefollowingbroadquestions:
1) Areparticipantssatisfiedwiththeprogram?
2) Istheprogramachievingitsshort,medium,andlongtermgoals?
3) Areprogramaccomplishmentsworththeinvestedresources?
4) Istheprogramsustainable?

KeyStakeholders
ThekeystakeholdersoftheSmartGirlsprogramincludeprogramparticipants,parents,
volunteers,administrators,andfunders,andcommunitypartners.Tomaintainthe
transparencyandintegrityoftheevaluation,thesekeystakeholderswillbeengaged
throughouttheevaluationprocess.

Assumptions
Itshouldbenotedthatthisevaluationwillconductedwiththefollowingassumptions:
1) Dataforthisevaluationcanbecollectedandmeasured
2) Participantsandotherkeystakeholderswillagreetoparticipateintheevaluation
3) Allstaffwhofacilitatethetrainingsdosoinaconsistentmanner
4) Theprogramlogicmodeliscurrentandreflectiveoftheprogramsinputs,outputs
andoutcomes;theprogramgoalsandobjectivesalignwithitsactivities
5) Enoughgirlsandparents/guardiansarebeingreachedtomakeasignificant
change
Smart Girls Life Skills Training Evaluation 5

ContextualFactors
Demographicsofgirlsbeingtrained(age,ethnicity,familybackground/cultural
influence)
Familydemographic(age,ethnicity,familybackground/culturalinfluence,
income,householdstructure)
Howthefacilitatorsaretrained
Setting
Resourcesthatareavailabletoeffectivelyfacilitatetrainings
Trainingdesign

Section3.EvaluationPlan

EvaluationQuestions
Thisevaluationwilladdressthefollowingspecificquestions,adaptedfromthebroad
questionsmentionedinSection2:
1. Aretheprogramresourcesbeingusedeffectively?
2. Istheprogrammeetingitsshorttermoutcomegoals?
3. Istheprogrammeetingitsmediumandlongtermoutcomegoals?
4. Whataretheunplanned/unforeseenoutcomesoftheprogram?
5. Areparticipantssatisfiedwiththeprogram?

EvaluationDesignandMethods
Theevaluationwillfeaturemultiplemethodsofdatacollectiontogatherinformation
abouttheprogramseffectiveness.

Observationofprogramworkshops
ObservationswillbeconductedattwooftheeightSmartGirlsmeetings.Variablesof
interestfortheseobservationsincludeparticipantinteractionandengagement,facilitator
efficacy,andadherencetotheprogramcurriculum.Eachobservationwillbeconducted
bytwomembersoftheresearchteam.Interraterreliabilitywillbeassessedand
calibratedasneededpriortobeginningtheobservations.

Datafromtheobservationswillbecodedandanalyzedforthemesrelatedto
program/curriculumefficacy,participantperceptions,andevidenceofprogramsuccesses
andfailures.

ParticipantPreandPostCurriculumSurvey
20girlswhoarenewtotheprogramwillberandomlyselectedandrecruitedtotakeone
surveybeforestartingtheprogram,andanotherafterayearofparticipatinginthe
program.Thesurveywillbedesignedtogatherinformationabout1)knowledge,
attitudes,andbehaviorsrelatedtosexualandrelationalhealthand2)expectationsand
perceptionsoftheprogram.
Smart Girls Life Skills Training Evaluation 6

KeyStakeholderInterviews
Keystakeholderinterviewswillbeconductedintheearlymidstagesoftheevaluation.
KeystakeholdersfortheSGLSTprogramincludetheprogramparticipants,parents,
volunteers,administrators,funders,andcommunitypartners.Theseinterview;.//swill
provideinformationthatcanbeusefulinansweringalloftheevaluationquestions.
Althougheachinterviewwillbeuniqueforeachtypeofstakeholder,theywillall
includequestionstargetingexperiencesintheprogram,programsatisfaction,and
perceptionsoftheprogramssuccess.Eachinterviewwillbequalitativelycodedtoform
anarrativeofkeystakeholdersexperienceswithandperceptionsoftheprogram.

InternalDocumentReview
Areviewofinternaldocumentssuchasbudgets,attendancerecords,andsurveys
(feedbackandexitssurveys)willbeconductedforthisevaluation.

Section3.EvaluationCrosswalk

Observation Participant Key Internal

ofprogram PreandPost Stakeholder Document
meetings Curriculum Interviews Review
Surveys

Aretheprogramresources X X X
beingusedeffectively?

Istheprogrammeetingits X X X X
shorttermoutcomegoals?

Istheprogrammeetingits X X X
mediumandlongterm
outcomegoals?

Whatarethe X X X
unplanned/unforeseen
outcomesoftheprogram?

Whatareparticipants X X X
perceptionsofthe
program?

Section4.ReportingPlan
Oncealldataiscollected,evaluatorswillworkcollaborativelywithprogram
implementerstoanalyzeandcombinealldataintoasummaryreportwithinthirtydaysof
theconclusionofdatacollection.Thesummarywillincludeallfindingsaswellas
Smart Girls Life Skills Training Evaluation 7

recommendationsforthefuturetohelpbettertheimplementationprocessofSGLSTand
willbedistributedtokeystakeholders.Tobetterexplainallthefindings,anoraland
visualpresentationofthefindingswillalsobesharedwiththekeystakeholderswithin
thirtydaysofthedistributionofthesummaryreport.Thiswillallowkeystakeholdersto
thoroughlyreviewthereportandcreatequestionsfordiscussionattheoralpresentation.
Smart Girls Life Skills Training Evaluation 8

Section5.DetailedBudget

Section6.DetailedTimeline
Smart Girls Life Skills Training Evaluation 9

Fe Ap Ma Ju Au Se Oc No
Jan Ma Jul Dec
b r y n g p t v
17 r17 17 17
17 17 17 17 17 17 17 17
Identifykey
X
stakeholders
Contactand
schedulekey
X X X
stakeholder
interviews
Interrater
reliabilitywill
X X
beassessedand
determined
Constructionof
preandpost
X X X
surveyfor
particpants
Distributionof
presurveyfor
random X
participantsat
thefirstmeeting
Observationof
twoSmartGirls
meetingsbytwo X X
membersofthe
evaluationteam
Datafrom
observationof
SmartGirls
X X
meetingswillbe
codedand
analyzed
Holdkey
stakeholder X X X X X X X
interviews
Codequalitative
datakey
X X X
stakeholder
interviews
Distributionof
posttestfor
random X
participantsat
thelastmeeting
Codematched X X
preandpost
testfrom
Smart Girls Life Skills Training Evaluation 10

Fe Ap Ma Ju Au Se Oc No
Jan Ma Jul Dec
b r y n g p t v
17 r17 17 17
17 17 17 17 17 17 17 17
participants
about
curriculum
Internalreview
ofalldata X
collected
Constructionof
executive X X
summary
Reviewand
finalizationof
X X
executive
summary
Constructionof
feedback/exit X
surveys
Distributionof
executive
X
summarytokey
stakeholders
Summary
X
presentation
Distributionof
feedback/exit X
survey

References
Graves,K.N.,Sentner,A.,Workman,J.,&Mackey,W.(2011).BuildingPositiveLife

SkillstheSmartGirlsWay:EvaluationofaSchoolBasedSexualResponsibility

ProgramforAdolescentGirls.HealthPromotionPractice,12(3),463471.

https://doi.org/10.1177/1524839910370420

GuilfordCountyGovernment|SmartGirlsAdolescentPregnancyPreventionPrograms.

(n.d.).Retrievedfromhttp://www.myguilford.com/humanservices/health/health
Smart Girls Life Skills Training Evaluation 11

andwellness/healtheducationandtraining2/teenpregnancyprevention/smart

girlsadolescentpregnancypreventionprograms/

JustforGirls|SmartGirl.(n.d.).Retrievedfromhttp://www.smartgirl.org/kidsarea/

OutsideAgencyFundingApplicationPlannedParenthoodSouthAtlantic.(2015,

January23).Retrievedfrom

http://www.orangecountync.gov/document_center/Health/Planned_Parenthood.pdf

SmartGirls:SouthAtlantic.(2016).RetrievedNovember1,2016,from

https://www.plannedparenthood.org/plannedparenthoodsouthatlantic/education

andtraining/smartgirls

AppendixA.SmartGirlsLifeSkillsTrainingProgramLogic
Model
Inputs Outputs O

Whatweinvest Whatwedo Whoweserve ShortTerm Med

YoungWomen Knowledge Beha

Dedicatedandcreative SmartGirlsLifeSkills 1125years Increasedknowledgeof Post
staff Training reproductivehealth(STI, inter
contraception,pregnancy)
Countyfundingand Youth1116 Redu
operatingsupport Middle/HighSchool Increasedknowledgeofhealthy partn
Curriculum Parents relationships(e.g.,dating
Grantfunding violence/assault,coercion,sexual Incre
assertiveness) cond
Smart Girls Life Skills Training Evaluation 12

Schoolandcommunity ParentInvolvement cont

accessandlogistical SmartParents Attitudes activ
support GirlsDayOut Increasedempowerment,self
Homework esteemandconfidence Incre
Volunteers conn
Increasedabilitytomakehealthy
Teeninvolvement decisions
TeenLeadership
Parentalinvolvement SmartGirlsLeadership Positiveattitudesaboutpostponing
Academy sex

Positiveattitudesaboutusing
contraceptionifsexuallyactive

Behaviors
Increasedparentyouth
communication

Increasedbehavioralintentionto
postponesex,orifsexuallyactive,
utilizationofcondomsand/orbirth
control