Академический Документы
Профессиональный Документы
Культура Документы
An Integrative Review of Flipped Classroom Teaching Models in Nursing
Education
PII: S8755-7223(16)30084-9
DOI: doi: 10.1016/j.profnurs.2016.07.001
Reference: YJPNU 997
Please cite this article as: Njie-Carr, V.P.S., Ludeman, E., Lee, M.C., Dordunoo,
D., Trocky, N.M. & Jenkins, L.S., An Integrative Review of Flipped Classroom
Teaching Models in Nursing Education, Journal of Professional Nursing (2016), doi:
10.1016/j.profnurs.2016.07.001
This is a PDF file of an unedited manuscript that has been accepted for publication.
As a service to our customers we are providing this early version of the manuscript.
The manuscript will undergo copyediting, typesetting, and review of the resulting proof
before it is published in its final form. Please note that during the production process
errors may be discovered which could affect the content, and all legal disclaimers that
apply to the journal pertain.
ACCEPTED MANUSCRIPT
T
Corresponding author
P
RI
Assistant Professor
SC
Baltimore, MD 21201
NU
USA
Njie-carr@son.umaryland.edu
MA
410-706-4808
Assistant Professor
AC
Assistant Professor
Assistant Professor
Professor
Conflict of Interest:
T
The authors declare no conflict of interest.
P
RI
SC
NU
MA
ED
PT
CE
AC
ACCEPTED MANUSCRIPT
Highlights
T
Rigorous studies are needed that are focused on flipped classroom models in nursing
P
RI
Lessons learned from other disciplines can be integrated to inform implementation
SC
Studies are needed to determine long-term effects in clinical performance
NU
MA
ED
PT
CE
AC
ACCEPTED MANUSCRIPT
T
Abstract
P
RI
Nursing care is changing dramatically given the need for students to address complex and
SC
from didactic instruction to make important clinical decisions for optimal patient care. To
NU
optimize nursing education pedagogy, innovative teaching strategies are required to prepare
future nurses for practice. This integrative review synthesized the state of the science on flipped
MA
classroom models from 13 empirical studies published through May 2016. The purpose of the
review was to evaluate studies conducted on flipped classroom models among nursing students
ED
using a validated framework by Whittemore and Knafl. Multiple academic databases were
PT
searched, ranging in scope including PubMed, Embase (Elsevier), CINAHL (Ebsco), Scopus,
Web of Science and Google Scholar, resulting in 95 unique records. After screening and full-
CE
text reviews, 82 papers were removed. Thirteen empirical studies were included in the final
AC
analysis and results provided: (a) design and process information on flipped classroom models in
nursing education; (b) a summary of the state of the evidence to inform the implementation of
flipped classrooms; and (c) a foundation to build future research in this area of nursing
education. To develop sound evidence-based teaching strategies, rigorous scientific methods are
Index words: Flipped classroom; integrative review; nursing education; nursing students;
teaching models
ACCEPTED MANUSCRIPT
Problem Identification
Introduction
T
To address the problems of complex patients with multiple comorbidities, nursing
P
RI
students must be better prepared for clinical practice with emphasis on developing critical
thinking skills to make sound clinical decisions (Dalton, 2015; Missildine et al., 2013) as
SC
identified in national and international studies (Dalton, 2015; Hanson, 2016; Missildine et al.
NU
2013; Yacout & Shosha, 2016). Students struggle with applying knowledge to meet the unique
needs of the patient populations they encounter. Additionally, nurse educators grapple with
MA
content-laden courses (Giddens & Brady, 2007) and leveraging teaching strategies to help bridge
the education-practice gap by balancing didactic experiences with interactive classroom activities
ED
while maintaining quality instruction for students (Central, 2004; Mackintosh-Frankin, 2016).
PT
To address this gap, new innovative teaching strategies are critical to integrate in nursing
education. The flipped classroom is an evolving pedagogy with opportunities to bridge the
CE
education-practice gap in nursing education and move nursing closer to achieving the
AC
recommendations outlined in the most recent Institute of Medicine report of 2010 (IOM, 2010).
Background
learning strategies in nursing education that would address the recommendations in the IOM
report. While maintaining quality pedagogy, nursing educators leverage teaching strategies to
address the complex and multiple needs of patients that students encounter in clinical practice.
Important social changes are complicated by competing technologies, and the diversity of the
nursing students who are expected to smoothly transition to the new graduate role after
completing the nursing program. Ensuring that graduates are fully prepared to meet workplace
ACCEPTED MANUSCRIPT
requirements is critical to the nursing profession and most importantly to the safety and optimal
health of patients.
T
These challenges provide educators with opportunities to evaluate current teaching and
P
RI
learning practices and make the necessary modifications to reflect evidence-based practices to
optimize student outcomes and smooth new graduate transitions to practice settings. To address
SC
this growing issue, educators have adapted multiple teaching strategies including simulation
NU
experiences for students (Dalton, 2015). Another evolving pedagogy is the flipped classroom
teaching approach (Bergmann & Sams, 2012). Though nursing educators have interspersed
MA
strategies such as case studies, concept maps, games, and discussion groups in didactic
instruction, these strategies have been limited in methods used to implement them. For example,
ED
as new strategies were implemented, educators failed to remove extra content from curricula
PT
(Giddens & Brady, 2007; Mattis, 2014), which increased the workload for students and limited
the impact the new strategies may have on student outcomes such as increased course
CE
The flipped classroom model has been extensively used in other disciplines with positive
student outcomes (Mattis, 2014; McLaughlin et al., 2013; Moffett & Mill, 2014; Schultz,
Duffield, Rasmussen, & Wageman, 2014; Simonson, 2014; Simpson & Richards, 2015; Tune,
Sturek, & Basile, 2013). This relatively new pedagogy was first conceptualized by science
teachers in 2006 (Bergmann & Sams, 2012). A “pure” flipped classroom has two major
components: (a) a pre-class individual instruction that is often technology-based and allows
students to learn content, complete readings, view pre-recorded lectures in the form of web cast
videos, and/or narrated power point slides, podcasts, and interactive videos; and to complete
quizzes and module assignments before class; and (b) in-class group interactive activities that are
ACCEPTED MANUSCRIPT
focused on empowering students to apply content by interacting and exchanging ideas through
multiple modalities (Bergmann & Sams, 2012). Different terminology is used to conceptualize
T
flipped classrooms. For example, “active learning,” “inverted classrooms, “team-based
P
learning,” problem-based learning,” etc. (Della Ratta, 2015; Elliott, 2014; Simonson, 2014;
RI
Waltz, Jenkins, & Han, 2014). Bergman and Sams define flipped classroom as, “…that which is
SC
traditionally done in class is now done at home, and that which is traditionally done as
NU
homework is now completed in class” p. 13 (Bergmann & Sams, 2012; Davies, Dean, & Ball,
2013).
MA
A flipped classroom model integrates collaboration, active learning, and team-based
learning, which are important strategies for providing students with the necessary skills and
ED
McKnight, McKnight, & Arfstrom, 2013). In addition, it prepares students to be active, self-
directed learners and to help them develop higher level thinking skills through efficient
CE
processing of knowledge gained (Bergmann & Sams, 2012; Della Ratta, 2015; Mason, Shuman,
AC
& Cook, 2013). The flipped classroom approach has been demonstrated using different models,
across disciplines and across educational levels. However, there have been few studies of
flipped classroom models in its “pure” form investigating its usefulness and effectiveness on
student outcomes. This limitation was found when O’Flaherty and Phillips conducted a scoping
review on the use of flipped classroom approaches in higher education (O'Flaherty & Phillips,
2015) further underscoring the need for more rigorous research methods on flipped classroom
pedagogy. Additionally, other nurse scholars have conducted different reviews to address
flipped classroom models in nursing education and found similar results of limited robust
research methods, limited improvement in student exam scores, and conflicting results on student
ACCEPTED MANUSCRIPT
dissatisfaction with teaching strategy (Betihavas, Bridgman, Kornhaber, & Cross, 2016; Presti,
2016).
T
The purpose of this integrative review was to evaluate the state of nursing science on
P
RI
flipped classroom models among nursing students to inform the role of nurse educators. This
review focuses on national and international nursing studies conducted on flipped classroom
SC
models through May 2016 and contributes to this evolving pedagogy by reporting findings and
NU
providing nurse educators and researchers with an evidence-based foundation to develop and
nursing and the diversity of research methods, an integrative review is considered the best
PT
approach. Whittemore and Knafl (2005) suggest that an integrative review method is appropriate
when diverse methodologies are included to ensure comprehensive representation and unbiased
CE
authors posit that in providing researchers and practitioners with best evidence, it is critical that
all methodologies be included and to conduct a quality, unbiased review of research studies.
Their framework was used to guide this integrated review process and report findings on flipped
classroom models in nursing education by using the four components: (a) problem identification;
(b) literature search; (c) data evaluation; (d) data analysis; and (e) presentation. The first step,
problem identification, was addressed in a previous section. The sections below describe the
Literature Search
T
To ensure a thorough and comprehensive review of the literature, search strategies were
P
RI
developed in collaboration with a research librarian and included terms comprised of the
concepts of flipped classrooms and nursing education. The two research questions posed were:
SC
“Do flipped classroom teaching strategies influence student satisfaction and outcomes in nursing
NU
courses? What is the effect of flipped classroom approaches on nursing student satisfaction and
course outcomes? In anticipation of a scarcity of literature on this topic, several databases were
MA
searched including PubMed, Embase (Elsevier), CINAHL (Ebsco), Scopus, Web of Science and
Google Scholar through May 2016. No date restrictions were applied. Authors hand searched
ED
selected journals and checked the reference lists of relevant articles. Please see Appendix A for
PT
The literature screening was conducted in two phases to assess the relevance of studies
AC
identified during the literature search. First, titles and abstracts of papers were reviewed that
included nursing students. Second, full-text papers were reviewed in-depth. Papers were
excluded if they were: (a) not empirical studies, (b) written in a language other than English, (c)
dissertation papers, (d) conference abstracts, or (e) conducted with students in disciplines other
than nursing.
Data Evaluation
The titles and abstracts of 95 papers were evaluated for relevance. The review identified
varied types of publications such as books, reports, empirical studies, news reports, conference
reviewed the abstracts of each paper at least once. A full-text review of 20 papers was conducted
to determine if they were empirical studies. Seven were methods papers and were removed.
PT
Another in-depth, full-text review was conducted on the final 13 studies that were included in the
analysis. Figure 1 provides a flow chart illustrating our search strategy and output.
RI
SC
Records identified through Additional records identified
database searching (N =136) through other sources (n = 41)
NU
MA
Records after duplicates removed
(n = 95)
ED
PT
Full-text
text articles assessed Full-text articles excluded
for eligibility (n = 7)
(n = 20) - Not research studies
Four studies were quasi- or experimental designs, five were descriptive (quantitative or
qualitative), and four were mixed methods study designs. Studies were evaluated for quality and
T
rigor by using two items (#1 and #6) from the Health Evidence Quality Assessment Tool
P
RI
(HEQAT) for review articles (Health Evidence Assessment Tool, 2013). The HEQAT is short
and easy to use. It is designed for evaluation of systematic review articles, so for this reason it
SC
was modified by removing the items that were not appropriate for individual studies (#2-5 and
NU
#7-10). The total scores from the two items used ranged from 1-8; the higher the score, the
better the quality of study. Reliability and validity of the tool was not assessed in this process
MA
and is recognized as a potential limitation. Table 1 provides results from the evaluation of
www.healthevidence.org
Quantitative 6
T
of a flipped classroom approach to increase
P
understanding of drug science and its
RI
application to clinical practice.
SC
Harrington et al. (2015). Quantitative outcomes Experimental 5.5
for nursing students in a flipped classroom
2013
T
Burden et al. (2015). Flipping the Classroom: Qualitative 2
P
Strategies for Psychiatric-Mental Health
Course 2015
RI
SC
* Possible range of scores of 0-8
NU
Data Analysis
MA
The data analysis phase of the integrated review (Whittemore & Knafl, 2005), included
the following recommended steps: (a) data reduction; (b) data display; (c) data comparison; and
ED
(e) conclusion drawing and verification. This approach is systematic and rigorous to eliminate
risk of bias by inadvertently removing or including studies from the analysis. Having four
PT
authors independently conduct the literature search and review supported validation of the
CE
Data Reduction
For the identification step, see figure 1. The full-text versions of the remaining 13
empirical studies were reviewed and included in the final analysis and report of findings.
Data Display
To further maintain optimal and quality reporting, the approach suggested by the
Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was used to
present an illustration of the search strategy and process (Moher et al., 2015) (See Figure 1).
Key study components were compared across the 13 studies that include author and year of
ACCEPTED MANUSCRIPT
publication, study purpose, study design and setting, sample, course, and program flipped
P T
RI
SC
NU
MA
ED
PT
CE
AC
ACCEPTED MANUSCRIPT
T
Setting Sample/course Classroom
P
/Program Teaching
Intervention
RI
Model
Burden et al. To describe the Qualitative / USA 359 students in Four hour Analyzed reflective journal
(2015) strategies used in psychiatric sessions entry by students
SC
a flipped mental health Pre-class Themes identified include:
classroom course. folder: Work Students - helpfulness of
model, student Over 2 years sheets and pre-class modules, in-depth
perceptions and (BS) assignment information covered in
NU
implications for guidelines; class; satisfaction.
nursing textbook Faculty - active student
education. assigned engagement, better
readings; communication with
MA
youTube patients, and less anxiety
patient case and increased self-
study; graded confidence in clinical
ticket
ED
worksheet;
view web site
In-class folder:
Concept map
PT
on white
boards; small
assigned group
CE
work; role
plays; short
skits
Wisdom tip
AC
folder: Power
point
presentations;
youTube video
clips; podcasts
with
worksheets;
crossword
puzzles
Choi et al. To revise the Mixed methods / 75 students in Pre-class: Quantitative
(2015) existing English- Seoul, Korea 15 week Pre-recorded 97% viewed pre-recoded
medium English- lectures; group videos.
instruction medium project Students accepted and
nursing course instruction (analysis of favored the flipped
using; explore nursing course movies or classroom model; enhanced
students’ (BS) dramas using 4 understanding of content;
learning nursing meta- motivated students.
experiences and paradigms); Qualitative:
acceptance of health Major themes were –
flipped promotion benefits if flipped course;
ACCEPTED MANUSCRIPT
T
model. course site
In-class hours:
P
interactive and
creative
RI
learning
activities;
SC
critical
thinking
activities;
group
NU
discussions;
real-time polls
Critz et al. To explore Mixed methods / 20 students in Pre-class: 11 Content - 60% felt the
(2013) student course USA graduate pre-class material covered was
MA
satisfaction pediatric modules; pre- extremely worthwhile; 40%
course. recorded felt it was very worthwhile.
Over 2 power point Students reported that
semesters lecture videos current, evidence-based
(MS) (20 – 40 articles were useful.
ED
T
semesters Pre-test
(BS) HESI mid-
P
curricular test
to measure
RI
aptitude/ability
before taking
SC
course.
HESI scores
provide a
standardized
NU
national
performance
scale, which
was used as a
MA
covariate.
Harmon et al. To evaluate the Quasi- 347 students in Control Significant differences in
(2015) effect of team- experimental – the 4th year group test scores between the
based learning uncontrolled undergraduate Traditional groups (p <.001).
on course before and after psychiatric lecture-based Students enjoyed the change
outcomes. design / USA mental health. format with in course pace; like the
over 4 med-term & quizzes each week; quizzes
semesters final exams shifted emphasis from
(2010-2012). Intervention cramming to applying”
group
174 students in Intervention
the control program with
group & 173 educational
students in the package to
intervention access online
group case studies &
(BS) specialty
testing.
Team
assignments
and team
ACCEPTED MANUSCRIPT
quizzes
through the
Readiness
Assurance
T
Process; role
plays, online
P
case studies
using QSEN,
RI
Evolve, and
web info;
SC
shared
accountability
for team
assignments
NU
Harrington et al. To objectively Experimental / 82 students in Control Test scores and course
(2015) compare USA medical group outcomes
learning surgical Weekly online No significant differences
MA
outcomes of two nursing theory just-in-time found between the
pedagogies as course. quizzes, class traditional and flipped
measured Over 1 with minimum classroom groups:
quantitatively semester (BS) activities Wilks lambda = 0.851, p =
through exam Treatment .057 (p.180).
ED
quizzes
Pre-class
preparation
CE
activities.
Reminders to
complete
online
T
questionnaire
Missildine et al. To determine the Quasi- 445 students Comparison of Academic success and
P
(2013) effects of a experimental / (75.55% 3 learning course satisfaction
flipped USA response rate) approaches. Students in the flipped
RI
classroom and in 3 adult Traditional classroom scored higher on
innovative health courses. lecture exams; students were less
SC
learning Over 3 Lecture and satisfied with the flipped
activities on semesters lecture capture than other methods.
academic (BS) back-up
success and the Innovative
NU
satisfaction of classroom
nursing students. activities
course site;
printed outline
of lecture
content used in
the traditional
class was
provided to
guide note
taking.
In-class: active
learning
experiences;
calling on
students to
determine
understanding
Post et al. To explore Qualitative 18 students in Pre-class: pre- Focus Group Interview data:
(2015) student phenomenological medical- recorded Four major themes were
experiences of / USA surgical lecture videos identified from student data:
ACCEPTED MANUSCRIPT
T
(BS) activities, learning approach
question and 2. Disconnect-
P
answer decrease time with
sessions instructors, hard to
RI
set priorities
3. Depersonalization-
SC
video lectures not
helpful to some
students,
technology naive
NU
4. Time- time
management was
difficult, increase
workload
MA
Simpson et al. To increase the Descriptive & 29 third year Pre-class: Quantitative:
(2015) relevance of exploratory /USA students in a Voice-over No statistical differences
population population power point, between the two groups.
ED
quiz Themes:
In-Class: Student engagement;
random flexibility in learning;
assignment to student ownership of
groups for learning.
assignments; Faculty thought students
interactions had better grasp of content
using white & focused more on acute
boards; care and not community
computer setting.
access; case
studies; web
quests; videos;
and group
developed
presentations
T
classroom 2015-2016. In-Class: preferred the traditional
educational (BS) group method; 35.6% preferred the
P
strategy assignment flipped classroom;
with practice Significant differences
RI
problems observed between students‟
gender, age, residence and
SC
last academic achievement
(p < .05);
Stated, "facilitate
understanding topic; give
NU
ideas about class activities;
& increased retention of
information; "need extra
time to watch; no possibility
MA
of immediate feedback
during watching videos;
flipped classrooms cannot
be applied in all nursing
courses".
ED
Of the 13 empirical studies using a flipped classroom model with nursing students, 11
were conducted with undergraduate BSN students (Burden et al., 2015; Choi et al., 2015; Della
Ratta, 2015; Geist et al., 2015; Harmon & Hills, 2015; Harrington et al. 2015; Mikkelsen, 2015;
Missildine et al., 2013; Post et al., 2015; Simpson & Richards, 2015; Yacout & Shosha, 2016 ).
There was one study with associate degree nursing students (Pence, 2016) and another with
graduate nursing students (Critz & Knight, 2013). Content areas ranged from graduate pediatrics
(Critz & Knight, 2013), adult health (Harrington et al., 2015; Missildine et al., 2013; Post et al.,
2015), pharmacology (Geist et al., 2015; Hanson, 2016), anatomy and physiology (Mikkelsen,
ACCEPTED MANUSCRIPT
2015), psychiatric mental health (Burden et al., 2015; Harmon & Hills, 2015), maternal and child
health (Yacout & Shosha, 2016), and population health (Simpson et al. 2015).
P T
One study (Harrington et al., 2015) used an experimental study design; three (Geist et al.,
RI
2015; Harmon & Hills, 2015; Missildine et al., 2013) used a quasi-experimental design. In
SC
addition, five studies used descriptive (quantitative and/or qualitative) designs (Burden et al.,
2015; Pence, 2016; Post et al., 2015; Simpson & Richards, 2015; Yacout & Shosha, 2016), and
NU
four were mixed methods (Choi, 2015; Critz & Knight, 2013; Hanson, 2016; Mikkelsen, 2015).
MA
Most of the studies lacked statistical power and used descriptive statistics to analyze study data.
The descriptive study designs focused on student satisfaction, students’ perception of the
ED
duration of the pre-class lecture recordings, and other process-related instructional activity
outcomes (Burden et al., 2015; Critz & Knight, 2013; Post et al., 2015). Across studies that
PT
evaluated outcome measures, the flipped classroom group had higher mean exam scores than the
CE
comparison group (Geist et al., 2015; Missildine et al., 2013; Yacout & Shosha, 2016); while
others failed to find a statistical difference (Harmon & Hills, 2015; Simpson & Richards, 2015).
AC
However, there were mixed results related to student satisfaction. In addition, one study failed to
find differences between the flipped and traditional methods (Simpson & Richards, 2015), which
could be attributed to the small sample size (N = 29). One unusual finding found in this
integrative review was a flipped classroom model that was implemented because administrators
at the institution had a partnership with an industry and they were conducting studies to
determine the effect of space, technology, and pedagogy on student teaching (Burden et al.,
2015). The school of nursing at this institution was selected to participate in the flipped
Improvement in students’ course grades and student satisfaction were outcome measures
across the studies (Critz & Knight, 2013; Harmon & Hills, 2015; Harrington et al., 2015). Most
T
of the studies reported the need for more time for faculty to dedicate on course content, videos,
P
RI
and other course-related activities. The studies also reported the need for more technological
support. Additionally, student preparation before class was identified as an important component
SC
and key to the success of the flipped classroom pedagogical approach. Authors reported that
NU
often times some students were not adequately prepared before class, which led to student
dissatisfaction and frustration (Critz & Knight, 2013; Post et al., 2015). Overall, there were vast
MA
differences in how the flipped classroom was implemented across the studies (see Table 2).
ED
The quest for innovative teaching strategies to better prepare nursing graduates continues
PT
with some educators implementing flipped classroom models. Nurse educators are increasingly
CE
conducting research studies to investigate the use and effectiveness of flipped classroom models
on student performance and course satisfaction. Yet, evidence explicating how this pedagogy
AC
prepares students to transition into their new roles after graduation is limited. Few studies were
found assessing the integration of the flipped classroom in nursing courses. Effective flipped
classroom models could propagate collaborative learning, team-work, active participation in the
learning process, and improve critical thinking and decision-making skills for optimal patient
critical to ensure that research studies are conducted using rigorous scientific methods.
ACCEPTED MANUSCRIPT
The limited number of rigorous experimental studies employing control groups for
T
comparison is significant and has gained the attention of educators within and outside of nursing
P
RI
(Betihavas et al., 2016; Mikkelsen, 2015; O'Flaherty & Phillips, 2015; Presti, 2016). Perhaps the
focus of these research studies was on flipped classroom methodology and process and not
SC
scientific design. Nonetheless, the context of the papers could have been more clearly explicated
NU
in the reports. Robust scientific rigor could provide guidance on frameworks for content areas,
pre, and in-class activities. Additionally, rigorous methodologies could inform the appropriate
MA
course level(s) to implement flipped classroom models and the types of courses that are most
amenable to this pedagogy. Importantly, the use of robust research methods in implementing
ED
flipped classrooms could also increase validity for specific methods and frameworks to guide
PT
consistent and strong comparisons across interventions. This will allow educators to apply and
replicate studies with confidence in the context of educational systems. Other papers on flipped
CE
classroom pedagogy were found that focused solely on methodology and the report of findings
AC
(Best et al., 2014; Dalton, 2015; Della Ratta, 2015; Elliott, 2014; Schlairet, Green, & Benton,
One of the biggest challenges encountered during the review was the variation in which
educators conceptualized and operationalized the flipped classroom model. Some study
findings were more clearly explicated than others. No two models were similar making it
difficult to compare, replicate findings, or validate certain components of the model. The
pre-class and in-class activities to poorly developed activities that were not well developed or
ACCEPTED MANUSCRIPT
explicated. In some cases, very limited information was provided on the pre and in-class
activities used for the intervention. Some authors accorded students course credit for up to 60%
T
of the course grade for pre-class activities, motivating them to complete and prepare for class
P
RI
discussions (Critz & Knight, 2013; Harmon & Hills, 2015; Harrington et al., 2015). Students
were sometimes asked to spend a “minimum of 10 hours” (p. 210) on pre-class activities (Critz
SC
& Knight, 2013), but it was unclear if this was over the course of the semester or a week.
NU
Important variations in operationalizing outcomes were related to course satisfaction
outcomes, the components of the flipped classroom such as the length of the videos if used, and
MA
what constituted a reasonable timeframe for pre-class activities. Some of the authors developed
their own online or paper surveys to ask questions related to quality and quantity of content and
ED
process information related to how the flipped classroom model was implemented (Critz &
PT
Knight, 2013; Hanson, 2016; Mikkelsen, 2015; Pence, 2016; Schwartz, 2014). Other authors
used qualitative data or exam scores for outcome measures for satisfaction and course
CE
performance (Burden et al., 2015; Harrington et al., 2015; Post et al., 2015). Authors did not
AC
share course implementation challenges that might have occurred. For example, it was unclear if
teaching the courses was also the researcher. Only two studies addressed attrition rate (Hanson,
2016; Mikkelsen, 2015). It is interesting to note that the study with the highest quality score in
this review (Post et al., 2015) reported that students responded negatively to the flipped
In nursing education, the pure flipped classroom appears to be variable at best in the
United States and international contexts. Perhaps this makes sense in the context of nursing
education pedagogy because instructors must select appropriate teaching and learning strategies
ACCEPTED MANUSCRIPT
that meet the needs of the students to achieve the intended course outcomes. So a viable
question worth pursuing is, how best can the evidence in the area of flipped classroom pedagogy
T
in nursing education be built? If indeed flipped classroom approaches are strategically tailored
P
RI
to the learners, they will be highly variable. Thus, future reviews reporting impact on variables
such as student satisfaction with the course and improved grades, will remain challenging to
SC
review and interpret, but enhanced study rigor can be a step in the right direction.
NU
Building the foundation for best practice evidence and developing sound pedagogy
foundation to inform future studies. In five studies, the flipped classroom encouraged active
ED
satisfaction (Burden et al., 2015; Critz & Knight, 2013; Geist et al., 2015; Harmon & Hills, 2015;
Pence, 2016). Two studies noted improvement in clinical outcomes through increased self-
CE
confidence and patient interactions (Burden et al., 2015; Yacout & Shosha, 2016). However,
AC
students were not always satisfied and did express concerns such as the increase in amount of
work, a perception of distancing from the instructors, and being unable to manage their time.
Additionally, few of the studies addressed how students were prepared by faculty for the flipped
classroom experience.
for students to engage in active, team-based, and collaborative, problem-based activities. The
strategies used in flipped classroom pedagogy could help support nursing students in making
sound and accurate clinical decisions related to scenarios similar to those encountered in
ACCEPTED MANUSCRIPT
practice. However, studies that are more robust are needed in this area of nursing education
research. In addition, it is important to consider critical student and faculty related factors that
T
might facilitate or impede implementation of flipped classroom models. Unless these factors are
P
RI
addressed in robust research designs, flipped classroom models will continue to be implemented
on a trial and error basis at best. From this integrative review, authors have observed a trend
SC
towards more rigorous research of flipped classroom and presentation of study findings with
NU
recent publications demonstrating the growth of evidence in this area. On the student side, major
student-related factors were identified including the time involved in pre-class assignments;
MA
length of videos and other media; and internet access. Faculty-related factors include workload
needed to dedicate time for the development of a flipped classroom course; incorporating
ED
different student learning styles in activities, and increased technology support for faculty.
PT
educators can use the framework as a model to implement flipped classroom approaches. There
CE
is a need for rigorous research studies to address operationalizing pre- and in-class activities, and
AC
type of content and level of students that might be best amenable to this pedagogy. Other health
models. Nursing educators could integrate lessons learned in their work making sure
components are appropriate in the context of nursing education. There is need to investigate
faculty workload issues and how those would impact implementation of flipped classroom
models. Most importantly, research studies are needed to determine how flipped classroom
models will influence student performance in clinical judgment and decision-making skills
months after they complete the flipped classroom course. This point is critical and remains a gap
given the rationale provided for implementing flipped classroom models in the studies reviewed.
ACCEPTED MANUSCRIPT
Nursing educators could then translate these models in more strategic ways to transform the
T
duplicate and unnecessary course content to accommodate this innovative pedagogy to best
P
RI
prepare graduate nurses with the skill set they need to be effective and transformative
professionals.
SC
Conclusions
NU
Nurse educators are interested in integrating evidence-based pedagogy through the
curricula as a means to better prepare the next generation of nursing students. The flipped
MA
classroom model has gained in popularity and as a result, research on the impact of the flipped
classroom model on student exam scores, course performance, and satisfaction is evident.
ED
However, results are mixed, derived from primarily non-experimental studies, employing various
PT
methods to implement within the classroom, and examining a variety of outcomes (e.g., a single
exam score or a course grade). This integrative review summarizes, critiques, and analyzes
CE
previously conducted research studies examining the impact of the flipped classroom model
AC
integrated into nursing education. Even though there is progress in the scientific rigor of the
studies evaluated, there is a need for more robust research methods with adequate sample sizes to
advance the evidence that the flipped classroom model is effective in preparing future nurses to
Acknowledgements
Funding:
T
“This research did not receive any specific grant from funding agencies in the public,
P
commercial, or not-for-profit sectors.”
RI
SC
NU
MA
ED
PT
CE
AC
ACCEPTED MANUSCRIPT
References
American Association of the Colleges of Nursing (AACN). (2011). Core competencies for inter-
T
professional collaborative practice: Report of an expert panel. Washington, DC: Inter-
P
RI
professional Education Collaborative.
Bergmann, J., & Sams, A. (2012). Flip your classroom: Reach every student in every class every
SC
day. Eugene, Oregon: International Society for Technology in Education.
NU
Best, D., Naber, J. (2016). Is a flipped classroom an effective educational method to meet
Betihavas, V., Bridgman, H., Kornhaber, R., & Cross, M. (2016). The evidence for 'flipping
ED
Brooks, B. A (2015). An emerging role: the nurse content curator. Nursing forum, 50(1). 51-54.
CE
Burden, M. L., Carlton, K. H., Siktberg, L., & Pavlechko, G. (2015). Flipping the classroom:
AC
doi:10.1097/NNE.0000000000000162
Central, P. (2004). Does active learning work? A Review of the Research, 93, 223-231.
Choi, H., Kim, J., Bang, K., Park, Y., Lee, N., & Kim, C. (2015). Applying the flipped learning
Critz, C., M., & Knight, D. (2013). Using the flipped classroom in graduate nursing education.
Dalton, L., Levett, T., & Gee, T. (2016). Using clinical reasoning and simulation-based
ACCEPTED MANUSCRIPT
education to ‘flip’ the Enrolled Nurse curriculum. Australian Journal of Advanced Nursing,
33(2), 28 - 34.
T
Davies, R. S., Dean, D. L., & Ball, N. (2013). Flipping the classroom and instructional
P
RI
technology integration in a college-level information systems spreadsheet course.
SC
013-9305-6
NU
Della Ratta, C. B. (2015). Flipping the classroom with team-based learning in undergraduate
about communicable disease control and community health nursing. Journal of Nursing
ED
Geist, M., J., Larimore, D., Rawiszer, H., & Al Sager, A. W. (2015). Flipped versus traditional
Gilboy, M. B., Heinerichs, S., & Pazzaglia, G. (2015). Enhancing student engagement using the
flipped classroom. Journal of Nutrition Education & Behavior, 47(1), 109-114. Retrieved
from
http://search.ebscohost.com/login.aspx?direct=true&db=sph&AN=100703544&site=ehost-
live
Hanson, J. (2016). Surveying the experiences and perceptions of undergraduate nursing students
http://dx.doi.org/10.1016/j.nepr.2015.09.001
ACCEPTED MANUSCRIPT
Hamdan, N., McKnight, P., McKnight, K., & Arfstrom, K. (2013). A review of flipped learning.
T
Harmon, R., & Hills, R. (2015). Transforming psychiatric, mental health nursing with team
P
RI
based learning. Archives of Psychiatric Nursing, 29, 413-418.
http://dx.doi.org/10.1016/j.apnu.2015.06.014
SC
Harrington, S., Ann, Vanden Bosch, M., Schoofs, N., Beel-Bates, C., & Anderson, K. (2015).
NU
Quantitative outcomes for nursing students in a flipped classroom. Nursing Education
http://www.healthevidence.org/documents/our-appraisal-
ED
tools/QA_tool&dictionary_18.Mar.2013.pdf
PT
Hessler, K. L. (2016). Nursing education: Flipping the classroom. The Nurse practitioner, 41(2),
17.
CE
Institute of Medicine of the National Academies. (2010). The future of nursing: focus on nursing
AC
https://www.nationalacademies.org/hmd/~/media/Files/Report%20Files/2010/The-Future-
of-Nursing/Nursing%20Education%202010%20Brief.pdf
Koo, C., Demps, E., Farris, C., Bowman, J., Panahi, L., & Boyle, P. (2016). Impact of a flipped
Liebert, C., Lin, D., Mazer, L., Bereknyei, S., & Lau, J. (2016). Effectiveness of the surgery
core clerkship flipped classroom: a prospective cohort trial. American Journal of Surgery,
T
http://doi.org/10.1016/j.nedt.2016.02.015
P
RI
Mason, G. S., Shuman, T. R., & Cook, K. E. (2013). Comparing the effectiveness of an inverted
SC
Transactions on Education, 56(4), 430-435. doi:10.1109/TE.2013.2249066
NU
Mattis, K. V. (2015). Flipped classroom versus traditional textbook instruction: Assessing
McLaughlin, J. E., Griffin, L. M., Esserman, D. A., Davidson, C. A., Glatt, D. M., Roth, M. T.,
ED
Retrieved from
CE
http://search.ebscohost.com/login.aspx?direct=true&db=aph&AN=98951750&site=ehost-
AC
live
classroom anatomy and physiology course. Journal of Nursing Education and Practice,
Missildine, K., Fountain, R., Summers, L., & Gosselin, K. (2013). Flipping the classroom to
improve student performance and satisfaction. Journal of Nursing Education, 52(10), 597-
599. doi:10.3928/01484834-20130919-03
ACCEPTED MANUSCRIPT
Moffett, J., & Mill, A. C. (2014). Evaluation of the flipped classroom approach in a veterinary
T
doi:10.2147/AMEP.S70160
P
RI
Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., . . . PRISMA-P
Group. (2015). Preferred reporting items for systematic review and meta-analysis protocols
SC
(PRISMA-P) 2015 statement. Systematic Reviews, 4, 1-4053-4-1. doi:10.1186/2046-4053-
NU
4-1
O'Flaherty, J., & Phillips, C. (2015). The use of flipped classrooms in higher education: A
MA
scoping review. The Internet and Higher Education, 25, 85-95.
http://dx.doi.org/10.1016/j.iheduc.2015.02.002
ED
course: A 2-year pilot study. Teaching and Learning in Nursing, 11(2), 52-57.
http://dx.doi.org/10.1016/j.teln.2015.12.006
CE
Post, J. L., Deal, B., & Hermanns, M. (2015). Implementation of a flipped classroom: Nursing
AC
doi:10.5430/jnep.v5n6p25
Presti,C. R. (2016). The Flipped Learning Approach in Nursing Education. Journal of Nursing
Schlairet, M., C., Green, R., & Benton, M., J. (2014). The flipped classroom. Nurse Educator,
Schultz, D., Duffield, S., Rasmussen, S. C., & Wageman, J. (2014). Effects of the flipped
classroom model on student performance for advanced placement high school chemistry
Schwartz, T., A. (2014). Flipping the statistics classroom in nursing education. Journal of
T
Simonson, S. R. (2014). Making students do the thinking: Team-based learning in a laboratory
P
RI
course. Advances in Physiology Education, 38(1), 49-55. Retrieved from
http://search.ebscohost.com/login.aspx?direct=true&db=eric&AN=EJ1021047&site=ehost-
SC
live; http://dx.doi.org/10.1152/advan.00108.2013
NU
Simpson, V., & Richards, E. (2015). Flipping the classroom to teach population health:
Tune, J. D., Sturek, M., & Basile, D. P. (2013). Flipped classroom model improves graduate
ED
http://search.ebscohost.com/login.aspx?direct=true&db=eric&AN=EJ1016939&site=ehost-
CE
live; http://dx.doi.org/doi:10.1152/advan.00091.2013
AC
Waltz, C., Jenkins, L., & Han, N. (2014). The use and effectiveness of active learning methods in
Warugaba, C., Naughton, B., Hedt-Gauthier, B., Muhirwa, E., & Amoroso, C. (2016).
Experience with a massive open online course in rural Rwanda. International Review of
Whittemore, R., & Knafl, K. (2005). The integrative review: Updated methodology. Journal of
doi:10.7537/marsjas12021607
P T
RI
SC
NU
MA
ED
PT
CE
AC
ACCEPTED MANUSCRIPT
Appendix A
T
Databases Search Strategies Number of papers
P
RI
CINAHL (flipp* W2 class* OR invert* W2 classroom*) 19
AND nurs*
SC
NU
Embase (flipp* NEAR/2 class*) AND nurs* 16
MA
ERIC (flipp* W2 (class* OR course* OR instruction OR 0
teaching OR learning) OR invert* W2 class*) AND
nurs*
ED
classroom"
CE