Академический Документы
Профессиональный Документы
Культура Документы
ANNUAL
REVIEWS Further Benets of Training and
Click here for quick links to
Annual Reviews content online,
including:
Development for Individuals
Other articles in this volume
Top cited articles
Top downloaded articles
and Teams, Organizations,
Our comprehensive search
and Society
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
1
The Business School, University of Colorado Denver, Denver, Colorado 80217-3364;
email: Herman.Aguinis@ucdenver.edu
2
Department of Psychology, Colorado State University, Fort Collins, Colorado 80523-1876;
email: Kurt.Kraiger@colostate.edu
451
ANRV364-PS60-17 ARI 27 October 2008 16:19
knowledge generated by researchers in various The second section reviews research ad-
training subelds. Second, although psychol- dressing how to maximize the benets of train-
ogy research on training has been a topic tradi- ing activities at the individual and team, orga-
Human capital: the
tionally studied at the individual level of analysis nizational, and societal levels. First, we focus collective set of
and more recently at the team level of analysis, on the activities that take place before train- performance-relevant
this review also includes organization and soci- ing is implementedneeds assessment and pre- knowledge, skills, and
ety levels of analysis. The present article goes training states. Then, we focus on training de- attitudes within a
workforce (at an
beyond the traditional levels of analysis because, sign and delivery, followed by a discussion of
organizational or
as noted by Kaufman & Guerra (2001), we training evaluation. We review research regard- societal level)
have entered a new era in which both achiev- ing transfer of skills and knowledge acquired in
Training evaluation:
ing useful results and proving that they add training to work settings. In the third and - the systematic
value to the organization and our shared soci- nal section, we address conclusions, including investigation of
ety are required (p. 319). Third, thanks in part implications for practice, and suggestions for whether a training
to the availability of cheaper and faster ways future research. program resulted in
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
knowledge, skills, or
to send and receive information using the In-
affective changes in
ternet, human resource management interven- learners
tions and training efforts in particular are taking BENEFITS OF TRAINING FOR
INDIVIDUALS AND TEAMS
by Rice University on 12/20/11. For personal use only.
as well as go beyond, the general ndings re- Taylor et al. (2005) conducted a meta-analysis
ported by Arthur et al. (2003). We emphasize including 117 behavior-modeling training
that results from meta-analytic reviews should studies. They ascertained that the largest ef-
generally be given more weight than individ- fects were for declarative and procedural knowl-
ual (i.e., primary-level) studies because they are edge (ds around 1.0 resulting from comparing
more reliable (Aguinis et al. 2008). training versus a no-training or pretest con-
Training effects on performance may be dition). Declarative knowledge is knowledge
subtle (though measurable). In a qualitative about what (e.g., facts, meaning of terms),
study involving mechanics in Northern India, whereas procedural knowledge is knowledge
Barber (2004) found that on-the-job training about how (i.e., how to perform skilled behav-
led to greater innovation and tacit skills. Tacit ior) (see Aguinis 2009, Kraiger et al. 1993). The
skills are behaviors acquired through informal overall mean effect on changes in job behavior
learning that are useful for effective perfor- was d = 0.27. However, Taylor et al. (2005) re-
mance. Regarding innovation, trained mechan- ported substantial variance in the distribution
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
ics learned to build two Jeep bodies using only of effect sizes, indicating the need to inves-
a homemade hammer, chisel, and oxyacetylene tigate moderators of the relationship between
welder. Regarding tacit skills, Barber noted that behavior-modeling training and outcomes. We
by Rice University on 12/20/11. For personal use only.
the job of a mechanic requires feel to be suc- address the issue of moderators below in the
cessful. Specically, trained mechanics devel- Suggestions for Future Research section.
oped an intuitive feel when removing dentsa Training not only may affect declarative
complex process particularly when the fender is knowledge or procedural knowledge, but also
badly crumpled. As a result of informal training, may enhance strategic knowledge, dened as
one of the mechanics had a good feeling of how knowing when to apply a specic knowledge
to hit the metal at the exact spot so the work pro- or skill (Kozlowski et al. 2001, Kraiger et al.
gresses in a systematic fashion (Barber 2004, 1993). Smith et al. (1997) refer to this as
p. 134). This type of tacit skill was particularly training for adaptive expertise (see also Ford
useful in the Indian context because, although & Schmidt 2000). In addition, training may
most shops in developed nations would not even enable consistency in performance across
attempt to repair a fender that was damaged so conditions. For example, Driskell et al. (2001)
badly, this type of repair is common practice in conducted a study including 79 U.S. Navy
the developing world (Barber 2004). technical school trainees who performed a
Benets of training are also documented for computer-based task. Trainees participated in a
technical skills. For example, Davis & Yi (2004) stress-exposure training session. This training
conducted two experiments with nearly 300 exposes trainees to information regarding
participants using behavior-modeling training stressors (e.g., noise, time urgency), to the
and were able to improve computer skills sub- stressors, and how these stressors are likely
stantially. Although behavior-modeling train- to affect performance. Results showed that
ing has a rich history of success (e.g., Decker & training was benecial in that trainees per-
Nathan 1985, Robertson 1990), a unique aspect formed well under a novel stressor and when
of this research was that training was found to performing a novel task. Thus, stress training
affect changes in worker skills through a change helps maintain performance consistency.
in trainees knowledge structures or mental Performance consistency may also result
models (see also Marks et al. 2002 for an ex- from enhancing trainees self-efcacy or self-
amination of mental models at the team level). management skills. Frayne & Geringer (2000)
Specically, mentally rehearsing tasks allowed conducted a eld experiment in which they
trainees to increase declarative knowledge and administered self-management training (lec-
task performance, each measured 10 days af- tures, group discussions, and case studies) to
ter the training was completed. More recently, 30 salespeople in the life insurance industry.
Results showed that salespeople who partici- the Suggestions for Future Research section).
pated in the training program demonstrated More recently, Littrell et al. (2006) conducted
higher self-efcacy, outcome expectancy (e.g., a qualitative review of 25 years (19802005)
Cross-cultural
I will increase my sense of accomplishment), of research addressing the effectiveness of training: training
and objective outcomes (e.g., number of new cross-cultural training in preparing managers conducted for
policies sold) as well as subjective job perfor- for an international assignment. Littrell et al. improving individual
mance (i.e., sales managers ratings of each (2006) examined 29 prior conceptual reviews effectiveness and/or
adjustment while on
salespersons performance). Training-related and 16 empirical studies. Overall, they con-
assignment in a new
performance improvement was sustained over cluded that cross-cultural training is effective at culture
a 12-month period after training ended. enhancing the expatriates success on overseas
There are also documented benets of train- assignments. They also identied many vari-
ing for managers and leaders. Collins & Holton ables that moderate the effects of training on
(2004) conducted a meta-analysis of the bene- expatriate performance, including the timing
ts of managerial leadership development pro- of the training (e.g., predeparture, while on
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
grams including 83 studies published between assignment, and postassignment), family issues
1982 and 2001 (see also Cullen & Turnbull (e.g., spouses adjustment), attributes of the job
2005). They found that mean ds (comparing (e.g., job discretion), and cultural differences
by Rice University on 12/20/11. For personal use only.
training with no training) ranged from 0.96 between the home country and the assignment
to 1.37 for knowledge outcomes and from country.
0.35 to 1.01 for expertise/behavioral outcomes.
Knowledge was dened as principles, facts, at-
titudes, and skills measured using both subjec- Other Benefits
tive (e.g., self-reports) and objective (e.g., stan- Other research demonstrates the impact of
dardized tests) measures. Expertise/behavioral training on outcomes other than job perfor-
outcomes were dened as changes in on-the- mance or on variables that serve as antecedents
job behavior and were also assessed using both to job performance. However, we emphasize
subjective (e.g., peer ratings) and objective (e.g., that these additional benets of training are
behavioral) measures. not necessarily unrelated to job performance.
A nal illustration of training benets re- In fact, in many cases they are indirectly re-
lated to performance is cross-cultural training, lated to performance and, in others, they may be
in which employees are trained to perform their related to individual and team well-being, vari-
jobs in a different culture and/or adjust psy- ables arguably also indirectly related to job per-
chologically to living in that culture (Bhawuk formance. For example, there is a renewed in-
& Brislin 2000, Lievens et al. 2003). Morris & terest in leadership training (Collins & Holton
Robie (2001) conducted a meta-analysis of the 2004, Day 2000). Dvir et al. (2002) imple-
effects of cross-cultural training on expatriate mented a longitudinal randomized eld ex-
performance and adjustment. Their meta- periment, using cadets in the Israel Defense
analysis included 16 studies that investigated Forces, in which experimental group leaders
adjustment and 25 studies that investigated job received transformational leadership training.
performance as the focal dependent variable. Transformational leaders exhibit charismatic
The mean correlation for the relationship behaviors, are able to motivate and provide
between training and adjustment was 0.12 ( p < intellectual stimulation among followers, and
0.05), and the correlation for the relationship treat followers with individual consideration.
between training and performance was 0.23 Results showed that transformational leader-
( p < 0.05). However, there was substantial ship training enhanced followers motivation
variability in the distribution of effect sizes, (i.e., self-actualization needs and willingness to
suggesting that potential moderators existed exert extra effort), morality (i.e., international-
(again, we discuss the issue of moderators in ization of their organizations moral values), and
tiveness of charismatic inuence training on the making, each of which contribute to air safety.
performance and attitudes of the participants There are two qualitative literature reviews of
who watched the videotapes. studies addressing CRM training: OConnor
by Rice University on 12/20/11. For personal use only.
Another area that has received consistent at- et al. (2002) reviewed 48 studies, and Salas et al.
tention is aviation human factors training. This (2001) reviewed 58 studies. Given that they in-
is an important area of research because hu- cluded overlapping sets of primary studies, it
man error has been consistently identied as is not surprising that the conclusions of these
one of the main causes of air crashes since the literature reviews converged and determined
late 1970s (Edkins 2002). Edkins (2002) con- that most studies focused on the benets re-
ducted a qualitative review of the aviation hu- garding attitudes and knowledge at the indi-
man factor training literature and concluded vidual and team levels of analysis. Documented
that outcomes of safety and team-based train- benets include positive reactions to training,
ing programs include (a) safety-related bene- knowledge of teamwork principles, and aircrew
ts, including a reduction in lost time related to communication and performance. A more re-
injuries, and (b) teamwork-related benets in- cent qualitative review by Salas et al. (2006)
cluding improved team performance. Because examined 28 studies published since the Salas
safety-related errors in elds such as aviation et al. (2001) review and included CRM studies
and medical care are often the result of team co- not only in cockpits but also in other contexts
ordination issues (e.g., Morey et al. 2002, Salas such as aircraft maintenance and health care.
et al. 2001), team training emerges as an impor- Salas et al. (2006) reported positive effects of
tant intervention. Ellis et al. (2005) conducted CRM training on trainee reactions, but results
an experiment including 65 four-person teams. were mixed in terms of trainee learning and on-
Individuals participated in a dynamic command the-job behaviors. For example, Jacobsen et al.
and control simulation in which participants (2001) found that trainees had high situational
monitor activity in a specic geographic re- awareness and communicated frequently; how-
gion and defend it against invasion by ground ever, trainees had difculties diagnosing medi-
or air. Training improved declarative knowl- cal problems, and no team member assumed the
edge within the team and, in comparison with lead or delegated tasks. In general, CRM train-
untrained teams, trained teams demonstrated ing was more effective in aviation settings than
better planning and task coordination, collabo- in health care settings, where its application is
rative problem solving, and communication in more recent.
novel team and task environments. In summary, a considerable number of in-
The most common training intervention dividual studies and meta-analytic reviews pro-
for improving team communication and team vide support for the many benets of training
for individuals and teams. These benets in- dom, the Netherlands, Portugal, Finland, and
clude performance as well as variables that Spain. Organizational performance was oper-
relate to performance directly (e.g., innova- ationalized as (a) effectiveness (i.e., employee
tion and tacit skills, adaptive expertise, techni- involvement, human resource indicators, and
cal skills, self-management skills, cross-cultural quality), and (b) protability (i.e., sales vol-
adjustment) or indirectly (e.g., empowerment; ume, benets before interest and taxes, and
communication, planning, and task coordina- a ratio of benet before taxes/sales). Results
tion in teams). In the following section, we re- indicated that some types of training activi-
view evidence regarding benets produced by ties, including on-the-job training and training
training activities at the organizational level. inside the organization using in-house train-
ers, were positively related to most dimen-
BENEFITS OF TRAINING sions of effectiveness and protability. Ubeda
FOR ORGANIZATIONS Garca (2005) conducted a study including 78
Spanish rms with more than 100 employ-
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
survey on training practices. Financial data were For example, Sirianni & Frey (2001) evaluated
gathered from the Amadeus database; a two- the effectiveness of a nine-month leadership de-
factor measure of nancial performance was velopment program at a nancial services com-
computed based on (a) operating revenue per pany with presence in Canada, Europe, Latin
employee and (b) cost of employees as a percent- America, and Asia. Participants included 29 ser-
age of operating revenues. Results indicated vice and operations market managers, district
that the manner in which management devel- managers, and a regional president. The 13
opment was implemented accounted for sub- training modules (e.g., managing conict, mo-
stantive variance in the nancial performance tivating others, priority setting) were delivered
measure. Specically, rms with line managers in three-hour sessions every two weeks. Mea-
reporting that management development pro- sures of program effectiveness included ratings
grams are valued were more likely to have a offered by participants as well as other objec-
positive relationship between management de- tive measures including regional scorecard re-
velopment and nancial performance. sults, which were collected on a monthly basis
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
Because of the paucity of primary-level stud- and used to determine service quality. Data col-
ies examining the benets of training at the lected approximately at the beginning and end
organizational level, the meta-analytic reviews of the training program suggested that, at a re-
by Rice University on 12/20/11. For personal use only.
published to date include only a small num- gional level, there were improvements on six of
ber of studies. In the meta-analysis by Arthur the seven scorecard components: overall teller
et al. (2003), the researchers also examined the errors, teller out of balance, number of deposit
impact of training on organizational-level re- slips left in envelopes, business retention, teller
sults. Only 26 studies (N = 1748) examined secret shopper ratings, and new account secret
the benets of training at the organizational shopper surveys.
level. Results showed that the benets of train- Benson et al. (2004) collected data from each
ing vary depending on the type of training de- of the 9439 permanent, salaried employees of
livery method, the skill or task being trained, a large high-technology manufacturing rm to
and the measure used to assess effectiveness. assess the effects on employee turnover of the
However, the mean d for organizational results organizations investment in employee devel-
was 0.62, precisely the same effect size found opment via a tuition reimbursement program.
for the impact of training on job-related behav- Investment in training via tuition reimburse-
iors and performance at the individual level of ment decreased turnover while employees were
analysis. Similarly, the Collins & Holton (2004) still taking classes. However, turnover increased
meta-analysis of managerial leadership devel- once employees obtained their degrees if they
opment programs included only seven studies were not promoted. This study points to the
(of 83) that included information regarding need to offer development opportunities on
the relationship between training and tangi- an ongoing basis and to align training efforts
ble organizational-level benets (e.g., reduced within an organizations performance manage-
costs, improved quality and quantity). The total ment system (Aguinis 2009).
sample size in these seven studies was 418 and The nature of an organizations reputa-
the overall mean d was 0.39, favoring training tion inuences how customers (and potential
compared to control groups. customers), competitors, and even employees
interact with the organization. Thus, an or-
ganizations reputation can have important -
Other Benefits nancial consequences. Clardy (2005) noted that
Benets of training have been documented an organizations reputation can be affected
for variables other than organizational perfor- by its training practices. Organizations such
mance. Again, many of these additional out- as the SEALs (special operations force of the
comes are related to performance indirectly. U.S. Navy) are legendary for their rigorous and
constitute 22 different political entities, most Hindustan Machine Tools, Bharat Heavy Elec-
of the economies are small, education is gen- tricals, Hindustan Aeronautics, State Bank of
erally good at the elementary level but not India, Steel Authority of India, and Coal India.
the secondary level, and in-company training Poland is an additional interesting illustra-
is limited. The area is very diverse economi- tion given its transition from a centralized econ-
cally, socially, and culturally. However, the Pa- omy under Soviet control to a member of the
cic Islands, led by the regional intergovern- European Union in May 2004. Under Soviet
mental Secretariat of the Pacic Community control with a command economy, and virtually
and the Pacic Islands Forum Secretariat, have full state ownership in all sectors, a typical Pol-
developed a common and unique vision of peo- ish employee was chronically suspicious, full of
ple as the most important building block for sour demand, unable to take responsibility or to
economic, social, and cultural development commit himself, ever ready to wallow in his own
(Bartlett & Rodgers 2004, p. 311). This people- misery and misfortune (Tischner 1992 as cited
centered approach assumes that investment in in Szalkowski & Jankowicz 2004, p. 347). To
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
human capital is fundamental for achieving so- say the least, the majority of employees did not
cietal prosperity. possess the attitudes and skills needed to meet
In the United Kingdom, the government the demands of a market economy. In addition,
by Rice University on 12/20/11. For personal use only.
wishes to improve the skills of the workforce that thousands of employees were on the coun-
and encourages the development of lifelong trys payroll without making value-added con-
learning practices through a variety of organi- tributions became obvious as several industries
zations and initiatives (Lee 2004). Although the shrunk their workforces. For example, the coal
government leads these initiatives, they give a mining industry went from about 500,000 em-
strong voice to employers, trade unions, pro- ployees in the mid-1990s to about 100,000 em-
fessional bodies, and other stakeholders in the ployees a decade later (Szalkowski & Jankowicz
business sector. For example, the organization 2004). Thus, in Poland now there is a general
Investors in People gives awards to organiza- feeling that further progress in the commer-
tions that implement excellent practices in the cial sphere can only come through engagement
training of individuals to achieve business goals. in the process of globalization and through the
Different organizations can use different means development of national human resources via
to achieve success through their people, so In- training, education, and research (Szalkowski
vestors in People does not prescribe any one & Jankowicz 2004, p. 350).
method but instead provides a framework to In summary, the recognition of the benets
help organizations nd the most suitable means of training activities for society has led many
for achieving success through people (Investors countries around the world to adopt national
in People Standard 2006). policies to encourage the design and delivery of
The recognition of the importance of training programs at the national level. These
training activities led India in 1985 to become policies have the goal to improve a nations hu-
the rst nation in the Asia-Pacic region man capital, which in turn is related to greater
to create a Ministry of Human Resource economic prosperity.
Development (Rao 2004). This ministry was
created by then Prime Minister Rajiv Ghandi,
who had a vision that investment in human HOW TO MAXIMIZE THE
capital would be an essential tool for the BENEFITS OF TRAINING
countrys development. Accordingly, the public In the next section, we summarize recent theory
sector, which had traditionally been the largest and research oriented toward improving the
employer in India, assisted in the creation of effectiveness and impact of training. Roughly
corporate training departments. Examples of following the instructional design model
organizations with such departments include (Goldstein & Ford 2002), we organize this
review around stages of needs assessment and showed that managers job involvement, orga-
pretraining states, training design and delivery, nizational commitment, and perceptions of the
training evaluation, and transfer of training. work environment (i.e., perceived support and
Transfer of training:
recognition) were predictive of pretraining self- the extent to which
efcacy, which in turn was related to pretraining new knowledge and
Needs Assessment and motivation. Pretraining motivation was related skills learned during
Pretraining States to posttraining measures of utility reactions, af- training are applied on
the job
Conducting a thorough needs assessment be- fective reactions, declarative knowledge scores,
fore training is designed and delivered helps and procedural knowledge scores. Pretraining Pretraining
motivation:
set appropriate goals for training and ensure motivation has also been shown to be related
individual attitudes,
that trainees are ready to participate (Blanchard to trainee personality (Rowold 2007), trainee expectancies, and
& Thacker 2007). However, there continues self-efcacy and training reputation (Switzer self-beliefs likely to
to be little theoretical or empirical work on et al. 2005), as well as reactions to prior train- inuence willingness
needs assessment (Kraiger 2003). One excep- ing courses (Sitzmann et al. 2007). In a eld to attend training and
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
learning during
tion is a study by Baranzini et al. (2001), who study of learners in a traditional classroom or
training
developed and validated a needs assessment blended learning course, Klein et al. (2006)
tool for the aviation maintenance industry. A found that learners had a higher motivation to
by Rice University on 12/20/11. For personal use only.
second example of a theory-based approach learn when they had a high learning goal orien-
to conducting a needs assessment is a study tation (rather than a lower learning goal orien-
by Fowlkes et al. (2000), who evaluated an tation) and when they perceived environmental
event-based knowledge-elicitation technique in conditions (e.g., time, Internet access) as learn-
which subject matter experts (SMEs) are asked ing enablers (rather than as barriers). Motiva-
about team situational awareness factors in re- tion to learn, in turn, was related to learner
sponse to a military helicopter operation. Re- satisfaction, metacognition, and course grade.
sults showed that more experienced experts Kozlowski et al. (2001) showed that trait and
identied a richer database of cues and were manipulated learning orientation had indepen-
more likely to identify response strategies, sup- dent effects on participants self-efcacy and
porting the conclusion that using SMEs during structural knowledge.
a needs assessment maximizes the benets of More generally, Colquitt et al. (2000) sum-
training. The nding that expertise affects the marized 20 years of research on factors af-
quality of needs assessment data is consistent fecting trainee motivation. Their meta-analysis
with the conclusions of Morgeson & Campion showed that training motivation was signi-
(1997), who reported that the accuracy of job cantly predicted by individual characteristics
analysis data may be compromised by up to (e.g., locus of control, conscientiousness, anxi-
16 different systematic sources of error. These ety, age, cognitive ability, self-efcacy, valence
include social inuence and self-presentation of training, and job involvement) as well as by
inuences and limitations in information pro- situational characteristics (e.g., organizational
cessing (cf. Ford & Kraiger 1995). More em- climate).
pirical research is necessary to understand how In summary, two ways to maximize the ben-
the quality of training design and delivery is af- ets of training is to conduct a needs assess-
fected by systematic and random inuences on ment using experienced SMEs and to make
the quality of needs assessment data. sure trainees are ready and motivated for train-
Consideration of the pretraining states or ing. For example, training readiness can be
individual characteristics of trainees also en- enhanced by lowering trainees anxiety about
hances the benets of training. Tracey et al. training, demonstrating the value of training
(2001) collected data from 420 hotel managers before training begins, and making sure em-
who attended a two-and-a-half-day managerial ployees are highly involved and engaged with
knowledge and skills training program. Results their jobs.
Training Design and Training Delivery sessions and rated whether discrete tasks such
as entering data correctly or formatting a table
Research on training design and delivery can be
were performed correctly. Trainees who were
categorized into two general themes: research
provided the opportunity to make errors (to-
on new approaches to engage learners in mean-
gether with explicit instructions encouraging
ingful learning processes and research on spe-
them to learn from these errors) performed sig-
cic training methods. Several studies in each
nicantly higher than those in error-avoidant
of these two domains provide information on
conditions. In a follow-up experiment, partic-
how to maximize the benets of training.
ipants learning how to use presentations soft-
Linou & Kontogiannis (2004) compared im-
ware (i.e., PowerPoint) performed better in the
mediate recall and follow-up retention levels
error training with metacognition prompting
(after six weeks) in four groups. Trainees were
(i.e., instructions encouraging trainees to think
production engineering undergraduates. The
explicitly about what the problem is, what they
primary objective of training was to help par-
are trying to achieve, and so forth) compared
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
individuals in 78 teams on a ight simulator task published studies involving 19,331 trainees, the
and examined adaptive performance on subse- researchers found that Web-based instruction
quent performance trials. Training participants was 6% more effective than classroom instruc-
Adaptive guidance:
self-regulation processes mediated the effects of tion for teaching declarative knowledge but was providing trainees with
training on task self-efcacy and their adaptive equally effective for teaching procedural knowl- diagnostic, future-
performance across trials. Two studies reported edge. However, when the same instructional oriented information
by Sitzmann et al. (2008) used repeated tri- methods were used in both forms of instruc- to aid decisions about
what and how much to
als to demonstrate that while engaging in self- tion, there were no differences in the relative
study and practice in
regulatory processes facilitates learning, the ef- effectiveness of either media. Thus, the small training
fects improve over time. advantage of Web-based instruction over class-
Technology-delivered instruction (TDI) room training may be due more to the use of
continues to become increasingly popular in novel (and effective) training strategies than to
industry (Paradise 2007), although researchers the medium per se.
have been slow to study factors that facilitate Researchers are also exploring the impact
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
or limit its effectiveness (Brown 2001, Welsh of novel training technologies on outcomes
et al. 2003). TDI includes Web-based training other than learning. For example, Wesson &
and instruction on single workstations, PDAs Gogus (2005) compared two different meth-
by Rice University on 12/20/11. For personal use only.
and MP3 players, as well as embedded just-in- ods for delivering socialization training to new
training in work-related software (Aguinis et al. employees: a group social-based program and
2009). One potential drawback of TDI is that it an individual computer-based program. This
transfers more control to learners to make deci- quasi-experiment included 261 new employ-
sions about what and how to learn (Noe 2008). ees from a large technology-based consulting
A recent meta-analysis by Kraiger & Jerden rm. The social-based program was substan-
(2007) indicated that high learner control has tially more successful in socializing new em-
only marginally benecial effects on learning, ployees regarding people, politics, and organi-
and in many studies, high control has a nega- zational goals and values.
tive effect. Low-ability or inexperienced learn- In summary, the application of appropriate
ers under high learner-control conditions may training design and delivery methods can help
make poor decisions about what and how to maximize the benets of training. In terms of
learn (DeRouin et al. 2004). One promising design, recent research suggests that the bene-
technique for coupling learner-driven instruc- ts of training are enhanced by applying theory-
tion with technology is to supplement learner based learning principles such as encouraging
control with adaptive guidance. Specically, trainees to organize the training content, mak-
Bell & Kozlowski (2002) concluded that pro- ing sure trainees expend effort in the acquisi-
viding adaptive guidance in a computer-based tion of new skills, and providing trainees with
training environment substantively improved an opportunity to make errors together with
trainees study and practice effort, knowledge explicit instructions to encourage them to learn
acquired, and performance. from these errors. In terms of training delivery,
Better hardware and software capabilities recent research indicates that the benets of us-
have allowed for improvements in the deliv- ing technology can be enhanced by providing
ery of various forms of remote training. Zhao trainees with adaptive guidance.
et al. (2005) conducted a meta-analysis compar-
ing face-to-face and distance education courses
and found no signicant differences between Training Evaluation
formats. A meta-analysis by Sitzmann et al. The Kirkpatrick four-levels approach to train-
(2006) examined the relative effectiveness of ing evaluation continues to be the most widely
Web-based instruction over classroom instruc- used training evaluation model among practi-
tion. In an analysis of 96 published and un- tioners (e.g., Sugrue & Rivera 2005, Twitchell
et al. 2000), although the approach continues to Aguinis & Branstetter (2007) also discussed the
be criticized by researchers (e.g., Holton 2005, need to discriminate between affective and util-
Kraiger 2002, Spitzer 2005). There has been ity reactions because utility reactions are more
Training
effectiveness: the little empirical work in the twenty-rst cen- strongly related to learning than are affective
study of individual-, tury on designing and validating new evalua- reactions. K.G. Brown (2005) proposed a the-
group-, or tion measures, although there have been several oretical structure with distinct factors (enjoy-
organizational-level conceptual contributions to frameworks guid- ment, relevance, and technology satisfaction) as
factors that inuence
ing evaluation decisions (Holton 2005, Kraiger well as a second-order factor of overall satisfac-
learning in training
and transfer after 2002, Spitzer 2005, Wang & Wilcox 2006). tion, related in part to trainee affect. Data from
training Kraiger (2002) proposed a decision-based two studies reported by K.G. Brown (2005) sup-
evaluation model. The model frames decisions ported this model. In a study of 181 Korean
about how to measure training impact around workers, Lim & Morris (2006) showed that
the intended purpose for evaluationpurposes the relationship between perceived applicabil-
of decision making, marketing, and providing ity (training utility) and perceived application
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
feedback to participants, instructors, or instruc- (transfer) decreased as the time between train-
tional designers. The model also emphasizes ing and measurement increased.
tailoring evaluation measures to the needs There continues to be calls for establishing
by Rice University on 12/20/11. For personal use only.
and sophistication of the intended audience(s). the return on investment for training, particu-
It proposes a comprehensive taxonomy for larly as training continues to be outsourced and
evaluation, including assessing the training new forms of TDI are marketed as cost effec-
program, changes in the learner, and changes tive. Although the tools and strategies for show-
in the organization. Notably, a number of ing return on investment are well known (e.g.,
authors have criticized the lack of rigor in Kraiger 2002, Phillips & Phillips 2007, Spitzer
training evaluation designs (e.g., Edkins 2002, 2005), as the above review of organizational-
Littrell et al. 2006, OConnor et al. 2002, Wang level outcomes indicated, there remain few pub-
2002). Although Kraigers model emphasizes lished studies of return on investment.
the importance of solid designs (as compared In summary, it is important not only that the
to more or better measures), he argued that benets of training be maximized, but also that
meaningful evaluation can be done with incom- these benets are documented. Recently pro-
plete research designs, a point raised earlier posed conceptualizations and measures of train-
by Sackett & Mullen (1993) and Tannenbaum ing effectiveness can enhance the perceived
& Woods (1992), and later echoed by Kraiger benets of training from the perspective of the
et al. (2004). The internal referencing strategy, various stakeholders in the process, including
in which effect sizes for trained behavior (or those who participate in training, those who
knowledge) are compared to effect sizes for deliver it, and those who fund it (e.g., organi-
nontrained behaviors (or knowledge), was used zations). It is important that training evaluation
in several studies as an alternative to more include a consideration of the intended purpose
rigorous designs with a control group (Aguinis of the evaluation, the needs and sophistication
& Branstetter 2007, Frese et al. 2003). of the intended audience, and the variables re-
How people react to training has contin- lated to various types of utility reactions (i.e.,
ued to receive attention in the literature, par- affective versus utility).
ticularly around the question of how best to
use reactions for improving training design and
delivery. Morgan & Casper (2000) factor ana- Transfer of Training
lyzed a set of training reaction items from 9128 Evidence described in the previous sections
government employees and found evidence of forcefully makes the point that training works,
two underlying factors: overall affect toward in the sense that it has an impact on individ-
training and perceived utility of the training. uals and teams and on the organizations and
the societies in which they function. However, variables (e.g., fostering job involvement, em-
training efforts will not yield the anticipated ef- ployee involvement, information sharing), job
fects if knowledge, attitudes, and skills acquired design variables (e.g., fostering task autonomy,
in training are not fully and appropriately trans- job match), quality management variables (e.g.,
ferred to job-related activities. Thus, the study employee commitment to quality work, cus-
of transfer of training focuses on variables that tomer focus), and continuous learning variables
affect the impact of training on transfer of train- (e.g., continuous learning as a priority, rewards
ing as well as on interventions intended to en- for learning). With a sample of 300 employees
hance transfer. in the information technology division of a
Research on moderators of the training- large U.S. automaker, Kontoghiorghes (2004)
transfer relationship has focused primarily found support for both climate and work
on workgroup factorssupervisory and peer environment factors as predictors of transfer
supportas well as on organizational-level fac- motivation and performance.
tors. Holton et al. (2003) used the Learning Although there continue to be claims that
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
Transfer System Inventory (Holton et al. 2001) the transfer climate is critical to transfer of
to examine differences in transfer characteris- training, empirical studies of transfer climate
tics across eight different organizations, three have yielded mixed results. Richman-Hirsch
by Rice University on 12/20/11. For personal use only.
organization types, and three training types. (2001) found that posttraining transfer en-
The Learning Transfer System Inventory in- hancement interventions were more successful
cludes 68 items encompassing 16 conceptual in supportive work environments. Chiaburu &
constructs that in turn are organized in to four Marinova (2005) found no effects for supervi-
major groups: trainee characteristics (learner sory support but positive results for peer sup-
readiness and self-efcacy), trainee motivation port in a study of 186 trained employees. van der
(motivation to transfer, transfer effort to perfor- Klink et al. (2001) also found no effect for su-
mance expectations, and performance to out- pervisory support on two studies involving bank
come expectations), work environment (perfor- tellers. An important study for understanding
mance coaching, supervisor support, supervisor these mixed results may be that of Pidd (2004),
sanctions, peer support, resistance-openness to which examined the role of peer and supervisory
change, positive personal outcomes, and nega- support for transfer of training on workplace
tive personal outcomes), and ability (perceived drug and alcohol awareness. Pidd reported that
content validity, personal capacity for transfer, the inuence of workplace support on transfer
transfer design, and opportunity to use). Anal- was moderated by the extent to which trainees
yses showed that scale scores differed across in- identied with the groups that provided
dividual organizations, organization types, and support.
training types, indicating that transfer environ- A number of studies have investigated in-
ments are probably unique to each training training strategies for improving transfer, with
application. little or mixed success. T.C. Brown (2005) ex-
Regarding organizational-level factors, amined goal setting at the end of training by
Kontoghiorghes (2004) emphasized the im- comparing three conditions: setting distal goals,
portance of both transfer climate and the work setting proximal plus distal goals, and telling
environment in facilitating transfer. Transfer participants to do their best. Contrary to expec-
climate includes a number of factors including tations, participants instructed to do their best
supervisory and peer support, but also task out-performed trainees told to set distal goals,
cues, training accountability, opportunities to and did as well as participants told to set prox-
practice, opportunities to use new knowledge imal plus distal goals. In contrast, Richman-
and skills, and intrinsic and extrinsic rewards Hirsch (2001) reported positive effects for
for using new knowledge. Work environment a posttraining goal-setting intervention, par-
factors include sociotechnical system design ticularly in supportive work environments.
understand the factors that facilitate a smooth be a powerful and important message in to-
cross-level transfer of benets. Of special in- days corporate world plagued by downsizing
terest is the question of vertical transfer: how and employee layoffs.
effects of training on individuals (increased Fourth, we identied the need to study mod-
knowledge and skills) translate directly into bet- erators in several areas. Moderators explain the
ter functioning at the team and organizational conditions under which an effect or relationship
level. Although good conceptual models of this is likely to be present and likely to be stronger
process exist (e.g., Kozlowski & Salas 1997, (Aguinis 2004, Aguinis et al. 2005). Training re-
Kozlowski et al. 2000), there has been little search has consistently found support for both
empirical research. Conceptual work on such individual and situational moderators on rela-
cross-level transfers in other areas of applied tionships among training interventions, trainee
psychology may prove useful in this regard (e.g., learning, and workplace performance (Kraiger
Fiol et al. 2001). & Aguinis 2001). For example, in this review
Second, a gap exists between the applied and we highlighted the importance of moderators
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
scholarly literatures regarding the use of cycle in the study of the relationship between behav-
time as a variable to assess training effective- ior modeling and training outcomes, the rela-
ness (Holton 2003). Effect sizes for the quality tionship between cross-cultural training and ex-
by Rice University on 12/20/11. For personal use only.
of performance may not be the same as those for patriate adjustment, the relationship between
the speed at which individuals, teams, and or- training and transfer. However, additional re-
ganizations identify and implement solutions to search is needed to understand fully the range
new problems. Given competition and market- and impact of these moderators. Ideally, this
related pressures, organizations need to realize research would be driven by better theory on
the benets of training faster and faster. Re- how proposed situational and individual mod-
search on this issue is lacking in the scholarly erators operate to effect learning and transfer.
literature; work is needed regarding the factors For example, how do organizational systems for
that can accelerate the realization of the benets accountability inuence trainee motivation or
of training at various levels of analysis. This re- cognitive effort during training? How does cog-
search may prot from initial studies on the ef- nitive ability inuence both the rate and depth
fects of training on innovation and performance of learning during training?
adaptability. We close by emphasizing the overwhelm-
Third, although the role of affect has been ing evidence in favor of the benets that train-
acknowledged in the measurement of reactions ing produces for individuals and teams, orga-
to training, affect could play a more central nizations, and society. An important challenge
role in the training process in general. Prior for the practice of training is to integrate the
research has focused on the relationship be- training function with employee selection, per-
tween liking a training program (positive re- formance management, rewards, and other hu-
actions) and employee learning or subsequent man resource management practices (Aguinis
performance (Alliger et al. 1997), but has paid 2009, Aguinis & Pierce 2008, Cascio & Aguinis
less attention to relationships between affective 2005). Training alone may not be able to realize
states during training and learning. Offering its benets if it is disconnected from other hu-
employees training opportunities can be seen as man resource management functions or the or-
a message that the organization cares for its em- ganization is dysfunctional in other areas (e.g.,
ployees (Aguinis 2009). This perception may in interpersonal relationships). Training will have
turn produce benets even though training de- the greatest impact when it is bundled together
sign and delivery may not be optimal. In short, with other human resource management prac-
future research could investigate the extent to tices and these practices are also implemented
which training opportunities are seen as a mes- following sound principles and empirical
sage that the organization cares, which could research.
SUMMARY POINTS
1. The current review differs from previous Annual Review of Psychology articles on the topic
of training and development because its approach is fundamentally multidisciplinary,
multilevel, and global.
2. There is considerable support for the many benets of training for individuals and teams.
These benets include performance as well as variables that relate directly (e.g., inno-
vation and tacit skills, adaptive expertise, technical skills, self-management skills, cross-
cultural adjustment) or indirectly (e.g., empowerment; communication, planning, and
task coordination in teams) to performance.
3. Many studies have gathered support for the benets of training for organizations as a
whole. These benets include improved organizational performance (e.g., protability,
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
around the world to adopt national policies to encourage the design and delivery of
training programs at the national level. The goal of these policies is to improve a nations
human capital, which in turn is related to greater economic prosperity.
5. Several interventions are effective at enhancing the benets of training. First, organi-
zations should conduct a needs assessment using experienced subject matter experts to
make sure trainees are ready and motivated for training. Second, in terms of design, or-
ganizations should apply theory-based learning principles such as encouraging trainees
to organize the training content, making sure trainees expend effort in the acquisition
of new skills, and providing trainees with an opportunity to make errors together with
explicit instructions to encourage them to learn from these errors enhances the benets
of training. Third, in terms of training delivery, the benets of using technology for
training delivery can be enhanced by providing trainees with adaptive guidance. Fourth,
it is important not only that the benets of training be maximized, but also that these
benets are documented. Recently proposed conceptualizations and measures of training
effectiveness can enhance the perceived benets of training from the perspective of the
various stakeholders in the process, including those who participate in training, those
who deliver it, and those who fund it (e.g., organizations). Finally, recent research points
to the importance of considering interpersonal factors such as supervisory and peer sup-
port as moderators of the relationship between training and transfer of training back to
the work environment.
6. Designing, delivering, evaluating, and clearly documenting the benets of training using
the information included in this review will allow the human resource management func-
tion to be a strategic organizational player and to move away from the negative conno-
tations (e.g., welfare secretaries) associated with this function in the twentieth century.
7. Future research is needed in several areas. For example, the benets of training may have
a cascading effect such that individual-level benets (e.g., individual performance) affect
team-level benets (i.e., team performance), which in turn affect organizational (i.e., prof-
itability) and societal (i.e., human capital) outcomes. However, future research is needed
to understand the factors that facilitate a smooth cross-level transfer of benets. Second,
a gap exists between the applied and scholarly literatures regarding the use of cycle time
as a variable to assess training effectiveness. Third, although the role of affect has been
acknowledged in the measurement of reactions to training, affect has the potential to play
a more central role in the training process in general. Finally, this review identies the
need to study moderators, including moderators of the relationship between behavior
modeling and training outcomes, the relationship between cross-cultural training and
expatriate adjustment, and the relationship between training and transfer.
8. Training alone may not be able to realize its benets if it is disconnected from other human
resource management functions or if the organization is dysfunctional in other areas (e.g.,
interpersonal relationships). Training will have the greatest impact when it is bundled
together with other human resource management practices and these practices are also
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
DISCLOSURE STATEMENT
by Rice University on 12/20/11. For personal use only.
The authors are not aware of any biases that might be perceived as affecting the objectivity of this
review.
ACKNOWLEDGMENTS
We thank Ken Brown, Steve Kozlowski, Chuck Pierce, and Sabine Sonnentag for constructive
comments on earlier drafts. This research was conducted in part while Herman Aguinis was on
sabbatical from the University of Colorado Denver and holding visiting appointments at the
University of Salamanca (Spain) and the University of Puerto Rico.
LITERATURE CITED
Aguinis H. 2009. Performance Management. Upper Saddle River, NJ: Pearson Prentice Hall. 2nd ed.
Aguinis H. 2004. Regression Analysis for Categorical Moderators. New York: Guilford
Aguinis H, Beaty JC, Boik RJ, Pierce CA. 2005. Effect size and power in assessing moderating effects of
categorical variables using multiple regression: a 30-year review. J. Appl. Psychol. 90:94107
Aguinis H, Branstetter SA. 2007. Teaching the concept of the sampling distribution of the mean. J. Manag.
Educ. 31:46783
Aguinis H, Mazurkiewicz MD, Heggestad, ED. 2009. Using Web-based frame-of-reference training to de-
crease biases in personality-based job analysis: an experimental eld study. Pers. Psychol. In press
Aguinis H, Pierce CA. 2008. Enhancing the relevance of organizational behavior by embracing performance
management research. J. Organ. Behav. 29:13945
Aguinis H, Sturman MC, Pierce CA. 2008. Comparison of three meta-analytic procedures for estimating
moderating effects of categorical variables. Organ. Res. Methods 11:934
Alliger GM, Tannenbaum SI, Bennett W Jr, Traver H, Shotland A. 1997. A meta-analysis of the relations
among training criteria. Pers. Psychol. 50:34158 A broad meta-analysis
Aragon-S anchez A, Barba-Aragon I, Sanz-Valle R. 2003. Effects of training on business results. Int. J. Hum. showing linkages
Resour. Manag. 14:95680 between training design
and evaluation features
Arthur WJ, Bennett WJ, Edens P, Bell ST. 2003. Effectiveness of training in organizations: a meta-
and training success at
analysis of design and evaluation features. J. Appl. Psychol. 88:23445
individual and
Baranzini D, Bacchi M, Cacciabue PC. 2001. A tool for evaluation and identication of training needs in organizational levels.
aircraft. Hum. Factors Aerosp. Saf. 1:16793
Barber J. 2004. Skill upgrading within informal training: lessons from the Indian auto mechanic. Int. J. Train.
Dev. 8:12839
Bartlett KR, Rodgers J. 2004. HRD as national policy in the Pacic Islands. Adv. Dev. Hum. Resour. 6:30714
Becker G. 1962. Investment in human capital: a theoretical analysis. J. Pol. Econ. 70(Suppl. 5, Pt. 2):S949
Becker G. 1964. Human Capital: A Theoretical and Empirical Analysis, With Special Reference to Education. New
York: Columbia Univ. Press
Bell BS, Kozlowski SWJ. 2002. Adaptive guidance: enhancing self-regulation, knowledge and perfor-
Blends theory and
mance in technology-based training. Pers. Psychol. 55:267306
application to advance a
workable compromise Benson G, Finegold D, Mohrman SA. 2004. You paid for the skills, now keep them: tuition reimbursement
between advocates of and voluntary turnover. Acad. Manag. J. 47:31531
highly structured and Bhawuk DPS, Brislin RW. 2000. Cross-cultural training: a review. Appl. Psychol.: An Int. Rev. 49:16291
purely exploratory Blanchard PN, Thacker JW. 2007. Effective Training: Systems, Strategies, and Practices. Upper Saddle River, NJ:
computer-based Pearson Prentice Hall. 3rd ed.
learning environments. Brown KG. 2001. Using computers to deliver training: Which employees learn and why? Pers. Psychol. 54:271
96
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
Brown KG. 2005. Examining the structure and nomological network of trainee reactions: a closer
Presents both a
look at smile sheets. J. Appl. Psychol. 90:9911001
hierarchical analysis of
training reactions and a Brown KG, Van Buren ME. 2007. Applying a social capital perspective to the evaluation of distance training.
In Where is the Learning in Distance Learning? Towards a Science of Distributed Learning and Training, ed.
by Rice University on 12/20/11. For personal use only.
Edkins GD. 2002. A review of the benets of aviation human factors training. Hum. Factors Aerosp. Saf.
2:20116
Ellis APJ, Bell BS, Ployhart RE, Hollenbeck JR, Ilgen DR. 2005. An evaluation of generic teamwork skills
training with action teams: effects on cognitive and skill-based outcomes. Pers. Psychol. 58:64172
Fiol CM, OConnor EJ, Aguinis H. 2001. All for one and one for all? The development and transfer of power
across organizational levels. Acad. Manag. Rev. 26:22442
Ford JK, Kraiger K. 1995. The application of cognitive constructs and principles to the instructional systems
model of training. Implications for needs assessment, design, and transfer. In International Review of
Industrial and Organizational Psychology, ed. CL Cooper, IT Robertson, 10:148. Chichester, UK: Wiley
Ford JK, Schmidt AM. 2000. Emergency response training: strategies for enhancing real-world performance.
J. Hazard. Mater. 75:195215
Fowlkes JE, Salas E, Baker DP, Cannon-Bowers JA, Stout RJ. 2000. The utility of event-based knowledge
elicitation. Hum. Factors 42:2435
Fox A. 2003. Training budgets said to be withstanding companies economic troubles. HR Mag. 48(7):32, 38
Frayne CA, Geringer JM. 2000. Self-management training for improving job performance: a eld experiment
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
Klein HJ, Noe RA, Wang C. 2006. Motivation to learn and course outcomes: the impact of delivery
Introduces perceived
mode, learning goal orientation, and perceived barriers and enablers. Pers. Psychol. 59:665702
barriers and enablers as
factors in choosing and Kontoghiorghes C. 2004. Reconceptualizing the learning transfer conceptual framework: empirical validation
benefiting from of a new systemic model. Int. J. Train. Dev. 8:21021
traditional and blended Kozlowski SWJ, Brown KG, Weissbein DA, Cannon-Bowers JA, Salas E. 2000. A multi-level perspective
learning environments. on training effectiveness: enhancing horizontal and vertical transfer. In Multilevel Theory, Research, and
Methods in Organizations, ed. KJ Klein, SWJ Kozlowski, pp. 157210. San Francisco, CA: Jossey-Bass
Kozlowski SWJ, Gully SM, Brown KG, Salas E, Smith EM, Nason ER. 2001. Effects of training goals and goal
orientation traits on multidimensional training outcomes and performance adaptability. Organ. Behav.
Hum. Decis. Process. 85:131
Kozlowski SWJ, Salas E. 1997. An organizational systems approach for the implementation and transfer of
training. In Improving Training Effectiveness in Work Organizations, ed. K Ford, SW Kozlowski, K Kraiger,
E Salas, M Teachout, pp. 24787. Mahwah, NJ: Erlbaum
Kraiger K. 2002. Decision-based evaluation. In Creating, Implementing, and Maintaining Effective
Critiques past
Training and Development: State-of-the-Art Lessons for Practice, ed. K Kraiger, pp. 33175. San
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
approaches to training
evaluation models and Francisco, CA: Jossey-Bass
presents a theory- and Kraiger K. 2003. Perspectives on training and development. In Handbook of Psychology: Volume 12, Industrial
practice-based new and Organizational Psychology, ed. WC Borman, DR Ilgen, RJ Klimoski, pp. 17192. Hoboken, NJ: Wiley
evaluation model for Kraiger K, Aguinis H. 2001. Training effectiveness: assessing training needs, motivation, and accomplishments.
by Rice University on 12/20/11. For personal use only.
practitioners and In How People Evaluate Others in Organizations: Person Perception and Interpersonal Judgment in I/O Psychology,
researchers. ed. M London, pp. 20319. Mahwah, NJ: Erlbaum
Kraiger K, Ford JK, Salas E. 1993. Application of cognitive, skill-based, and affective theories of learning
outcomes to new methods of training evaluation. J. Appl. Psychol. 78:31128
Kraiger K, Jerden E. 2007. A new look at learner control: meta-analytic results and directions for future
research. In Where is the Learning in Distance Learning? Towards a Science of Distributed Learning and
Training, ed. SM Fiore, E Salas, pp. 6590. Washington, DC: APA Books
Kraiger K, McLinden D, Casper WJ. 2004. Collaborative planning for training impact. Hum. Resour. Manag.
Rev. 43:33751
Latham GP. 1988. Human resource training and development. Annu. Rev. Psychol. 39:54582
Lee M. 2004. National human resource development in the United Kingdom. Adv. Dev. Hum. Resour. 6:33445
Lievens F, Harris MM, Van Keer E, Bisqueret C. 2003. Predicting cross-cultural training performance: the
validity of personality, cognitive ability, and dimensions measured by an assessment center and a behavior
description interview. J. Appl. Psychol. 88:47689
Lim DH, Morris ML. 2006. Inuence of trainee characteristics, instructional satisfaction, and organizational
climate on perceived learning and transfer training. Hum. Resour. Dev. Q. 17:85115
Linou N, Kontogiannis T. 2004. The effect of training systemic information on the retention of fault-nding
skills in manufacturing industries. Hum. Factors Ergon. Manufacturing 14:197217
Littrell LN, Salas E, Hess KP, Paley M, Riedel S. 2006. Expatriate preparation: a critical analysis of 25 years
of cross-cultural training research. Hum. Resour. Dev. Rev. 5:35588
Mabey C, Ramirez M. 2005. Does management development improve organizational productivity? A six-
country analysis of European rms. Int. J. Hum. Resour. Manag. 16:106782
Marks MA, Sabella MJ, Burke CS, Zaccaro SJ. 2002. The impact of cross-training on team effectiveness.
J. Appl. Psychol. 87:313
Mattson B. 2005. Using the critical outcome technique to demonstrate nancial and organizational perfor-
mance results. Adv. Dev. Hum. Resour. 7:10220
McGuire D, Cross C, ODonnell D. 2005. Why humanistic approaches in HRD wont work. Hum. Resour.
Dev. Q. 16:13137
Morey JC, Simon R, Jay GD, Wears RL, Salisbury M, et al. 2002. Error reduction and performance im-
provement in the emergency department through formal teamwork training: evaluation results of the
MedTeams Project. Health Serv. Res. 37:155381
Morgan RB, Casper WJ. 2000. Examining the factor structure of participant reactions to training: a multidi-
mensional approach. Hum. Resour. Dev. Q. 11:30117
Morgeson FP, Campion MA. 1997. Social and cognitive sources of potential inaccuracy in job analysis.
J. Appl. Psychol. 82:62755
Morris MA, Robie C. 2001. A meta-analysis of the effects of cross-cultural training on expatriate performance
and adjustment. Int. J. Train. Dev. 5:11225
Noe RA. 2008. Employee Training and Development. Boston, MA: Irwin-McGraw. 4th ed.
OConnor P, Flin R, Fletcher G. 2002. Techniques used to evaluate crew resource management training: a
literature review. Hum. Factors Aerosp. Saf. 2:21733
Paradise A. 2007. State of the Industry: ASTDs Annual Review of Trends in Workplace Learning and
Latest in an annual
Performance. Alexandria, VA: ASTD
series that documents
Phillips JJ, Phillips P. 2007. Measuring return on investment in leadership development. In The Handbook of training practices in a
Leadership Development Evaluation, ed. KM Hannum, JW Martineau, C Reinelt, pp. 13766. Hoboken, large sample of U.S.
NJ: Wiley corporations.
Pidd K. 2004. The impact of workplace support and identity on training transfer: a case study of drug and
alcohol safety training in Australia. Int. J. Train. Dev. 8:27488
Rao TV. 2004. Human resource development as national policy in India. Adv. Dev. Hum. Resour. 6:28896
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
Richman-Hirsch WL. 2001. Posttraining interventions to enhance transfer: the moderating effects of work
environments. Hum. Resour. Dev. Q. 12:10519
Rivera RJ, Paradise A. 2006. State of the Industry: ASTDs Annual Review of Trends in Workplace Learning and
Performance. Alexandria, VA: ASTD
by Rice University on 12/20/11. For personal use only.
Robertson IT. 1990. Behaviour modelling: its record and potential in training and development. Br. J. Manag.
1:11725
Rowold J. 2007. The impact of personality on training-related aspects of motivation: test of a longitudinal
model. Hum. Resour. Dev. Q. 18:931
Sackett PR, Mullen EJ. 1993. Beyond formal experimental design: towards an expanded view of the training
evaluation process. Pers. Psychol. 46:61327
Salas E, Burke CS, Bowers CA, Wilson KA. 2001. Team training in the skies: Does crew resource management
(CRM) training work? Hum. Factors 42:64174
Salas E, Cannon-Bowers JA. 2001. The science of training: a decade of progress. Annu. Rev. Psychol. 52:47199
Salas E, Wilson KA, Burke CS. 2006. Does crew resource management training work? An update, an extension,
and some critical needs. Hum. Factors 48:392412
Sattereld JM, Hughes E. 2007. Emotion skills training for medical students: a systematic review. Med. Educ.
41:93541
Schmidt A, Ford JK. 2003. Learning within a learner control training environment: the interactive effects of
goal orientation and metacognitive instruction on learning outcomes. Pers. Psychol. 56:40530
Sirianni PM, Frey BA. 2001. Changing a culture: evaluation of a leadership development program at Mellon
Financial Services. Int. J. Train. Dev. 5:290301
Sitzmann T, Bell B, Kraiger K. 2008. A multi-level analysis of the effect of prompting self-regulation in
technology-delivered instruction. Pers. Psychol. Manuscr. under review
Sitzmann T, Brown KG, Ely K, Kraiger K. 2008. Motivation to learn in a military training curriculum: a
longitudinal investigation. Mil. Psychol. Manuscr. under review
Sitzmann T, Kraiger K, Stewart D, Wisher R. 2006. The comparative effectiveness of Web-based and
Large-scale meta-
classroom instruction: a meta-analysis. Pers. Psychol. 59:62364
analysis that evaluates
Smith EM, Ford JK, Kozlowski SWJ. 1997. Building adaptive expertise: implications for training design. the effectiveness of
In Training for a Rapidly Changing Workplace: Applications of Psychological Research, ed. MA Quinones, A Web-based instruction
Ehrenstein, pp. 89118. Washington, DC: APA Books and suggests design
Spitzer DR. 2005. Learning effectiveness measurement: a new approach for measuring and managing learning factors for optimizing
to achieve business results. Adv. Dev. Hum. Resour. 7:5570 effectiveness.
Sugrue B, Rivera RJ. 2005. State of the Industry: ASTDs Annual Review of Trends in Workplace Learning and
Performance. Alexandria, VA: ASTD
Swanson RA. 2001. Assessing the Financial Benets of Human Resource Development. Cambridge, MA: Perseus
Switzer KC, Nagy MS, Mullins ME. 2005. The inuence of training reputation, managerial support, and
self-efcacy on pretraining motivation and perceived training transfer. Appl. HRM Res. 10:2134
Szalkowski A, Jankowicz D. 2004. The development of human resources during the process of economic and
structural transformation in Poland. Adv. Dev. Hum. Resour. 6:34654
Tannenbaum SI, Woods SB. 1992. Determining a strategy for evaluating training: operating within organiza-
tional constraints. Hum. Resour. Plann. 15(2):6381
Tannenbaum SI, Yukl G. 1992. Training and development in work organizations. Annu. Rev. Psychol. 43:399
441
Taylor PJ, Russ-Eft DF, Chan DWL. 2005. A meta-analytic review of behavior modeling training. J. Appl.
Psychol. 90:692709
Tharenou P, Saks AM, Moore C. 2007. A review and critique of research on training and organizational-level
outcomes. Hum. Resour. Manag. Rev. 17:25173
Towler AJ. 2003. Effects of charismatic inuence training on attitudes, behavior, and performance. Pers. Psychol.
56:36381
Tracey JB, Hinkin TR, Tannenbaum S, Mathieu JE. 2001. The inuence of individual characteristics and the
work environment on varying levels of training outcomes. Hum. Resour. Dev. Q. 12:523
Twitchell K, Holton E III, Trott JW Jr. 2000. Technical training evaluation practices in the United States.
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
Annual Review of
Psychology
Prefatory
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
vii
AR364-FM ARI 11 November 2008 15:42
viii Contents
AR364-FM ARI 11 November 2008 15:42
Psychobiological Mechanisms
Health Psychology: Developing Biologically Plausible Models Linking
the Social World and Physical Health
Gregory E. Miller, Edith Chen, and Steve Cole p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 501
Health and Social Systems
The Case for Cultural Competency in Psychotherapeutic Interventions
Stanley Sue, Nolan Zane, Gordon C. Nagayama Hall, and Lauren K. Berger p p p p p p p p p p 525
Research Methodology
Missing Data Analysis: Making It Work in the Real World
John W. Graham p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 549
Annu. Rev. Psychol. 2009.60:451-474. Downloaded from www.annualreviews.org
Indexes
Contents ix