Академический Документы
Профессиональный Документы
Культура Документы
Cyprus, California
2014
(Defended April 7, 2014)
Approved by:
Office of Academic Affairs
Dean: Dr. Simcha (Stephen) Pollard
Committee Chair/ Director, PhD Program: Dr. Sigalit Ronen
Committee Member: Dr. David Richards
Committee Member: Dr. Dan Corcoran
UMI 3583088
Published by ProQuest LLC (2014). Copyright in the Dissertation held by the Author.
Microform Edition ProQuest LLC.
All rights reserved. This work is protected against
unauthorized copying under Title 17, United States Code
ProQuest LLC.
789 East Eisenhower Parkway
P.O. Box 1346
Ann Arbor, MI 48106 - 1346
ii
BIOGRAPHICAL SKETCH
CPT (R) Preizer is a retired US Army Infantry officer. During his 22 year Army
career he rose thru the ranks from private to Company Commander. Along the
way he lead, trained and mentored US Army Rangers, future Army Officers and
newly commissioned Infantry LTs. He participated in Army level strategic
change initiatives and leadership transformation efforts. CPT(R) Preizer
participated in the formulation of the Warrior Ethos implementation plan for the
Army and was credited as the primary author of the Soldiers Creed (See
http://www.army.mil/values/soldiers.html ). After retiring from the Army, he was
directly involved in preparing deploying units for combat operations in Iraq and
Afghanistan, training and mentoring leaders from virtually every unit deployed
from 2005-2009. Currently he teaches organizational behavior and research
classes. His current research focus is leadership and performance management
specifically, employee evaluations and leader development.
iii
DEDICATION
This work is dedicated to my best friend (some say my only friend) my beautiful
wife Jacque, without her love and support this would not have been possible.
iv
ACKNOWLEDGMENTS
I would like to acknowledge the participation of the 1st Brigade Combat Team
82d Airborne Division Ft Bragg North Carolina.
TABLE OF CONTENTS
Page
BIOGRAPHICAL SKETCH
iii
DEDICATION
iv
ACKNOWLEDGMENTS
TABLE OF CONTENTS
vi
LIST OF FIGURES
viii
LIST OF TABLES
iv
ABSTRACT
Chapter 1: Introduction
Background
Transformational Leadership and Perceptions about Performance
Evaluation Effectiveness
Secure Work Base and Perceptions of Performance Evaluation
Effectiveness
Purpose
Significance
Definitions
12
Research Questions
15
4
7
16
16
Performance Management
19
Employee Evaluations
20
23
24
27
28
30
Control variables.
50
52
54
Research Design
54
Population Description
56
56
60
71
Statistical Analysis
73
vi
vii
74
76
76
82
83
84
86
86
87
87
88
90
91
95
96
102
105
109
111
113
116
120
122
124
128
129
129
130
134
135
139
140
142
142
144
145
164
172
LIST OF FIGURES
Figure 1.1 (Conceptualization of factors involved in the performance evaluation process)
Figure 1.2 (Conceptualization of the theoretical integration based on Leadership Theory)
Figure 2.1 (Conceptual Model)
Figure 3.1 (Study Population)
Figure 3.2 (Sample recruiting flyer)
Figuer 4.1 (Initial Measurment Model)
Figure 4. 2 (Measurement model after modification)
Figure 4.3 (Full Structural Model)
Figuer 4.4 (H1 SEM Path Analysis)
Figure 4.5 (H2 Models)
Figure 4.6 (H3 Model)
Figure 4.7 (H4 Model)
Figure 4.8 (H5 SEM Path Analysis Model)
Figure 4.9 (H6 Models)
Figure 4.10 (H7 Model)
Figure 4.11 (H8 Model)
Figuer 4.12 (H9 SEM Path Analysis)
viii
PAGE
3
11
29
59
72
93
94
101
104
108
110
112
115
119
121
123
126
LIST OF TABLES
Table 2.1 (Hypotheses)
Table 2.2 (Demographic Variables)
Table 3.1 (PE effectiveness scale Factor Analysis Pilot #1)
Table 3.2 (PE effectiveness scale Factor Analysis Pilot #2)
Table 4.1 (Population Demographics)
Table 4.2 (Descriptive statistics about the Performance Management System)
Table 4.3 (Scale summary descriptive statistics)
Table 4.4 (Confirmatory Factor Analysis PE Scale)
Table 4.5 (Confirmatory Factor Analysis SWB Scale)
Table 4.6 (Variable correlations)
Table 4.7 (Collinearity statistics)
Table 4.8 ((Summary of SEM model Fit Indices))
Table 4.9 (Significant Regression Weights, Standardized path coefficients for full
model)
Table 4.10 (H1 Summary)
Table 4.11 (H5 Summary)
Table 4.12 (H9 Summary)
Table 4.13 (Summary of Hypotheses Testing)
ix
49
50
63
66
77
81
82
84
86
89
90
96
98
103
114
125
127
ABSTRACT
This research set out to further theory within three broad areas. These areas are
transformational leadership theory (TL), secure work base theory (SWB) and the
study of performance management (PM) specifically the performance evaluation
(PE). Contributions to theory have been made by developing and testing nine
specific hypotheses. This study employed advanced mediation analysis and
structural equation modeling to analyze the nine hypotheses and found support for
all nine. The overall findings of this research are as follows: (1) there is a positive
significant relationship between TL and SWB and ratees perception about PE
effectiveness, (2) perceptions about PE effectiveness do mediate the
relationships between TL and work outcomes (unit cohesion, job satisfaction and
turnover intentions), (3) perceptions about SWB do mediate the relationship
between rater leadership style and work outcomes (unit cohesion, job satisfaction
and turnover intentions) and (4) there is a significant positive relationship
between ratees perceptions of SWB and ratees perceptions about PE
effectiveness. Significant to this research is the introduction of the construct of
perceived PE effectiveness. This study has resulted in validated scale to measure
this novel construct. The insights gained from this research will contribute to
theory as well as have managerial implications. This study provides information
that will help organizations develop and implement policies and procedures that
will lead to a more effective PE and ultimately a more efficient PM system.
Chapter 1: Introduction
Introduction
Employee performance management (PM) is an unavoidable element of
organizational life. As a point of fact, effective PM is a stated strategic goal of
most organizations (Longenecker & Fink, 1999). Past research has explored the
challenges associated with PM and identified effective PM as an essential leader
function (Jawahar, 2006; Pulakos & O'Leary, 2011; Roberts, 1994). In spite of
this focus, organizations tend not to have a validated framework for the execution
of this HR system (Fletcher, 2004). It is partly because of this strategic
importance that PM, specifically employee performance evaluations (PE)
continues to be one of the most widely researched areas in
industrial/organizational psychology (Murphy & Cleveland, 1995).
Within the research, several sub-topics relating to employee perceptions are
prevalent. The most researched subjects include employee satisfaction with the
PE, perceptions about the utility of the evaluation and employee perceptions about
the fairness of the PE (Cawley, Keeping, & Levy, 1998).
Even with this established research stream a significant gap in the
literature exists regarding some important relationships. First, there is little or no
specific research into followers perceptions about PE effectiveness. Secondly,
past studies lack any depth of inquiry into the relationship between the specific
skills, traits or attributes of the leader charged with performing the evaluation and
the followers perceptions about PE effectiveness. Finally, there is a gap in the
research into how perceptions about PE effectiveness affects other outcomes such
1
as perceptions of secure work base (SWB), job satisfaction, turnover intention and
unit cohesion.
Background
Practitioners sometimes refer to PM as the Achilles Heel of human
capital management (Pulakos & O'Leary, 2011). This perception is partly due to
the inherent complexities in both the design of an effective system and the actual
implementation of the evaluation process. In spite of this fact, it is unquestionably
important to have a system that is perceived by employees as being effective.
The PM process is a complex event that operates within the organization
and includes a wide range of activities. The purpose of the PM process is to
enhance the performance of individuals and groups, with the ultimate purpose of
improving organizational effectiveness (DeNisi, 2000). The PM process is
impacted by environmental, organizational and individual factors (Lawler, 2010).
Past research (Aguinis, 2007; Lawler, 2008, 2010) identifies four essential
activities (identified as pillars) of an effective PM system. First, the PM system
must outline a specific set of job requirements. These requirements must then be
associated with specific performance requirements. The important part of this
function is that these requirements are mutually agreed upon. Second, the PM
system must include processes that will provide for the development of
employees skills and knowledge. This development function facilitates the
effective performance development of required job functions. Third, the PM
system should be designed in such a way, as to motivate individuals to perform
effectively. Finally, the PM system should be linked (provide data to) to the
organizations human resource management systems.
G. E. Roberts (1994) points out that the effectiveness of a PM system is
particularly contingent on the attitudes of the users (i.e., both raters and ratees).
3
allow for direct sharing of ideas. The transformational leader will offer direct
recognition of each followers unique contributions, (3) Inspirational Motivation
transformational leaders are able to articulate a clear vision to followers. The
transformational leader imbues the follower with this vision to help followers
experience the same passion and motivation to fulfill these goals, and (4)
Idealized Influence The transformational leader is a role model for followers.
Followers naturally wish to emulate the transformational leader and will
internalize his or her ideals. This is due to the trust and confidence that the
transformational leader builds in the follower.
Bass further differentiates authentic transformational leadership from nonauthentic (pseudo-transformational) and transactional leadership by identifying
the moral foundation of truly transformational leadership. (Bass & Bass, 2008;
Bass & Riggio, 2006). Additionally, the leader who is viewed as transformational
must also be viewed as having charisma (Bass, 1990). Transformational leaders
provide followers with a clear sense of purpose that is energizing.
Transformational leaders provide a role model and builds identification with the
leaders vision (Avolio, 1999). Transformational leaders set examples that
followers want to emulate. Transformational leaders develop and use multiple
strategies that serve to empower followers, change values, norms and attitudes to
those that are consistent with the leaders vision (Bass, 1985; Conger, 1999).
Conger (1999) further make the point that this shared vision must be anchored in
a set of deeply held values as well as be linked to the fulfillment of followers
expectations of the leader. The effective transformational leader must regularly
fulfill the expectations followers have of their leader (Kuhnert & Lewis, 1987). In
order to fulfill these expectations leaders must understand that fulfillment of
followers expectations (whether established or fulfilled) must originate in the
personal values of the leader.
The model of transactional and transformational leaders (Bass, 1985)
contends that "most leaders do both (transformation and transaction) in different
amounts" and establishes a continuum of movement from transactional to
transformational leadership. It is important to note that this research does not look
at the relationship between the positive aspects of transactional leadership
(contingent reward) and work outcomes as evidenced in past research. For
example, Avolio and Bass (1995) found that the more effective leaders are those
are those that possess both transactional and transformational leadership.
Additionally, the positive aspects of transactional leadership have also shown
correlation with work outcomes such as job satisfaction, motivation and leader
performance (Judge & Piccolo, 2004).
Bass (1985) says The transactional leaders works within the
organizational culture as it exists; the transformational leader changes the
organizational culture. The transformational leader gains influence from the
demonstration of personal characteristics as described in Bass and Avolio (1988)
and Bass (1985). This influence should serve as a catalyst that influences ratees
perceptions about the PE.
Past empirical research and meta-analyses into TL has shown linkages
between this leadership styles and work outcomes such as unit cohesion,
performance, leader effectiveness, and job satisfaction (Bass, Jung, Avolio, &
Berson, 2003; Dumdum, Lowe, & Avolio, 2002; Lowe, Kroeck, &
Sivasubramaniam, 1996).
Secure Work Base and Perceptions of Performance Evaluation Effectiveness
Bowlby (1973) suggested that experiences of security within close
relationships helped to foster the development of a secure attachment. This leads
to the perception of a secure base from which individuals can interact with the
work environment unfettered by the worry of unfulfilled attachment needs.
Bowlby (1973) further described the concept of a secure base as
one of being available, ready to respond when called upon to
encourage and perhaps assist, but to intervene actively only when
clearly necessary. In these respects it is a role similar to that of the
officer commanding a military base from which an expeditionary
force sets out and to which it can retreat, should it meet with a
setback. Much of the time the role of the base is a waiting one but
it is none the less vital for that. For it is only when the officer
commanding the expeditionary force is confident his base is secure
that he dare press forward and take risks (p. 11).
Feeney and Thrush (2010) provide a view of the secure base that involved
three main behavioral tendencies: being available to fulfill a persons need in
comfort and assistance, encouraging a person to pursue his or her personal goals,
and not interfering with a persons initiatives and activities. These three
behavioral tendencies seem to match the three basic psychological needs (the
need for relatedness, the need for competence, the need for autonomy) identified
by Deci and Ryan (1985). Feeney and Thrush (2010) point out that
encouragement and acceptance of a persons exploration and autonomy needs will
motivate individuals to take on challenges, pursue personal goals, and learn new
skills and perspectives. It seems to be logical that individuals who are more
motivated by the sense of SWB will perceive more effective PE process. Noninterference is another important component of secure base provision discussed
by Feeney and Thrush (2010). Past research has shown managers who are
perceived as non-interfering (those who supported employee autonomy) had
employees who reported higher job satisfaction (Deci, Connell, & Ryan, 1989).
There is initial evidence that elements of SWB are related to positive work
outcomes such as unit cohesion (Mikulincer & Shaver, 2003) and negative
outcomes such as job burnout and job dissatisfaction (Ronen & Mikulincer,
2012).
The SWB base is a type of support that helps sustain a context-specific
sense of confidence in oneself as a valuable, competent, and autonomous member
of a working group (p.20). Building on SWB and TL theory this research will
explore the mediating effect of SWB on the link between TL and perception of
PE. This research posits that TL will enhance a sense of SWB among
subordinates and that this in turn will promote positive perceptions about the
effectiveness of the PE. Additionally, this research explored the mediating effect
of SWB on the relationship between rater TL and work outcomes (unit cohesion,
job satisfaction and turnover intentions).
Purpose
The broad purpose of this research is to further theory in three areas, TL,
SWB and PM. The narrow purpose is four fold, First, to study the effect TL and
SWB have on ratees perception about PE effectiveness. Second, this study will
explore the relationship between TL and perceptions about SWB. Third, this
study will investigate whether perceptions about PE effectiveness mediate the
relationships between TL and work outcomes (unit cohesion, job satisfaction and
turnover intentions). Finally, this research will study whether perceptions about
SWB mediate the relationship between rater leadership style and work outcomes
(unit cohesion, job satisfaction and turnover intentions).
Significance
There is a significant science-practice gap in the study of PM (Aguinis,
2007). Aguinis and Pierce (2008) go so far as to declare that entire bodies of
research remain ignored by managers and other organizational decision makers
(p.139). This research attempts to partially fill this gap as it applies to
understanding perceptions about PE effectiveness from the perspective of the
ratee. Additionally, the research provides specific actionable information to
organizations that will aid in the understanding of how TL and perceptions of
SWB affect perception about PE effectiveness. This is significant because it is
advancing the study of TL and SWB into the realm of PM (perceptions about PE
effectiveness). This is a research area that has yet to be explored. Also significant
is the studying of possible mediating effect SWB has on relationship between TL
and work outcomes (unit cohesion, job satisfaction and turnover intentions). This
understanding will aid organizations in the development and implementation of
9
10
(Alston & Mujtaba, 2009). Further, the evaluation system will not be effective if
the leader (rater) is unskilled at conducting the evaluation interview or fails to
provide clear guidance and counseling (Roberts, 2003). During the PE process
(see Figure 2), the leader must effectively communicate with the follower in an
effort to motivate and influence the follower to achieve specific outcomes
(Wisecarver, Schneider, Foldes, & Cullen, 2011). This research explored the
perceived effectiveness of PE as a leadership outcome influenced by the
leadership style of the rater.
Figure 1.2 (Conceptualization of the theoretical integration based on
Leadership Theory {Adapted from: Yukl, (2006) & Army FM 6.22, (2006})
12
1973, 1982) can and will apply to work situations. Additionally, the SWB
concept draws heavily on Self-Determination Theory (Deci et al., 1989; Deci &
Ryan, 1985, 2008) specifically arguing that for an individual to feel secure within
the work base his or her fundamental psychological needs (relatedness,
competence, and autonomy) must be met.
This research defines PE effectiveness as: the ratees conscious
recognition that the evaluation accurately and adequately evaluates his or her
actual performance over a set period of time, and that the evaluation is based on
goals and objectives developed jointly with the rater, further, that the ratee
perceives the evaluation system to be purposeful and useful to both the ratee and
the organization.
Unit cohesion is defined as the degree to which mechanisms of social
control operant in a unit maintain a structured pattern of social relationships
between unit members, individually and collectively, necessary to achieve the
unit's purpose (Siebold & Kelly, 1987, p.5). The components of small unit
cohesion outlined in Siebold, (1999) are: 1. horizontal cohesion-peer bonding
and teamwork; 2.vertical cohesion-leader caring and leader competence; and 3.
organizational cohesion-pride and shared values, and attainment of needs and
goals (p.19).
Job Satisfaction This research uses the widely used job satisfaction
definition of Locke, (1976) who defined JS as . . . a pleasurable or positive
emotional state resulting from the appraisal of ones job or job experiences (p.
1304).
13
14
Research Questions
This research address the following specific questions:
Research Question #1 What is the relationship between raters leadership style
and ratees perceptions about PE effectiveness?
Research Question #2 What is the relationship between raters leadership style
and ratees perceptions about SWB?
Research Question #3 What is the relationship between ratees perceptions of
SWB and ratees perceptions about PE effectiveness?
Research Question #4 To what extent do perceptions about PE effectiveness
mediate the relationship between rater leadership style and work outcomes (unit
cohesion, job satisfaction and turnover intentions)?
Research Question #5 To what extent do perceptions about SWB mediate the
relationship between rater leadership style and work outcomes (unit cohesion, job
satisfaction and turnover intentions)?
15
16
perceptions of the members. Leaders are agents of change - persons whose acts
affect other people more than other peoples acts affect them (Bass, 1990, p.18).
Leadership occurs when one group member modifies the motivation or
competencies of others in the group (Bass, 1990, p. 19-20). Bass further stated
that the transformational leader recognizes the transactional needs in potential
followers but tends to go further, seeking to arouse and satisfy higher needs, to
engage the full person of the follower to a higher level of need according to
Maslows hierarchy of needs (Bass, (1985, p. 20).
In 1995 Bennis and Nanus conducted a study with ninety top leaders.
They identified specific important leader traits. These traits included logical
thinking, persistence, empowerment, and self-control. They also identified the
articulated differences between transactional and transformational leaders making
the point that the transformational leaders job is to communicate vision and
values with significant clarity that enables self-empowered followers know where
to go (Bennis & Nanus, 1995).
Past research into associations between leadership orientations
(transactional vs. transformational) has reported links with a broad range of
follower outcomes (Avoilio, et. al., 2009). Additionally, past research included
reported findings that provide positive evidence linking TL (as well as the
positive contingent reward aspect of transactional leaders) to subordinates
satisfaction with their leaders (Bennett, 2009). Further, Bommer, Rubin, and
Baldwin (2004) found followers of transformational leaders are more likely to be
accepting of organizational change. In addition, studies have shown
17
18
more effective at all hierarchical levels and had positive impact on followers job
satisfaction and their attitudes toward their supervisors.
Bass and Riggio, (2006) make the point that future research needs to focus
on followers of transformational leaders. This research focuses on followers
perceptions (PE effectiveness and SWB) and the link between raters TL and
these perceptions. Additionally, this research focused on the predictive value of
those perceptions on work outcomes such as unit cohesion, job satisfaction and
turnover intention.
Performance Management
A 2006 survey of organizations from 15 different countries (60% being
multinational companies) reported that 91 percent implement some form of a
formal PM system (Cascio, 2006). Additionally, those organizations that operate a
formal and systematic performance management system are 51 percent more
likely to perform better than the other organizations on financial outcomes, and 41
percent more likely to perform better on other outcomes such as customer
satisfaction and employee retention (Cascio, 2006).
Cleveland, Murphy, and Williams (1989) outline six important purposes
of an effective PM system. The PM system has a strategic purpose - linking
organizational goals with individual goals. The PM system has an administrative
purpose- providing a source of valid and useful information to assist in decision
making about employee actions such as salary adjustments, promotions, employee
retention or termination, recognition of superior performance, identification of
poor performers, layoffs, and merit increases. The PM system has a
19
20
performance assessment, performance review, and performance renewal and recontracting). During the evaluation stage, the rater communicates to the ratee the
extent to which the desired behaviors have been displayed, and whether the
desired results have been achieved (Aguinis & Pierce, 2008). The evaluation of
employee performance is one of if not the most important roles of the human
resource (HR) function. Additionally, as pointed out in the introduction, employee
evaluation is one of the most widely researched areas in industrial-organizational
psychology (Fletcher, 2002; Murphy & Cleveland, 1991). Some researchers
(Derven, 1990) believe no PM system can be perfected to the point of being fully
useful therefore; scarce organizational resources are better used elsewhere. Others
believe that PM is a critical part of the functioning of an effective organization
(Lawrie, 1990) so it is appropriate to place emphasis on the development and
implementation of an effective system.
A review of the literature indicates that practitioners have a keen interest
in issues related to performance management. A simple Google search reveals no
shortage of practitioner related information about talent
management/development, leadership development, performance evaluations
(system related and individual techniques and best practices) as well as
technological (software) solutions to the issues involved with performance
management. These resources attempt to keep pace with the intensification of
work demands as employers try to increase productivity with fewer employees,
and managing change (Aguinis, 2007). An EBSCO Academic Search Complete
(from 2000-2012) resulted in excess of 500 articles published in peer reviewed
21
academic journals with the term performance appraisal in the title. This reflects
the interest in and the importance of the subject.
Over the past 20 years, research into employee evaluations has generally
focused on: (1) the PE systems purpose and or methods as related to
organizational outcomes (2) the individual employees perceptions of fairness and
justice and (3) the appraisal system as an antecedent for employee satisfaction.
There is a notable gap in the literature concerning ratees perceptions about PE
effectiveness and its influence on work-related outcomes.
In the academic realm, performance appraisal/feedback is a popular
research topic. In fact, from 2003-2007 performance appraisal/feedback was in
the top 5 of the most popular topics published in the Journal of Applied
Psychology (Cascio & Aguinis, 2008). It is evident that both academics and
practitioners are aware how the signals managers send out to their employees
through the design and implementation of their PM systems (specifically the PE)
impacts individual and organizational outcomes.
There is a consensus among performance appraisal researchers and
practitioners alike that the assessment of employees reaction to the
evaluation/appraisal is important but lacking (Keeping & Levy, 2000). Murphy
and Cleveland (1995) argue that in order for a performance evaluation to have a
positive influence on employee behavior, employees must perceive the appraisal
as effective. Even with this focus, no study heretofore has looked at the ratees
perceptions about PE effectiveness instead past research has focused on other
22
perceptions such as fairness with the process, perceptions about utility or use and
the satisfaction it raises among employees.
Even with this demonstrated amount of both practitioner and academic
research into the subject, consensus cannot be reached on- what is the most
effective way to perform evaluations or what the consequences for an improperly
managed evaluation system might be. This research attempts to provide insight
into PE effectiveness from the point of view of the recipient of the evaluation.
Employee reactions to performance evaluation
Past research on PE has focused on rating errors and rating accuracy with
less attention given to criteria such as subordinates' reactions to appraisals and the
factors contributing to these reactions (Cardy & Dobbins, 1994; Murphy &
Cleveland, 1995). More recently, a Pichler (2012) meta-analysis into the
literature on PE indicated that the perceptions of the ratee (i.e., satisfaction with
rater, perceptions of support received, trust in rater) are strongly related to ratee
reactions to PE.
Employee satisfaction with PE is the most frequently measured appraisal
reaction (Keeping & Levy, 2000). Ahmed, Hussain, and Ahmed, (2010)
conducted research to examine the impact of employee satisfaction with the PE on
employee overall job satisfaction and turnover intentions in SGOs of Pakistan.
This research found support for a positive relationship between satisfaction with
PE and employee overall job satisfaction and negative relationship between
satisfaction with PE and turnover intentions. Jawahar (2006) found satisfaction
with rater and previous performance ratings to positively influence employees
23
24
A study conducted by (Youngcourt, Leiva, & Jones, 2007) found that the
perceived purpose of the PE influences ratees perceptions of and attitudes toward
their jobs. Additionally, a positive relationship between employees attitudes and
procedurally just PE was also observed. Again, this research focused on attitude
relating to a specific question that had to do with the execution of the PE and not
the employees perceptions about PE effectiveness as with this study. The fact
that the individual sees a PE to be just (or fair for that matter) may not necessarily
indicate the employee perceived said PE to be effective.
Gabris and Ihrke (2001) examined the relationship between aspects of PE
(instrument validity, distributive justice, and procedural justice) and burnout and
job satisfaction. The results indicated a positive relationship between the three
justice-related variables and job satisfaction, and negative relationship between
procedural and distributive justice and job burnout within a sample of
professional county employees. This research focused on narrow elements within
the PE and although employees may perceive the instrument to be valid and the
PE to be executed in a just manner they may still not believe the PE was effective.
Boachie-Mensah and Seidu (2012) conducted a case study that focused on
employees perceptions of PE biases or errors such as the halo effect, leniency,
strictness or central tendency error that are common in PE literature (Fletcher,
2001; Hennessey & Bernardin, 2003). The results showed that employees
perceived that the PE system in their institutions is affected by subjectivity and by
common errors. Karimi, Malik, and Hussain (2011) examined the relationship
between the PE system and employee satisfaction within a sample of 101
25
26
that these constructs only provide general information and do not provide the
why. The construct of PE effectiveness allows for the gathering of specifics that
will lead to the ability to make recommendations on how to improve perceptions.
Performance Evaluation Effectiveness
Past literature (e.g., Cawley, Keeping & Levy 2001; Keeping & Levy,
2000; Murphy and Cleveland, 1995; Roberts, 2000, 2003, 2001;) indicates that
the definition of PE effectiveness should include factors related to the overall
effectiveness of the evaluation system as well as the overall effectiveness of the
employees last evaluation. Roberts (1994) proposed that followers acceptance of
the evaluation will be maximized when, the performance measurement process is
perceived to be accurate, the system is administered fairly, the appraisal system is
congruent or doesn't conflict with the employee's personal goals and values, and
when the appraisal process does not exceed the bounds of the "psychological
contract" between leader and the follower (p. 526). These factors are
incorporated into a measure of perceived PE effectiveness.
27
28
29
Hypotheses
The concepts behind TL form the essence of what the US Army calls
adaptive leadership (U.S. Army doctrine Field Manual 6.22). Adaptive leaders
are able to build teams, operate within established intent and take required actions
to move a group of individuals towards a desired end state in an ambiguous
environment. An adaptive leader (Bass, 1985 labeled this type of adaptive
leadership as transformational) works effectively in rapidly changing
environments by helping to make sense of and responding to the challenges
confronted by both leaders and followers. An adaptive leader will work with and
develop followers abilities to handle a broader range of leadership
responsibilities (Bass et al., 2003).
Part of every leaders responsibility is to conduct effective PE on
individuals within his or her team or organization. The US Army teaches and
trains its leaders that, to be perceived as effective during the PE process leaders
must demonstrate certain qualities (respect for followers, self and cultural
awareness, credibility and empathy) and skills (active listening, responding and
questioning) (Army Leadership, 1999, 2006). There is a commonality between
these qualities and skills and those of the transformational leader.
TL comprises four primary behaviors (Bass, 1985). First, a
transformational leader exhibits idealized influence, by demonstrating consistency
and reliability and thus gaining the trust of others. If the individual being
evaluated trusts the evaluator, he or she is must more likely to be open and this
openness should lead to stronger feelings about the effectiveness of the
30
31
(Cawley, Keeping, & Levy, 1998). Contrast this with the transactional rater that
would hold ratees to achieving agreed-upon objectives (unemotionally, black and
white) but would not fulfill psychological needs of the ratee or encourage them to
assume greater responsibility for developing and leading themselves (Bass, 1985;
Burns, 1978). This research hypothesized that: the rater who is more
transformational will have ratees that perceive the PE to be more effective.
H1: There is a positive relationship between rater TL and ratee perceptions
about PE effectiveness
TL effect on work outcomes (job satisfaction, turnover intention and unit
cohesion) is well researched. Transformational leadership has been shown to have
positive influence followers performance and innovation (Boerner, Eisenbeiss, &
Griesser, 2007). Transformational leadership is also more significantly associated
with team cohesiveness, work unit effectiveness and organizational learning as
compared to other leadership styles (Lowe et al., 1996; Stashevsky and
Koslowsky, 2006; Zagorsek et al., 2008). Further, past meta-analysis into
associations between leadership orientations and work outcomes has reported
links with a broad range of follower outcomes (Avolio, Reichard, Hannah,
Walumbwa, & Chan, 2009; Judge, & Piccolo, 2004; Lowe et al., 1996).
Past research into the effect that TL has on unit cohesion has shown it to
have a positive effect (Bass et al., 2003; Hardy, Arthur, Jones, Shariff, Munnoch,
Isaacs, & Allsopp, 2010). The components of unit cohesion outlined in Siebold
(1999) are: 1. horizontal cohesion-peer bonding and teamwork; 2.vertical
cohesion-leader caring and leader competence; and 3. organizational cohesion-
32
pride and shared values, and attainment of needs and goals (p.19). Using the
above definition it can be assumed that cohesion will be increased by
strengthening the bond between the individual leader and the lead, the lead and
the organization and the individual and the organization. Critical also is ensuring
that members of the group are aware of and have by in to the values of the
group. An effective PE that does not conflict with the employee's personal goals
and values but enhances their feelings of pride and attraction to the group will
increase feeling of unit cohesion (Roberts, 1994). The PE that is perceived to be
effective will increase the individuals understanding and acceptance of the
organizational goals as well as strengthen the bond with the leader thereby
increasing feelings of unit cohesion. Additionally, the perception that an
individual is being developed (through an effective PE process) according to his
or her capabilities should increase the vertical bond and thereby strengthen feeling
of cohesion. Gesme and Wiseman (2011) claim that not having an effective PE
system will result in poor office morale, inefficiency, and high turnover rates,
logically we may add low feeling of unit cohesion to this list of negative
outcomes. It is logical to assume that an effective PE evaluation will assist in
providing for the development of bonding within all three components of small
unit cohesion.
One of the reasons for the success of the US military is its understanding
and effective application of leadership, development of leaders, and arguably
most importantly the emphasis on team building and team unit cohesion. Both
Peter Drucker and Jack Welch were once asked a question ---- who does the best
33
job of developing leaders? Without hesitation, both stated that if you really want
to understand leadership and leader development, look to the United States
military. The PE is a forum for the development of ratee and serves as conduit for
the imparting of organizational information. This forum should lead to more
positive feelings of unit cohesion (if perceived to be effective). It is for this
reason that this research hypothesized raters who are identified as
transformational leaders would have ratees who display more feelings of unit
cohesion and that perceptions about the PE would mediate this relationship.
H2: Ratee perceptions of PE Effectiveness will mediate the relationship
between rater TL and ratees feelings about unit cohesion.
Job satisfaction is a feeling of general, overall, or global satisfaction with
the job as a whole (Thompson & Phua, 2012). Satisfaction with the job is an
important job attitude. As with all attitudes, job satisfaction is influenced by the
individuals views about the organization as well as views about the leadership of
the organization (Judge & Kammeyer-Mueller, 2012). Past literature has stated
that to be effective the PE should address satisfaction with the job (Fletcher, 2001;
Roberts, 2003). Since it is likely that individuals perceptions about the
effectiveness of their PE will contribute to the evaluation of overall or global job
satisfaction, it is also likely that a more positive perception about the PE will
result in more positive overall job satisfaction.
Transformational leaders are more likely than not to voluntarily assist
employees with issues and are better at creating an environment that is proactive
in preventing the occurrence of work-related problems (Berson & Avolio, 2004).
34
35
36
leave. Research has shown the importance on the quality of the employeeorganizational relationship with links being established between turnover
intentions and employee affective commitment (Kuvaas, 2008; Meyer, Stanley,
Herscovitch, & Topolnytsky, 2002) and perceived organizational support and
justice perceptions (Rhoades & Eisenberger, 2002; Shore & Strauss, 2008). An
effective PE can be seen as an integral part of the employee-organizational
relationship and reduce turnover intentions.
Griffith (2004) suggests that an individuals overall satisfaction within the
work environment includes satisfaction with their leader and that this satisfaction
in turn has influence over the individuals intention to leave. Individuals who
have higher turnover intentions are further along in the process of disengagement
from an organization. Individuals with higher reported turnover intention caused
by a dysfunctional relationship with the leader are more likely to display intent to
leave (Joiner, Bartram, & Garreffa, 2004). Past meta-analysis within the turnover
literature (Cotton & Tuttle, 1986; Griffeth et al., 2000) has shown a negative
relationship between satisfaction with a supervisor and actual turnover.
An effective PE should retard the process of disengagement by helping to
develop skills in the rater that allow for the development in the organization. Also
the effective PE will decrease intentions to leave by providing a voice to the
employee that allows for open communication. The increased communication
allows the ratee to develop a sense of hope, optimism and trust in the
organization. Transformational leaders are able to motivate followers in such a
way as to develop higher levels of organizational commitment, trust and optimism
37
(Bass & Riggio, 2006). Employees who are more committed will have less
turnover intentions (Rafferty & Griffin, 2004; Scandura & Williams, 2004).
Based on past research this research proposed raters who are identified as
transformational to have ratees who display less turnover intention and
perceptions about the PE will mediate this relationship.
H4: Ratee perceptions of PE Effectiveness will mediate the relationship
between rater TL and ratees turnover intention.
Ronen and Mikulincer (2012) view SWB as a sense of security that
develops from interactions with the organization or any of its members (p.30).
Perception of a SWB will include the ratee feeling that they are provided the
required support when needed, that their capabilities and efforts are being
affirmed and appreciated, and that their acts and initiatives are not being
interfered or interrupted. These three behavioral tendencies seem to match up with
TL behaviors. That is, inspirational motivation involves inspiring others to pursue
goals; intellectual stimulation involves stimulating others and encouraging
creativity (initiative) among followers; idealized influence involves acting as a
role model for followers and finally, individualized consideration involves being
supportive and encouraging to followers as individuals.
The rateerater leader relationships can be said to function in many
respects as an attachment relationship such as that of child and a parent
(Mayseless & Popper, 2007). Further, it can be expected that ratees will form
relationships with their rater that will reflect attachment dynamics (Mayseless &
Popper, 2007). The provision of security and protection (the safe haven and the
38
39
1999; Bass, 1990). A rater with more TL characteristics will be more likely to
treat ratees as individuals with different needs, abilities, and aspirations rather
than just as members of the group. The transformational rater will be more
effective at helping to develop ratees strengths while attentively listening to the
ratees concerns.
Ronen and Mikulincer (2012) explain SWB as a type of support that helps
sustain a context-specific sense of confidence in oneself as a valuable, competent,
and autonomous member of a working group (p. 20). Leadership styles that
emphasize empowering followers (e.g., transformational) are more likely to foster
an emotional feeling such as those associated with a secure workplace base. This
research proposed that raters who display more transformational characteristics
will have ratees who perceive more of a SWB.
H5: There is a positive relationship between rater TL and ratee perceptions
about SWB
Groups are seen to be as cohesive when and if the members of the group
are displaying positive behaviors and have positive attitudes and whenever
interactions sustain these conditions (Friedkin, 2004). The concept of
cohesiveness as explored within this research (Siebold & Kelly, 1988) deals with
the extent to which the mechanisms of social control maintain a structured
pattern of social relationships between unit members (p.2). These relationships
include those between peers (described as horizontal bonding), between leaders
and subordinates (vertical bonding) and relationships between individuals and the
organization (organizational bonding). The transformational leader serves as an
40
attachment figure through which the subordinate draws inspiration and energy and
is therefore more likely to feel bonded to the leader (vertical cohesion). The
transformational leader also has the ability to communicate vision. This leads to
organizational buy-in and therefore increased organizational bonding
(organizational cohesion).
The characteristics of the transformational leader are proposed to
influence all three of these relationships. The transformational leader and has the
ability to impart vision, provide support, empower and develop subordinates
(Carless et al., 2000). These positive characteristics are proposed to lead to greater
feelings of cohesion. Additionally, the transformational leader shares power and
information, is innovative and inclusive. Theoretically the transformational leader
possesses the requisite qualities that should lead to increased vertical and
organizational bonding and therefore more feelings of cohesion (Bass et al., 2003;
Hardy et al., 2010). Additionally, past research within the military context (Bass
et. al., 2003) has shown TL to be positively related to unit cohesion.
Perceptions of a SWB also should contribute to shared perceptions about
the organization. SWB develops from interactions with the organization or any
of its members . . . their acts and initiatives are not being interfered or interrupted
(Ronen & Mikulincer, 2012, p.30). Unit cohesion is a unit or group state varying
in the extent to which the mechanisms of social control maintain a structured
pattern of positive social relationships (bonds) between unit members,
individually and collectively, necessary to achieve the unit or groups purpose
(Siebold & Kelly, 1988). Given the similarity in the components of these two
41
psychological states, it makes sense that there should be some link between them.
This research proposes that SWB will contribute to the understanding of why TL
and cohesion are related.
The individuals perception of SWB is proposed to influence how bonded
the individual will feel to both the leader and the organization. When an
individual evaluates the level of care, cooperation, and support he or she feels in
his or her group the resulting feeling can be described as a feeling of unit
cohesion (Ronen & Mikulincer, 2012). Therefore, an individual who does not
perceive an adequate level of care, cooperation, and support is less likely to feel
bonded to the individual leader or the organization. Individuals who perceive a
SWB can count on others to be available in times of trouble and are willing to
take risks because they perceive others to be their safety net (Ronen & Lane,
2013). Individuals who perceive a SWB also perceive the environment to be
encouraging. These individuals believe that they will receive praise in the form of
positive compliments. This individual perceives the work environment as one that
encourages forward momentum (Ronen & Lane, 2013). Siebold and Kelly
(1988) define horizontal bonding as the extent to which peers trust and care
about one another (p.2) and vertical bonding as the degree to which leaders look
out for and help their subordinates (p.2). These components of SWB (availability
and encouragement) are proposed to impact on the development of both vertical
and horizontal bonding and therefore have a mediating effect on the relationship
between TL and perceptions of cohesion.
42
H6: Ratee perceptions of SWB will mediate the relationship between rater
TL and ratees perceptions about unit cohesion
As outlined in the literature review, past research has shown that TL to
have significant influence on the job satisfaction and behaviors of followers
(Nemanich & Keller, 2007; Scandura & Williams 2004). The transformational
leader ". . . recognizes and exploits an existing need or demand of a potential
follower. . . [and] looks for potential motives in followers, seeks to satisfy higher
needs, and engages the full person of the follower" (Burns, 1978, p.4). The rater
who is perceived as being transformational will be more available and responsive
to the ratee. This availability and responsiveness will be seen as supportive and
therefore increase the ratees sense of security. This increased sense of security
will should manifest as stronger perceptions of job satisfaction (Mikulincer &
Shaver, 2005).
The perception of a SWB assists the individual in developing his or her
positive sense of autonomy, commitment and satisfaction within the workplace
(Ronen & Mikulincer, 2012). The perception of SWB should also lead to higher
feelings of confidence that he or she is a valuable autonomous member of a
working group (Ronen & Mikulincer, 2012) therefore becoming more committed
to the organization.
Self-determination theory (Deci & Ryan, 1985, 2008) holds the view that
an individuals natural or intrinsic functioning will be either facilitated by or
impeded by the social context. Through the process of integration the
transformational leaders values (and therefore the organizations values) are
43
44
Hackett, & Allen, 1995; Martin & Epitropaki, 2001; Rafferty & Griffin, 2004;
Wells & Peachey, 2010) has reported that transformational leaders tend to have
employees that show lower intent to leave than employees working for leaders
with other styles.
A perception of a SWB can be considered an indicator of organizational
support (Ronen & Mikulincer, 2012) in that the employee will feel as though they
have a positive connection to the workplace and that the work base provides
adequate support to the individuals as to foster secure feelings. This positive
connection can also be explained as being embedded or committed to the
organization.
Organizational commitment theory is influenced by psychological
attachment theory in that an individual who forms an attachment to the
organization also displays affective commitment to the organization.
Organizational commitment as defined by Meyer et al. (2002) includes three
components (affective or want to stay, continuance or have to stay and
normative or ought to stay). Organizational commitment has been linked to
increased turnover (Meyer, et., al., 2002). Further, research into voluntary
turnover within the military context has consistently shown a negative
relationship between an individuals level of organizational commitment and
turnover intention (Godlewski & Kline, 2012; Holt, Rehg, Lin, & Miller, 2007;
Lytell & Drasgow, 2009). The perception of a secure work should lead to
increased affective commitment and affective commitment has been shown to be
negatively related to turnover intentions.
45
46
47
has a perception of a SWB will see the rater as more available and the increased
perception of availability will contribute to positive perceptions regarding the PE.
The ratee who is more secure within the workbase is more likely to be receptive.
This receptivity to rater input is critical to the rate being able to perceive the PE to
be effective. The need for competence is met when the ratee believes his or her
actions will bring about desired outcomes, this will be confirmed during an
effective PE process. Positive feedback provided during the PE will reinforce the
feeling of competence.
Kaymaz (2011) found that effective use of PE reduces performance
ambiguity and subsequently has a positive effect on motivation. The perception of
a SWB should also contribute to reduction of ambiguity and the building of
motivation (Ronen & Mikulincer, 2012). This research posits that more positive
perceptions of a SWB should have positive effect on perceptions about PE
effectiveness. H9 posits that when the ratees needs are being met within the work
base (the need for comfort and assistance (relatedness), the need to feel
encouraged to pursue personal goals (competence), and the need to not have
personal initiatives and activities interfered with (autonomy) it is also more likely
that the ratee will also have more positive perceptions about the effectiveness of
the PE
H9 There is a positive relationship between ratee perceptions of a SWB and
ratee perceptions about PE effectiveness
48
Statement
There is a positive relationship between rater TL and ratee perceptions about PE effectiveness
Ratee perceptions of PE effectiveness will mediate the relationship between rater transformational
leadership and and ratees feelings about unit cohesion.
Ratee perceptions of PE effectiveness will mediate the relationship between rater TL and and
ratees job satisfaction.
Ratee perceptions of PE effectiveness will mediate the relationship between rater TL and and
ratees turnover intention.
There is a positive relationship between rater TL and ratee perceptions about SWB.
Ratee perceptions of SWB will mediate the relationship between rater TL and ratees perceptions
about unit cohesion
Ratee perceptions of SWB will mediate the relationship between rater TL and ratees perceptions
about job satisfaction.
Ratee perceptions of SWB will mediate the relationship between rater TL and ratee turnover
intention.
There is a positive relationship between ratee perceptions of SWB and ratee perceptions about PE
effectiveness
49
Control variables.
The survey will include the following control variables: I will gather
organizationally reported data on the overall positivity or negativity of the
individual participants last performance evaluation to control for ratee bias. In
addition, we will gather data on subordinate attachment styles.
Past research has shown individuals identified as attachment avoidant tend
to present negative descriptions of others, show negative expectations about their
behaviors, and attribute their negative behaviors to other causes (Ronen &
Mikulincer, 2009). Additionally, anxiously attached individuals are highly
sensitive to signals of social disapproval, criticism, or rejection, (Ronen &
Baldwin, 2010) . Further, anxiously attached people will tend to refrain from
pursuing autonomous goals such as those that are fostered by a transformational
leader and developed during effective PE (Ronen & Mikulincer, 2012).
Secure individuals report higher levels of job satisfaction, less
interpersonal problems inside or outside of the workplace, higher work-related
self-efficacy, and more trust in peers and supervisors (Hazan & Shaver, 1990;
Ronen & Mikulincer, 2012). Since this research is designed to study the
relationship between individual perceptions (PE effectiveness, SWB, rater
leadership) and work outcomes (job satisfaction, turnover intention and cohesion)
and past research indicates that subordinates attachment styles are associated
with their perceptions of supervisors leadership styles (Popper, Mayseless, &
Castelnovo, 2000), as well as with perceptions of work attributes and outcomes it
is prudent to control for attachment styles when assessing the relationships
50
between SWB and leaders leadership styles and between SWB and perceived PE
Effectiveness and work outcomes.
Demographic Control Variables - Because education, experience (tenure),
the level of the leader and the number of individuals the leader is required to
evaluate may be related to how effective the evaluation is (and by inference how
effective the follower perceives the evaluation to be) and the effectiveness of the
evaluation is not a measurable construct these variables omission could
potentially bias the regression coefficients. I will therefore include these variables
as controls. In addition, one might conjecture that variations may be influenced
or explained by the difference in organizational norms and standards. Therefore, I
will control for organizational type in the analyses.
Table 2.2 (Demographic Variables)
Demographic Data
1
Type of Organization
Education Level
Rank
Duty Position
51
52
Research Institute), Sean Hannah (COL (R) US Army, United States Military
Academy Department of Behavioral Science and Leadership) and Bruce Avolio
(served as co-principal investigator in projects sponsored by the U.S. Army
Research Institute for the Behavioral and Social Sciences) and others as it pertains
to leadership and leader actions within the military context. Also, as I have not
found any application of research into effectiveness of employee evaluations in a
military context, this will expand the study of employee reactions to evaluations
into the military context.
53
54
deductive scale development, refining the research topic, research questions and
development of the theoretical definition of the PE construct. The endstate of
stage I established content validity formulating the PE effectiveness scale and
framed the overall research. During this stage (in conjunction with a thorough
literature review) data was collected through expert interviews from experts (n=8)
ranging from experienced direct supervisors to former United States Army
general officers and senior executives. Secondly, during stage I a pilot study
(using the PE scale created during stage I) was conducted. The pilot study was a
web based cross sectional data collection (n=97).
Stage II, gathered data to explore the nomological network of the PE scale
in order to provide evidence that this scale has construct validity (Cronbach &
Meehl, 1955). This study was a web based cross sectional data collection (n=154)
to examine the predictive, concurrent and discriminant validity of the PE
effectiveness scale.
Stage III, was a quantitative data collection and analysis conducted on-site
with the research population used for hypothesis testing (n=348). Stage IV was
continuation of the quantitative data collection with the survey population through
web based data collection (n=193). Due to the operational tempo of the survey
population and the cycle of performance evaluations (Annual evaluation) it was
necessary to collect the data over a long period of time. This stage continued for 8
months. This allowed the researcher to maximize the number of individuals who
had been evaluated in the current period as well as reduce the impact of individual
55
56
excess of 1300 leaders. The participants were recruited through the brigades
chain of command. For the onsite data collection, the brigade commander and his
staff communicated to subordinate commanders the time and place where the
survey was to be issued and specific timeline was published. This timeline
established specific groupings (by rank and duty position). Specific instructions
were given that groups cannot include both ratees and raters from the same
organization. Individuals who showed up were afforded the opportunity to leave
should they not wish to participate. Individuals who wished to participate
reported, received a briefing, signed the informed consent document and
completed the survey. For the web based data collection a link to the online
version of the survey was sent to the brigades operation officer who distributed
the link through the brigades chain of command.
Since the research is using structural equation modeling for final data
analysis and sample size is critical to reducing error, the Mitchell rule of thumb
(sample size of 10 to 20 times the number of variables, (Garson, 2008) was
applied. The final model contained 10 variables (Global TL, 2 dimensions of
perceived PE effectiveness, 3 dimensions of perceptions about the SWB, 2
dimensions of unit cohesion, job satisfaction, and turnover intentions) setting the
minimum sample size at 200. This is the minimum number of cases required to
ensure the sample is above the minimum number required for a power level of
.80. The actual number of responses received was well beyond the 200 case
minimum at 541 cases (348 from onsite data collection and 198 from web based
collection). After cleaning the data to remove records that were not complete or
57
those that contained excessive missing data, of the 541 participants 524 (96%)
completed the entire survey. This provided a final sample of 524 usable cases,
which was well above the required 200 cases.
58
KeyLeader&StaffSurvey
BDECDR,XOandCSM
BattalionCDRs,XOsandCSMs
BDEandBNprimarystaffofficersandkey
SNCOs(S1,S2,S3,S4,S6)
Company/battery/troopCDRs,XOsand1SGs
SmallUnitLeader&SoldierSurvey
AllPLsandPSGs
AllSquadLeaders
59
60
on content validity. That is, items had to assess the specific interest (perceived
effectiveness of PE) and not extraneous constructs.
Questions were developed and a pilot was conducted using this scale (PE
Effectiveness Items 1-26). Factor analysis was used to examine the stability of
the structure (and confirm the expected two factor solution) and to report on the
internal consistency of the scale. Questions 1-4 gathered demographic data.
Questions 5-16 measured individual followers perceptions of effectiveness related
to the evaluation system. Individuals were asked to rate a series of questions on a
5 point Likert scale with 1 being strongly disagree and 5 being strongly agree.
Example questions include: The Evaluation System is effective at motivating
employees and The Evaluation System is effective at establishing goals for
performance. In addition, questions 17-26 measure individual followers
perceptions of effectiveness regarding their last evaluation. Individuals are asked
to rate a series of questions on a 5 point likert scale with 1 being strongly disagree
and 5 being strongly agree. Example questions include: My last evaluation
provided accurate feedback on my past performance and My last evaluation
provided me with the tools to improve my performance.
Pilot study #1
The population consisted of working adults with government, US military
and civilian occupations. Link to survey was emailed to professional and personal
contacts on LinkedIn and Facebook resulting in 97 acceptable responses. 84.5
percent of the respondents have been evaluated in their position. 56.7 percent did
not complete a self-evaluation as part of the performance evaluation process. 64.9
61
percent did sit down and discuss the evaluation face to face. Also, 44.3 percent
describe the professional development process in their organization as an ongoing
development process with multiple meaningful engagements, 21.6 percent say the
professional development process in their organization is top down with one way
communication and 34 percent say there is no formal process followed.
Factor Analysis- a Principal Component Analysis (PCA) of 22 of the 26
Likert scale questions from the perceived effectiveness survey was conducted on
data gathered from 97 participants. An examination of the Kaiser-Meyer Olkin
measure of sampling adequacy suggested that the sample was factorable
(KMO=.93 , .6 is a suggested minimum). Using SPSS (Varimax with Kaiser
Normalization rotation method) loadings less than 0.30 were excluded and the
analysis yielded the expected two factor solution with a simple structure (factor
loadings =>.30). Additionally, Cronbachs coefficient alpha was used to test for
internal consistency. The alpha coefficient for the 22 items is 0.96, suggesting that
the items have relatively high internal consistency.
62
63
Component
PEsys PEev
.668
.704
.749
.820
.886
.859
.863
.782
.735
.715
.841
.878
.796
.808
.744
.759
.763
.804
.718
.855
.831
.846
Pilot study #2
Pilot Study # 2 gathered data to explore the nomological network of the
scale in order to provide evidence that this scale has construct validity (Cronbach
& Meehl, 1955). Two items were removed from the analysis of the scale (The
professional development process in my organization is effective and Apart
from the annual evaluation, I receive effective professional development). These
items measure perceptions about the overall professional development process
verses the PE process.
The population consisted of working adults within the Clarksville,
Tennessee City Government, US military and civilian occupations. Link to survey
was emailed to professional and personal contacts on LinkedIn as well as to
leadership within the City of Clarksville Parks Department. The resulting sample
included in 149 acceptable responses. 83% of the respondents have been
evaluated in their position. 69% reported that they did sit down and discuss the
evaluation face to face with their rater, 56.4% describe the professional
development process in their organization as an ongoing development process
with multiple meaningful engagements, 17% reported the professional
development process in their organization as top down with one way
communication and 27% reported there is no formal process followed.
Another factor analysis (again using PCA) of the 20 Likert scale questions
from the perceived effectiveness survey was conducted on data gathered from 149
participants. An examination of the Kaiser-Meyer Olkin measure of sampling
adequacy suggested that the sample was factorable (KMO=.935, .6 is a suggested
64
65
66
Component
PEsys PEev
.791
.785
.793
.794
.833
.792
.693
.762
.730
.809
.846
.825
.760
.722
.676
.708
.734
.724
.687
.782
reduce the number of items in the total survey, transformational leadership was
measured using a short measure of TL, the Global Transformational Leadership
scale (GTL) (Carless, Wearing & Mann, 2000). This scale was developed then
validated using a sample of business leaders in Australia (n=1440) Exploratory
and confirmatory analysis showed high convergent validity with the Multifactor
Leadership Questionnaire (MLQ; Avolio, Bass, & Jung, 1995) with correlations
ranging from .71 to .87. The alpha coefficient (.93) supports the GTL as reliable
measure of TL. The scale includes seven items designed to measure a global
measure of TL (Carless et al., 2000). The items measure seven behaviors; (1)
communicates a vision, (2) develops staff, (3) provides support, (4) empowers
staff, (5) is innovative, (6) leads by example, and (7) is charismatic. (Carless, et
al., 2000; p.390). The alpha coefficient for the 7 item scale computed for Pilot #2
(n=149) is =0.961, suggesting that the items have relatively high internal
consistency. Reliability test results computed using the final sample are reported
in the validity and reliability Analyses section of Chapter 4.
Unit cohesion. Unit cohesion was measured using a modified version of
the Platoon Unit cohesion Index (PCI) as reported in Siebold and Kelly (1988).
This measure was developed to be a shortened tool developed using the
psychometrically best items from the Combat Platoon Cohesion Questionnaire
(Siebold & Kelly, 1988). The long-form scales correlate with the short-form
scales at .8 (Siebold & Kelly, 1988). Unit cohesion is conceptualized in terms of
horizontal, vertical, and organizational bonding. The PCI consists of 20 items that
form 3 horizontal, 12 vertical, and 5 organizational bonding scales. I modified the
68
language in the survey to measure unit cohesion from the perspective of the SSG
and above. A sample item from the PCI includes First-termers in this platoon
uphold and support Army values and Leaders in this platoon uphold and support
Army Values. For example, Soldiers in my unit uphold and support Army
values and Leaders in my unit uphold and support Army Values. Other scales
using modified versions of this scale such as 20 item Unit Cohesion Index,
developed by (Mangelsdorff, Stokes, & Jacobs, 1990) report high reliability
coefficients (.94). Yagil (1995) reported reliability coefficients of .75 to .89 for
the sub scales of the 20 item PCI. Reliability test results computed using the final
sample are reported in the validity and reliability Analyses section of Chapter 4.
Job Satisfaction job satisfaction was measured using Brayfield and
Rothe (1951) 5 item job satisfaction scale. The calculated alpha coefficient for the
5 item scale computed for Pilot #2 (n=149) is =0.873, suggesting that the items
have relatively high internal consistency. Reliability test results computed using
the final sample are reported in the validity and reliability Analyses section of
Chapter 4.
Turn over intention turnover intention was measured using a three-item
measure developed by Konovsky and Cropanzano (1991) Konovsky and
Cropanzano (1991). Konovsky and Cropanzano (1991) report an alpha value of
.84 for this scale. Items are 'I intend to look for a job outside of the Army within
the next year," 'I intend to remain in the Army indefinitely'(reverse-scored), and 'I
often think about quitting the Army.' The calculated alpha coefficient for the
unmodified 3 item scale computed for Pilot #2 (n=149) is =0.844, suggesting
69
that the items have relatively high internal consistency. Reliability test results
computed using the final sample are reported in the Validity and Reliability
Analyses section of Chapter 4.
Perceptions of Secure work base will be measured with the Secure Work
base scale from Ronen & Lane (NP). This scale conceptualizes SWB in terms of
availability, (example question is I do not generally count on others at work to be
available to help out if I run into trouble when pursuing personal goals (reverse
coded)), reduced intrusiveness, (example question At work, when I am working
on something difficult or challenging, others sometimes try to take over and do it
for me) and encouragement, (example question. At work, others are praising me
when I do a good job. Reliability test results computed using the final sample are
reported in the validity and reliability Analyses section of Chapter 4.
Attachment Style was measured using the Experience of Relationships Scale (
ERS; Richards & Schat, 2011). The ERS is an adapted version of Brennan et al.s
(1998) measure. References to romantic partners in the items are replaced with
other people or others. The scale consists of 36-items measuring two
dimensions of attachment: anxiety (18 items) and avoidance (18 items). Sample
items are I worry a fair amount about losing my connections with others
(anxiety) and I dont feel comfortable opening up to other people (avoidance).
Responses were provided on a 5-point scale ranging from strongly disagree to
strongly agree. Reliability test results computed using the final sample are
reported in the Validity and Reliability Analyses section of Chapter 4.
70
Data Collection
Permission to conduct this research was be secured from US Army Human
Research Protections Office,theFort BraggHuman Research Protections Office
and the TUI University Institutional Review Board prior to commencement of
data collection. A letter of introduction and request to participate in the research
study was be made to the 1st Brigade Combat Team. The brigade commander
agreed to participate and assigned the brigade operations officer as organization
point of contact to facilitate participant recruitment. The method of data collection
was self-report questionnaire. Data was collected using the scales discussed
above using field study approach (Bass, et., al., 2003).
Contact was established with the organizations point of contact and a time
was established for the first data collection. The initial data collection was
conducted on site at Ft Bragg over a three day period. The chain of command
distributed a flyer (see FigX) that invited participation and established a timeline
where each group reported to designate classroom received an in brief, signed the
Informed Consent Document, completed the survey and departed. A total 348
individuals participated in the onsite data collection. In order to maximize
participation an online version of the survey was created using GoogleDocs. A
web link to the survey was sent to the organizations point of contact for
distribution through the chain of command. The web based data collection yielded
an additional 193 participants.
71
72
Statistical Analysis
Prior to conducting data analysis the responses were checked for accuracy
and completeness. Since the sample was large enough (n=541) and the amount of
missing data was minimal the listwise deletion (Complete Case Analysis) method
was used. The resulting usable sample was n=524. The data analysis addressed
three questions relating to the hypothesized relationship between the variables: (1)
what is the probability that the relationship exists? (2) how strong is the
relationship? and (3) How strong and in what direction do the hypothesized
mediating variables affect the relationship(s)? Data was analyzed using the
Statistical Package for the Social Sciences (SPSS) Graduate Pack/ Amos Graphics
18.0 and 21.0 for Windows. Structural Equation Modeling (SEM) techniques
were used to estimate the fit of the model that has been hypothesized in Figure 3.
SEM allows for the testing of overall model fit, and the interrelationships between
the variables (Raykov & Marcoulides, 2000). SPSS/AMOS-21 (SEM) was used
as an extension of the regression model to test the fit of the correlation matrix
against the models. The path analysis runs a regression for each variable in the
model as a dependent on others which the model assumes have a specific
relationship. The regression weights predicted by the model are then compared
with the observed correlation matrix for the variables, and a goodness of-fit
statistic calculated. The best-fitting of two or more models is then selected as best
model for advancement of theory. The model presented included several
mediators. SEM is more efficient at model specification and proving estimation
options and is overall a less problematic method of testing mediation (Preacher &
Hayes, 2008). The test for mediation follows the two-step method recommended
73
by Anderson and Gerbing (1988). Step one examines the model of the variables
by using confirmatory factor analysis (CFA). This process estimates the loadings
of the manifest indicators on their respective latent variables (Ronen &
Mikulincer, 2012). The structural model is tested in the second step. Additionally,
the research used the Preacher and Hayes (2008) bootstrapping method for testing
multiple mediation models with manifest variables using INDIRECT procedure
with SPSS v21.
Participant Safety and Confidentiality
There were no physical risks associated with this study. The risks to
subjects are of a psychological and social nature. These risks are just as real to the
subjects who experience them. It is possible that negative emotions may be
drawn out through participation in this study as a result of the nature of the
subject (PE). These emotions could lead to both short and longterm emotional
suffering. In addition, breaches of confidentiality (about the effectiveness of the
leader performing the PE, followers perceptions about the effectiveness of the
PE, followers turnover intention and job satisfaction) could be stigmatizing,
place a subject at risk of damage to a subjects reputation and or standing in the
organization. Lastly, the possibility of retribution is a concern should the leader
become aware of the followers perceptions. These risks were minimized with
careful planning. For example, because strong emotions could possibly be
released as a result of participation, I will conduct a separate pre-brief to leaders
and followers addressing the possible negative impacts and provide coping
strategies as well as ensure all risks are clearly stated in the application and are
74
part of the consent process. Participation in this research was voluntary, and with
the permission of the command. Confidentiality was promised to the participants
and carefully kept. Only authorized project personnel have access to data. All
participants were fully informed as to the purpose of the research and assured that
all data collected on them will be completely confidential.
75
76
Percent of population
(n=524)
Education
High School
13.4
Some College
34.2
Associates Degree
10.1
Baccalaureate Degree
33.0
Masters Degree
8.8
.2
.4
Duty Position
Squad Leader
22.9
Section Leader
8.8
Platoon Sergeant
13.0
Platoon Leader
10.3
Company Commander
6.9
Battalion Commander
2.7
Staff Officer
12.4
Staff NCO
10.1
Battalion XO
1.1
77
Percent of population
(n=524)
.4
1.7
First Sergeant
4.8
Company XO
4.6
Brigade Commander
.2
Brigade XO
.2
24.8
18.3
Rate two
13.5
43.3
Population Average
Age
31.59
Tenure
10.06
78
79
80
8.2
Disagree
20.4
33.8
Agree
30.9
Strongly Agree
6.7
11.1
Disagree
19.5
27.9
Agree
31.7
Strongly Agree
9.9
81
82
83
Goodness of Fit Index (GFI, .98) and Adjusted Goodness of Fit Index (AGFI, .98)
are >0.9 reflecting a good fit.
Table 4.4 (Confirmatory Factor Analysis PE Scale)
CFA Measurement Model PE Effectiveness Scale
Fit Index
2 Factor Model
Benchmark
182.93 (p<.001)
CFI
.98
>.95
NFI
.98
>.95
GFI
.96
>.95
AGFI
.98
>.95
RMSA
.03
85
2 Factor Model
Benchmark
59.78 (p<.001)
NFI
.98
>.95
GFI
.98
>.95
AGFI
.98
>.90
RMSA
.05
Bonding,) with a simple structure (factor loadings =>.40). Additionally, the alpha
coefficient for the subscales (HB, = .782, OB, =.896, VB, =.899) indicates that
the items have relatively high internal consistency.
Scale Correlation Analysis
A Pearson Product-Moment Correlation Coefficient (r) was calculated to
explore the strength and significance of relationships between the variables. The
Pearson correlations matrix, shown in Table 4.6 below, displays the calculated rvalue and associated p value for each correlation. The r-value indicates the
strength of the relationship between the two intersecting variables. The
corresponding p values are interpreted as the probability of Type I error
(inappropriately rejecting the null hypothesis). A p value < .05 is the typical
standard for rejecting the null hypothesis that that there is no significant
relationship between the two variables. All correlations between the variables in
this research were significant at p < .05.
88
3. SWBAv
4. SWBAu
1
1
.37**
-.023
.028
1
-.050
-.020
1
.286**
5. SWBEn
-.040
-.044
.720** .290**
6. HorBon
1. AVOID
2. ANX
-.092
-.090
.516
**
**
.442**
**
**
-.062
-.069
.462
8. TurnInt
-.039
.006
9. JobSat
-.075
-.073
10. GTL
-.093
-.093
11. PEsys
-.052
-.061
12. PEev
13. Tenure
-.034
.010
.525
**
.502
**
**
.262
**
.231
10
11
.505
**
.565
**
.573
.545**
.411
**
.146
13
**
.501
**
.395
1
1
**
.575**
**
**
.589
.475
.274
1
.570**
12
7. OrgBon
.297
**
.237
.473
**
**
.371
-.049
.017
.090
.103
.084 .112
**. Correlation is significant at the 0.01 level (2-tailed). n=524
*. Correlation is significant at the 0.05 level (2-tailed).
89
**
.374
.013
**
.344
.131
**
**
.450
**
.198
**
.702**
**
.068
.060
.543
.141
Collinearity
Tolerance VIF
.659 1.517
SWB Availablity
SWB Autonomy
.908 1.101
SWB Encouragement
.610 1.640
Global TL
.647 1.547
.673 1.486
PE System
Model DV PeSys
Last PE
SWB Availablity
SWB Autonomy
SWB Encouragement
Global TL
Model DV PEeV
Collinearity
Tolerance VIF
.613 1.632
SWB Encouragement
Global TL
.624 1.603
PE System
.535 1.869
Last PE
.565 1.770
SWB Availablity
.666 1.501
Model DV SWBAv
SWB Autonomy
SWB Encouragement
Global TL
PE System
Last PE
Model DV SWBAu
Model DV SWBEn
Global TL
PE System
Last PE
SWB Availablity
SWB Autonomy
90
Collinearity
Tolerance VIF
.715 1.398
.685 1.460
.914 1.094
.610 1.641
.638 1.568
Collinearity
Tolerance VIF
.917 1.090
.695 1.438
.618 1.618
.552 1.813
.565 1.771
Collinearity
Tolerance VIF
.646 1.548
.536 1.866
.570 1.756
.759 1.318
.920 1.087
Measurement Model
In preparation to conduct hypothesis testing using structural equation
modeling, an additional EFA was conducted using SPSS v 21 (Principle Axis
Factoring with Promax rotation method). This was conducted in order to obtain a
pattern matrix. The Pattern matrix was inputted into AMOS v. 21 to create the
measurement model (Fig. 4.1). Next, a confirmatory factor analyses was
conducted. A test of the initial measurement model (Fig, 4.1) resulted in two of
three acceptable fit indices, 2(1917, n = 524) = 3540.347, p = .00; NFI = .866;
CFI = .933; RMSEA = .040. The NFI was not at the acceptable level of .90. The
expected reasons for this lack of model fit where, the presence of significant
cross loading in the organizational bonding and vertical bonding scales and the
presence of several items that displayed extremely low factor loadings in the
measurement model. Using the modification indices in AMOS 21 an iterative
process was followed, testing additional modified models after removing those
that significantly cross loaded (less than .2 difference) and low regression weights
(below .65). The resulting measurement model (Fig. 4.2) included a combined
latent factor comprised of items from the organizational bonding and vertical
bonding scales into a single measure of organizational bonding. This is
theoretically sound since both vertical and organizational bonding measure a
feeling of cohesion vertically (Siebold & Kelly, 1986).
The final measurement model (Fig. 4.2) the measurement model resulted
in good fit indices, 2(1102, n= 524) = 1920.166, p = .00; NFI = .908; CFI = .958;
RMSEA = .038. Once the model was completed composite variables were created
91
using the impute variables function in AMOS v 21. The correlations between the
latent variables are presented; all loadings and correlations are statistically
significant (p < .01).
92
93
94
Hypothesis Testing
There are 6 major components to hypothesis testing. First, analyze the
direct relationship between TL and PE. Second, evaluate the mediating effect that
PE has on the relationship between TL and work outcomes (JS, TI, OrCoh).
Third, analyze the direct relationship between TL and SWB. Fourth, evaluate the
mediating effect that as the SWB has on the relationship between TL and work
outcomes (JS, TI, OrCoh). Fifth, analyze the direct relationship between SWB
and PE. Finally, evaluate the full structural model.
Initial Hypothesis testing was conducted using the Statistical Package for
the Social Sciences (SPSS) Graduate Pack 18.0 for Windows. Multiple regression
analysis was conducted to compare the direct correlations between the
independent and dependent variables. This series of regression analyses were
conducted to provide preliminary support for the hypothesized direct
relationships. In order to account for the influence of other variables (indirect)
within the relationships, each hypothesis along with the entire model was again
tested using Statistical Package for the Social Sciences (SPSS/AMOS) Graduate
Pack 21.0 for Windows.
95
Benchmark
P value not significant
CFI
.98
>.95
GFI
.98
>.95
AGFI
.98
>.95
NFI
.98
>.95
RMSA
.05
96
The full structural model tested a total of 47 paths (see figure 4. ). Of the
paths analyzed 29 indicated significant effects (had a significant path coefficient).
When evaluating the total effects (direct effects and indirect effects) Eleven paths
indicated a large significant total effect (>.25), 13 paths indicated a medium
significant total effect (.10-.25) and five paths indicated a small effect (.01-.09).
In 19 paths there was a change in the total effect indicating the presence of an
intervening (indirect effect).
97
Table 4.9 (Significant Regression Weights, Standardized path coefficients for full
model with significance and effect size)
Path
Direct
Effect
Sig
Total
Effect
Estimated
Effect Size
Effect
SWBEn
<--- GTL
0.57
***
0.57
Large
0.00
JobSat
<--- GTL
0.21
***
0.56
Large
0.35
PEsys
<--- GTL
0.35
***
0.55
Large
0.20
PEev
<--- GTL
0.40
***
0.54
Large
0.14
SWBA
<--- GTL
0.50
0.50
Large
***
v
0.00
HorBon
<--- PEsys
0.49
***
0.49
Large
0.00
OrgBon
<--- GTL
0.17
***
0.49
Large
0.32
JobSat
<--- PEsys
0.42
***
0.42
Large
0.00
TurnInt
<--- SWBEn
0.34
***
0.39
Large
0.05
HorBon
<--- SWBAv
0.26
***
0.37
Large
0.11
OrgBon
<--- PEsys
0.35
***
0.35
Large
0.00
PEsys
<--- SWBAv
0.25
***
0.25
Medium
0.00
JobSat
<--- SWBEn
0.19
***
0.24
Medium
0.05
SWBA
<--- GTL
0.23
0.23
Medium
***
u
0.00
OrgBon
<--- SWBEn
0.19
***
0.23
Medium
0.04
PEev
<--- SWBEn
0.20
***
0.20
Medium
0.00
TurnInt
<--- PEev
0.16
**
0.16
Medium
0.00
PEsys
<--- SWBEn
0.16
**
0.16
Medium
0.00
OrgBon
<--- SWBAu
0.18
***
0.14
Medium
-0.04
TurnInt
<--- PEsys
0.13
0.13
Medium
0.00
98
Path
Direct
Effect
Sig
Total
Effect
Estimated
Effect Size
Effect
JobSat
<--- D4
0.12
***
0.12
Medium
0.00
TurnInt
<--- D4
0.10
**
0.10
Medium
0.00
HorBon
<--- SWBAu
0.12
***
0.08
Medium
-0.04
JobSat
<--- SWBAu
0.10
**
0.06
Medium
-0.04
OrgBon
<--- D4
-0.07
-0.07
Possible Small
0.00
PEsys
<--- SWBAu
-0.09
**
-0.09
Possible Small
0.00
JobSat
<--- PEev
-0.09
-0.09
Possible Small
0.00
HorBon
<--- PEev
-0.10
-0.10
Possible Small
0.00
TurnInt
<--- SWBAv
-0.17
**
-0.12
Possible Small
0.05
PEev
<--- SWBAu
-0.03
ns
-0.03
ns
0.01
PEev
<--- SWBAv
0.08
ns
0.08
ns
0.00
TurnInt
<--- GTL
-0.01
ns
0.26
ns
0.27
HorBon
<--- GTL
0.01
ns
0.39
ns
0.38
OrgBon
<--- PEev
-0.09
ns
-0.09
ns
0.00
HorBon
<--- SWBEn
0.01
ns
0.07
ns
0.06
TurnInt
<--- SWBAu
0.03
ns
0.01
ns
-0.02
JobSat
<--- SWBAv
0.07
ns
0.17
ns
0.10
OrgBon
<--- SWBAv
0.06
ns
0.14
ns
0.08
TurnInt
<--- ANX
0.03
ns
0.03
ns
-0.01
JobSat
<--- ANX
-0.01
ns
-0.01
ns
0.00
OrgBon
<--- ANX
-0.01
ns
-0.01
ns
0.00
HorBon
<--- ANX
-0.02
ns
-0.02
ns
0.00
TurnInt
<--- AVOID
-0.02
ns
-0.02
ns
0.00
JobSat
<--- AVOID
-0.02
ns
-0.02
ns
0.00
99
Path
Direct
Effect
Sig
Total
Effect
Estimated
Effect Size
Effect
OrgBon
<--- AVOID
-0.03
ns
-0.03
ns
0.00
HorBon
<--- AVOID
-0.06
ns
-0.06
ns
0.00
HorBon
<--- D4
0.05
ns
0.05
ns
0.00
100
101
102
H1: There is a positive relationship between rater TL and ratee perceptions about
PE effectiveness
To test H1, a multiple regression analysis (using MOS as categorical
selection variable and controlling for AT and Tenure) was conducted to determine
if rater transformational leadership is positively related to ratee perceptions about
the performance evaluation (PEeF) (combined term from perception about the PE
system (PEsys) and perceptions about the last evaluation (PEev)). As discussed
in chapter three, the analysis controlled for attachment style, type of organization
(combat arms, combat support, and combat service support) and tenure. The
resulting regression analysis indicates that, on average, rater transformational
leadership (GTL) had a significant positive effect on ratee perceptions about the
PEeF for all three organization types (Table 4.12). The analysis reveals support
for H1 with the expected variation between organization types.
For individuals with combat arms job type, the overall model indicates
that GTL accounts for approximately 35% of variability between TL and PEeF
(F(3, 305) =54.19,p<.001, R2=.35). Both tenure and attachment style are significant
contributors to the model. For individuals with combat support job type, the
overall model indicates that GTL accounts for approximately 22% of variability
between TL and PEeF F(3, 301) =9.70,p<.001, R2=.22 ). Interestingly, both tenure
and adult attachment style are not significant predictors to the model. For
individuals with combat service support job type, the overall model indicates that
GTL accounts for approximately 33% of variability between TL and PEeF. F(3,
105)
predictor in the model. Due to the limitations of SPSS further analysis was
conducted within the full structural model. The path coefficients (direct effects)
as shown in the full structural model indicated moderate to large effect (PEsys <-- GTL 0.35***, R2 .41 and PEev <---GTL 0.40***, R2 .34 ). Hypothesis 1 is fully
supported.
Table 4.10 (H1 Multiple Regression Analysis Summary)
Combat Arms
Combat Support
Combat Service
Support
Variable B
SE B
GTL
0.14
0.12
Tenure
0.62
0.04
AT
-0.30 0.13
R2
R2 = 0.35
R2 = 0.22
R2 = 0.22
F=(3,305) = 54.12***
F=(3,101) = 9.70***
F=(3,105) = 9.70***
n=309
SE B
SE
B
.58*** 1.09
0.22
.45***
1.32
0.20
.54***
-0.03*
0.04
0.26
0.18**
.02*
-.08
0.08
.05(ns)
n=105
103
n=109
104
Figuer 4.4 (H1 Path Analysis as tested within the full structrual model)
105
H2: Ratee perceptions of PE effectiveness will mediate the relationship between
rater transformational leadership and and ratees feelings about unit cohesion.
To test the mediation hypotheses a multiple mediation using
bootstrapping in SPSS v21 (Preacher & Hayes, 2008) was conducted. The
Preacher and Hayes (2008), INDIRECT procedure indicated partial mediation in
the full model. Hypothesis 2 is partially supported
Model 1(H2): DV = OrgBon, IV = GTL, MEDS = PEsys, PEev
1) "a" path (GTL PEsys, GTL - PEev): the path coefficient from GTL
to PEsys is .52 , p<.001 and the path from GTL to PEev is .50, p<.001.
2) "b" path (PEsys OrgBon controlling for GTL, PEev OrgBon
controlling for GTL): the path coefficient from PEsys OrgBon is .30, p<.001
however, the path coefficient from PEev OrgBon is not significant, p=.2464.
3) "c" path (GTL to OrgBon without PEsys,PEev ie. Total effect) is .34
p<.001.
4) "c' " path (GTL to OrgBon, controlling for the PEsys and PEev is Direct
effect) is .20 p<.001.
5) R square = .3181 indicates 32% of variance in the OrgBon is accounted
for by the GTL and PEsys/PEev.
6) Bootstrapped tests of the indirect effects indicate that the true total
indirect effect is 95% likely to range from .0879 to .1866 the estimated effect is
.1309. Zero does not occur between the LL and the UL therefore we can conclude
that the total indirect effect is significant
7) For the individual mediators, the indirect effects show the indirect effect via
PEsys is 95% likely to range from .1078 and .2080 and the estimated effect is
.1539. Again, zero does not occur between the LL and the UL and we can
conclude that the indirect effect for PEsys is significant. The indirect effect via
PEev is 95% likely to range from -.0747 and .0196 and the estimated effect is .0231. For PEev zero is included in the confidence interval, therefore the indirect
effect is not significant.
Model 2(H2): DV = HorBon, IV = GTL, MEDS = PEsys, PEev
1) "a" path (GTL PEsys, GTL - PEev): the path from GTL to PEsys is
.52 , p<.001 and the path from GTL to PEev is .50, p<.001.
2) "b" path (PEsys HorBon controlling for GTL, PEev HorBon
controlling for GTL): the path coefficient from PEsys HorBon is .56, p<.001
however, the path coefficient from PEev HorBon (-.11) is not significant,
p=.0493 (although not by much).
3) "c" path (GTL to HorBon without PEsys,PEev, (total effect) is .36,
p<.001.
4) "c' " path (GTL to HorBon, controlling for the PEsys and PEev (direct
effect) is .13 p<.01.
5) R square = .3415 indicates 34% of variance in the HorBon is accounted
for by the GTL and PEsys/PEev.
6) Bootstrapped tests of the indirect effects indicate that the true total
indirect effect is 95% likely to range from .1789 to .3015 the estimated effect is
106
.2396. Zero does not occur between the LL and the UL therefore we can conclude
that the total indirect effect is significant
7) For the individual mediators, the indirect effects show the indirect
effect via PEsys is 95% likely to range from .2274 and .3675 and the estimated
effect is .2883. Again, zero does not occur between the LL and the UL and we can
conclude that the indirect effect for PEsys is significant. The indirect effect via
PEev is 95% likely to range from -.1063 and -.0041 and the estimated effect is .0487. For PEev, zero is not included in the confidence interval; therefore the
indirect effect is significant.
107
108
109
7) For the individual mediators, the indirect effects show the indirect
effect via PEsys is 95% likely to range from .2365 and .3893 and the estimated
effect is .3082. Again, zero does not occur between the LL and the UL and we can
conclude that the indirect effect for PEsys is significant. The indirect effect via
PEev is 95% likely to range from -.1144 and .0242 and the estimated effect is .0445. For PEev zero is included in the confidence interval, therefore the indirect
effect is not significant.
Figure 4.6 (H3 Model)
110
111
effect is .0853. Again, zero does not occur between the LL and the UL and we can
conclude that the indirect effect for PEsys is significant. The indirect effect via
PEev is 95% likely to range from 0346 and 1758 and the estimated effect is .1091.
For PEev, zero is not included in the confidence interval; therefore the indirect
effect is also significant.
Figure 4.7 (H4 Model)
112
H5: There is a positive relationship between rater TL and ratee perceptions about
SWB.
To test H5, a multiple regression analysis (using MOS as categorical
selection variable and controlling for AT and Tenure) was conducted to determine
if rater transformational leadership is positively related to perceptions about the
secure work base (SWB) (Autonomy (SWBAu), availability, (SWBAv) and
encouragement, (SWBEn). Because of the limitations of SPSS a composite
variable SWB (comb) was created. The resulting regression analysis indicated
that, on average, rater transformational leadership had a significant positive effect
with SWB. The overall model indicates that for individuals with combat arms job
type, the overall model indicates that GTL accounts for approximately 36% of
variability between TL and SWB F=(3,305)=57.46,p<.001, R2=.361). Attachment
style is a significant contributor to the model. For individuals with combat support
job type, the overall model indicates that GTL accounts for approximately 32% of
variability between TL and PEeF F=(3,101)=16.10,p<.001, R2=.32 ). Again, only
attachment is a significant predictor to the model. For individuals with combat
service support job type, the overall model indicates that GTL accounts for
approximately 35% of variability between TL and PEeF. F=(3,105)=19.13,p<.001,
R2 =.35). Again, adult attachment style is the only additional significant predictor
in the model. Due to the limitations of SPSS further analysis was conducted
within the full structural model. The path coefficients (direct effects) as shown in
the full structural model indicated moderate to large effect (SWBAv<---GTL,
113
<--- GTL,
Combat Support
Combat Service
Support
B
SE B
Variable
SE B
SE B
GTL
0.44
0.04
.47***
0.27
0.08
0.29***
0.45
0.07
0.5***
Tenure
0.04
0.05
0.04(ns)
-0.01
0.09
-0.01(ns)
0.01
0.08
0.01(ns)
AT
-0.09
0.02
-0.29(ns)
-0.14
0.03
-0.44***
-0.07
0.03
-0.23**
R2
R2 = 0.36
R2 = 0.32
R2 = 0.35
F=(3,305) = 57.46***
F=(3,101) = 16.10***
F=(3,105) = 19.13***
n=309
n=105
n=109
114
Figure 4.8 (H5 Path Analysis as tested within the full structural model)
115
116
H6: Ratee perceptions of SWB will mediate the relationship between rater TL and
ratees perceptions about unit cohesion
To test the mediation hypotheses a multiple mediation using bootstrapping
in SPSS v21 (Preacher & Hayes, 2008) was conducted. The preacher and Hayes
(2008), INDIRECT procedure indicated mediation in the model. There are
significant total indirect effects, therefore hypothesis 6 is supported.
Model 5 (H6) DV = OrgBon, IV = GTL, MEDS = SWBEn, SWBAv, SWBAu
1) "a" path (GTL SWBEn, GTL SWBAv, GTL - SWBAu): the path
coefficient from GTL to SWBEn is .51 p<.001, the path coefficient from GTL to
SWBAv is .42 p<.001 and the path coefficient from GTL to SWBAu is .23
p<.001.
2) "b" path (SWBEn OrgBon controlling for GTL, SWBAv OrgBon
controlling for GTL, SWBAu OrgBon controlling for GTL): the path coefficient
from SWBEn OrgBon is .18 p=.0001. The path coefficient from SWBAv
OrgBon is .12, p=.0088, the path coefficient from SWBAu OrgBon is .09
p=.0004.
3) "c" path (GTL to OrgBon without SWBEn, SWBAv or SWBAu, (total
effect) is .34 p<.001.
4) "c' " path (GTL to OrgBon, controlling for the PEsys and PEev (direct
effect) is .17 p<.01.
5) R square = .3341, (p<.001) indicates 33% of variance in the OrgBon is
accounted for by the GTL, SWBEn, SWBAv and SWBAu.
6) Bootstrapped tests of the indirect effects indicate that the true total
indirect effect is 95% likely to range from .1167 and .2115 the estimated effect
is .1626. Zero does not occur between the LL and the UL therefore we can
conclude that the total indirect effect is significant
7) For the individual mediators, the indirect effects show the indirect
effect via SWBEn is 95% likely to range from .0416 and .1504 and the estimated
effect is .0905. Again, zero does not occur between the LL and the UL and we can
conclude that the indirect effect for SWBEn is significant. The indirect effect via
SWBAv is 95% likely to range from .0008 and .0979 and the estimated effect is
.0498. For SWBAv, zero is not included in the confidence interval; therefore the
indirect effect is also significant. . The indirect effect via SWBAu is 95% likely to
range from .0077 and .0438 and the estimated effect is .0223. Once again, zero is
not included in the confidence interval; therefore the indirect effect is also
significant.
Model 6 (H6) DV = HorBon, IV = GTL, MEDS = SWBEn, SWBAv, SWBAu
1) "a" path (GTL SWBEn, GTL SWBAv, GTL - SWBAu): the path
coefficient from GTL to SWBEn is .51 p<.001, the path coefficient from GTL to
SWBAv is .42 p<.001 and the path coefficient from GTL to SWBAu is .23
p<.001.
2) "b" path (SWBEn HorBon controlling for GTL, SWBAv TI
controlling for GTL, SWBAu HorBon controlling for GTL): the path coefficient
from SWBEn HorBon is .42 and is not significant p=.2490. The path
coefficient from SWBAv HorBon is .07 p<.001, the path coefficient from
SWBAu HorBon is .07 p=.0501.
3) "c" path GTL to HorBon without SWBEn, SWBAv or SWBAu, (total
effect) is .37 p<.0001.
117
4) "c' " path (GTL to HorBon, controlling for the PEsys and PEev (direct
effect) is .14 p=.0007.
5) R square = .2988, (p<.001) indicates 30% of variance in the HorBon is
accounted for by the GTL, SWBEn, SWBAv and SWBAu.
6) Bootstrapped tests of the indirect effects indicate that the true total
indirect effect is 95% likely to range from .1562 and .2871 the estimated effect
is .2229. Zero does not occur between the LL and the UL therefore we can
conclude that the total indirect effect is significant
7) For the individual mediators, the indirect effects show the indirect
effect via SWBEn is 95% likely to range from -.0301 and .1146 and the estimated
effect is .0339. For SWBEn zero does fall within the CI therefore the indirect
effect for SWBEn is not significant. The indirect effect via SWBAv is 95% likely
to range from .1035 and .2442 and the estimated effect is .1723. For SWBAv,
zero is not included in the confidence interval; therefore the indirect effect is
significant. The indirect effect via SWBAu is 95% likely to range from -.0008
and .0394 and the estimated effect is .0167. Once again, zero is included in the
confidence interval; therefore the indirect effect is also not significant.
118
119
H7: Ratee perceptions of SWB will mediate the relationship between rater TL and
ratees perceptions about job satisfaction.
To test the mediation hypotheses a multiple mediation using
bootstrapping in SPSS v21 (Preacher & Hayes, 2008) was conducted. The
preacher and Hayes (2008), INDIRECT procedure indicated mediation in the
model. Once again there are significant total indirect effects, therefore hypothesis
7 is supported.
Model 7 (H7 DV = JS, IV = GTL, MEDS = SWBEn, SWBAv, SWBAu
1) "a" path (GTL SWBEn, GTL SWBAv, GTL - SWBAu): the path
coefficient from GTL to SWBEn is .51 p<.001, the path coefficient from GTL to
SWBAv is .42 p<.001 and the path coefficient from GTL to SWBAu is .23
p<.001.
2) "b" path (SWBEn JS controlling for GTL, SWBAv JSI controlling
for GTL, SWBAu JS controlling for GTL): the path coefficient from SWBEn
JS is .30 p<.001. The path coefficient from SWBAv JS is .25 p<.0001, the path
from SWBAu JS is .08, p<.0001.
3) "c" path (GTL to HorBon without SWBEn, SWBAv or SWBAu, (total
effect) is .67 p<.0001.
4) "c' " path (GTL to JS, controlling for the PEsys and PEev (direct effect)
is .40, p<.0001
5) R square = .4298, (p<.001) indicates 43% of variance in the JS is
accounted for by the GTL, SWBEn, SWBAv and SWBAu.
6) Bootstrapped tests of the indirect effects indicate that the true total
indirect effect is 95% likely to range from .2084 and .3566 the estimated effect
120
is .2746. Zero does not occur between the LL and the UL therefore we can
conclude that the total indirect effect is significant
7) For the individual mediators, the indirect effects show the indirect effect via
SWBEn is 95% likely to range from .0730 and .2409 the estimated effect is .1522.
For SWBEn zero does not fall within the CI therefore the indirect effect for
SWBEn is significant. The indirect effect via SWBAv is 95% likely to range from
.0367 and .1713 the estimated effect is .1032. For SWBAv, zero is not included
in the confidence interval; therefore the indirect effect is also significant. The
indirect effect via SWBAu is 95% likely to range from -.0001 and .0433 and the
estimated effect is .0192. Zero is included in the confidence interval; therefore the
indirect effect is not significant.
Figure 4.10 (H7 Model)
121
H8: Ratee perceptions of SWB will mediate the relationship between rater TL and
ratees perceptions about turnover intentions.
To test the mediation hypotheses a multiple mediation analysis using
bootstrapping in SPSS v21 (Preacher & Hayes, 2008) was conducted. The
preacher and Hayes (2008), INDIRECT procedure indicated mediation in the
model. There are significant total indirect effects mostly coming from SWBEn,
therefore hypothesis 8 is partially supported.
Model 8 (H8 DV = TI, IV = GTL, MEDS = SWBEn, SWBAv, SWBAu
1) "a" path (GTL SWBEn, GTL SWBAv, GTL - SWBAu): the path
coefficient from GTL to SWBEn is .51 p<.001, the path coefficient from GTL to
SWBAv is .42 p<.001 and the path coefficient from GTL to SWBAu is .23
p<.001.
2) "b" path (SWBEn TI controlling for GTL, SWBAv TI controlling for
GTL, SWBAu TI controlling for GTL): the path coefficient from SWBEn TI
is .45, p<.001. The path coefficient from SWBAv TI is -.15, p=.0493, the path
coefficient from SWBAu TI is .02 and not significant p=.6368.
3) "c" path (GTL to HorBon without SWBEn, SWBAv or SWBAu, (total effect)
is .28, p<.0001.
4) "c' " path (GTL to TI, controlling for the SWBEn, SWBAv and SWBAu (direct
effect) is .11, p<.0001
5) R square = .1478, (p<.001) indicates 14% of variance in the TI is accounted for
by the GTL, SWBEn, SWBAv and SWBAu.
6) Bootstrapped tests of the indirect effects indicate that the true total indirect
effect is 95% likely to range from .1066 and .2418 the estimated effect is .1732.
122
Zero does not occur between the LL and the UL therefore we can conclude that
the total indirect effect is significant
7) For the individual mediators, the indirect effects show the indirect effect via
SWBEn is 95% likely to range from .1513 and .3154 the estimated effect is .2284.
For SWBEn zero does not fall within the CI therefore the indirect effect for
SWBEn is significant. The indirect effect via SWBAv is 95% likely to range from
-.1253 and .0005 the estimated effect is.-.0594. For SWBAv, zero is included in
the confidence interval; therefore the indirect effect is not significant. The indirect
effect via SWBAu is 95% likely to range from -.0184 and .0275 and the estimated
effect is .0042. Zero is included in the confidence interval; therefore the indirect
effect is not significant.
Figure 4.11 (H8 Model)
123
H9: There is a positive relationship between ratee perceptions of SWB and ratee
perceptions about PE effectiveness
A multiple regression (using MOS as categorical selection variable and
controlling for AT and Tenure) was run to predict perceptions about PE
effectiveness from SWB. For all three groups SWB statistically significantly
predicted PEeF, For Combat Arms, perceptions about SWB accounted for 35% of
the variance in perception about PE effectiveness, F=(3,305)=55.40,p<.001, R2 =
.353. For Combat Support, perceptions about SWB accounted for 31% of the
variance in perception about PE effectiveness F=(3,101)=15.33,p<.001 R2 =.313.
Finally, for Combat Service Support, perceptions about SWB accounted for 27%
of the variance in perception about PE effectiveness F=(3,105)=12.915,p<.001 R2=
.270. For each group all but tenure added statistically significantly to the
prediction, p < .01.
Due to the limitations of SPSS further analysis was conducted within the
full structural model. The path coefficients (direct effects) as shown in the full
structural model indicated moderate effect (PEsys <--- SWBAv 0.25***, PEsys
<--- SWBAu -0.09**, PEsys <--- SWBEn 0.16**, PEev
PEev <--- SWBAu -0.03 (ns), PEev <--- SWBAv
fully supported.
124
Combat Support
Variable
SE B
SE B
SE B
PEef
0.17
0.02
.46***
0.10
0.03
0.26**
0.14
0.03
0.40***
Tenure
0.07
0.05
0.07(ns)
0.03
0.09
0.03(ns)
0.08
0.09
0.08(ns)
AT
-0.11
0.02
-0.30***
-0.14
0.03
-0.45***
-0.07
0.03
-0.23**
R2
R2 = 0.36
R2 = 0.31
R2 = 0.27
F=(3,305) = 55.40***
F=(3,101) = 15.33***
F=(3,105) = 12.92***
n=309
n=105
n=109
125
126
Figuer 4.12 (H9 Path Analysis as tested within the full structrual model)
127
Hypothesis
Statement
There is a positive relationship between rater TL and ratee perceptions about PE
effectiveness
Ratee perceptions of PE effectiveness will mediate the relationship between rater
transformational leadership and and ratees feelings about unit cohesion.
Ratee perceptions of PE effectiveness will mediate the relationship between rater TL
and and ratees job satisfaction.
Ratee perceptions of PE effectiveness will mediate the relationship between rater TL
and and ratees turnover intention.
There is a positive relationship between rater TL and ratee perceptions about SWB.
Ratee perceptions of SWB will mediate the relationship between rater TL and ratees
perceptions about unit cohesion
Ratee perceptions of SWB will mediate the relationship between rater TL and ratees
perceptions about job satisfaction.
Ratee perceptions of SWB will mediate the relationship between rater TL and ratee
turnover intention.
There is a positive relationship between ratee perceptions of SWB and ratee
perceptions about PE effectiveness
Supported
Partially
Supported
Supported
Supported
Supported
Partially
Supported
Partially
Supported
Partially
Supported
Supported
128
Chapter 5: Discussion and Implications of the Research
As discussed in chapter 1, this research proposed to further theory in three
broad areas, TL, SWB and PM. The specific research purpose was stated as being
four fold; first, study the effect TL and SWB have on ratees perception about PE
effectiveness. Second, explore the relationship between TL and perceptions about
SWB. Third, investigate whether perceptions about PE effectiveness mediate the
relationships between TL and work outcomes (unit cohesion, job satisfaction and
turnover intentions). Finally, study whether perceptions about SWB mediate the
relationship between rater leadership style and work outcomes (unit cohesion, job
satisfaction and turnover intentions). Significant to this research was the
development of a scale that measured perceptions of PE effectiveness. As outlined
in chapter 3, this scale was developed and validated using the methodology
outlined by past research (Churchill, 1979; Hinkin, 1995).
Five specific research questions were addressed:
Research Question #1, what is the relationship between raters leadership style
and ratees perceptions about PE effectiveness?
Research Question #2, what is the relationship between raters leadership style
and ratees perceptions about SWB?
Research Question #3, what is the relationship between ratees perceptions of
SWB and ratees perceptions about PE effectiveness?
Research Question #4, to what extent do perceptions about PE effectiveness
mediate the relationship between rater leadership style and work outcomes (unit
cohesion, job satisfaction and turnover intentions)?
Research Question #5, to what extent do perceptions about SWB mediate the
relationship between rater leadership style and work outcomes (unit cohesion, job
satisfaction and turnover intentions)?
Discussion of Findings
The overall findings of this research are as follows: (1) there is a positive
significant relationship between TL and SWB and ratees perception about PE
effectiveness, (2) perceptions about PE effectiveness does mediate the
relationships between TL and work outcomes (unit cohesion, job satisfaction and
turnover intentions), (3) perceptions about SWB does mediate the relationship
between rater leadership style and work outcomes (unit cohesion, job satisfaction
and turnover intentions) and (4) there is a significant positive relationship
between ratees perceptions of SWB and ratees perceptions about PE
effectiveness.
TL PE effectiveness direct model.
The US Army teaches and trains its leaders that, to be perceived as
effective during the PE process leaders must demonstrate certain qualities (respect
for followers, self and cultural awareness, credibility and empathy) and skills
(active listening, responding and questioning) (Army Leadership, 1999, 2006).
There is a commonality between these qualities and skills and those of the
transformational leader. The transformational leader with their enhanced ability to
communicate vision and ability to make subordinates feel they are being heard
and is more adept at giving subordinates the feeling of inclusion. This feeling of
129
130
131
132
133
134
and efforts are being affirmed and appreciated, and that their acts and initiatives
are not being interfered or interrupted (Ronen & Mikulincer, 2012). These three
needs were shown to match up with strengths of the transformational leader. That
is, inspirational motivation involves inspiring others to pursue goals; intellectual
stimulation involves stimulating others and encouraging creativity (initiative)
among followers; idealized influence involves acting as a role model for followers
and finally, individualized consideration involves being supportive and
encouraging to followers as individuals. The transformational leaders ability to
provide purpose direction and motivation while projecting a sense of confidence
fosters a sense of protection within the subordinate. This sense of protection is
indicated by the relationship between the encouragement and availability
components of secure work base with perceptions about the transformational
leadership of the rater. The transformational rater is more likely to be perceived
as available and this perception of availability leads to higher perceptions of a
secure workbase. This is consistent with Bass (1985, 1998). Dvir, Eden, Avolio,
and Shamir, (2002) suggested that transformational leaders expand their
followers need portfolios by raising them or Maslows hierarchy (, p. 736).
Again, this ability to meet needs the hallmark of the transformational leader.
Mediating effects of SWB
The proposed mediating effect of SWB was proposed to be present
because the ratee rater leader relationships functions in many respects as an
attachment relationship, therefore, it was expected that ratees who form positive
relationships with their rater will reflect attachment dynamics (Mayseless &
135
136
137
al., 2002) and therefore less likely to display turnover intentions. The
transformational rater will only be able to impact on the ratees affective
commitment (want to stay) if the individual perceives a SWB, specifically
being encouraged. This research provides evidence for this relationship.
Additionally, the transformational rater will be better able to retard the process of
disengagement (Hulin, 1991) when the ratee perceives a SWB. Within the
confines of the SWB the transformational rater is better positioned to meet the
individual ratees expectations about the workplace. The transformational rater
operating in an environment where the ratee feels encouragement will decrease
the likelihood of the employee having negative feelings such as being devalued or
unrecognized as a result of the job.
Hypothesis 9 tested and confirmed the relationship between PE
effectiveness and SWB. The multiple regression analysis showed that regardless
of the type of organization individuals who perceive a SWB are likely to perceive
the evaluation to be effective. SEM path analysis revealed that the direct effect
path coefficients between encouragement and PE system is significant, the path
between encouragement and last evaluation is significant, the path between
availability and PE system is significant and the path between availability and last
evaluation is significant. The direct effect path coefficient between autonomy and
PE system is not significant nor is the path between autonomy and last evaluation
significant.
This indicates that the relationship between SWB and PE effectiveness is a
function of encouragement and availability not autonomy. When the ratees
138
needs are being met within the work base, this contributes to the overall
perceptions about the performance evaluation. The perception of an encouraging
environment opens the ratee up increases motivation and contributes to the
reduction of ambiguity (Ronen & Mikulincer, 2012). The PE system is more
likely to be perceived effective when the ratee believes the environment is
conducive to development. This perception of availability and encouragement will
increase receptivity to developmental efforts and therefore lead to more positive
perceptions about the effectiveness of the PE. When the ratee has a feeling of
comfort within the environment as indicated by the perception of availability they
are more likely to perceive an evaluation as effective. This feedback will reinforce
the feeling of availability and contribute to the overall perceptions of
effectiveness regarding the PE.
Implications of the Findings
This research was undertaken in order to better understand the antecedents
and consequences of followers perceptions about PE effectiveness. First, by
examining the influence TL has on PE effectiveness and SWB. This research
advances TL theory by testing TL effect on PE effectiveness and SWB). Second,
by exploring the concept of SWB as it applies to PE effectiveness, this research
advances the study of SWB into new direction by testing SWB effect on PE
effectiveness. Third, this research opens a new research stream that examined the
direct and mediating effects SWB and perceptions about PE effectiveness have on
specific work outcomes (unit cohesion, turnover intentions, and job satisfaction).
139
Fourth, this research expands the study of employee reactions to evaluations into
the military context.
Theoretical Implications
As discussed in chapter 1, PM, specifically employee performance
evaluations (PE) is one of the most widely researched areas in
industrial/organizational psychology (Murphy & Cleveland, 1995). This research,
guided by the notion that the PM process is impacted by environmental,
organizational and individual factors provides insight into and support for further
exploration into these factors. This research found such environmental factors as
perceptions about the workbase do influence perceptions about the PM process.
Also, the results further the notion that perceived effectiveness of a PM system is
particularly contingent on the attitudes of the users (i.e., both raters and ratees).
Additionally, this research supports the initial evidence that elements of SWB are
related to positive work outcomes such as unit cohesion (Mikulincer & Shaver,
2003) and negative outcomes such as job burnout and job dissatisfaction (Ronen
& Mikulincer, 2012).
This research fills a significant gap in the literature exists regarding some
important relationships. First, there is little or no specific research into followers
perceptions about PE effectiveness. Significant to this research is the development
of a specific definition of PE effectiveness: the ratees conscious recognition that
the evaluation accurately and adequately evaluates his or her actual performance
over a set period of time, and that the evaluation is based on goals and objectives
developed jointly with the rater, further, that the ratee perceives the evaluation
140
system to be purposeful and useful to both the ratee and the organization.
Second, this research is novel in that it explores ratees perceptions about PE
effectiveness instead of as in past research other perceptions such as fairness with
the process, perceptions about utility or use and the satisfaction it raises among
employees. A scale measuring perceptions of PE effectiveness was developed and
validated using the methodology outlined by past research (Churchill, 1979;
Hinkin, 1995). Third, this research provides insight into followers perceptions
about PE effectiveness by identifying the relationship between the leadership style
of the leader charged with performing the evaluation and the followers
perceptions about PE effectiveness. This research advances previous research into
the link between leadership style (transformational leadership) and selected work
outcomes (cohesion, job satisfaction, turnover intentions) by showing the
mediating effect individual perceptions (PE effectiveness, perceptions about
SWB) has on these outcomes. This provides a possible start point for other
research that will explore the mediating effect these perceptions have on other
outcomes.
Finally, this research opens up other possible questions, such as will other
leadership styles also effect followers perceptions about PE effectiveness? Will
perceptions of SWB also mediate the relationship between other leadership styles
and work outcomes? What other work outcomes are influenced by perceptions
about the PE? This research certainly was not exhaustive and only focused on the
relationship between transformational leadership, PE effectiveness, SWB and
selected outcomes. The initial results will provide the impetus for future research.
141
Practical Implications
It is a fact that practitioners refer to PM as the Achilles Heel of human
capital management (Pulakos & O'Leary, 2011). This perception is partly due to
the inherent complexities in both the design of an effective system and the actual
implementation of the evaluation process. The importance of having a system that
is that is perceived effective by employees cannot be understated. This research
addresses some practical concerns and provides specific actionable information to
organizations that will aid in the understanding of how TL and perceptions of
SWB affect perception about PE effectiveness. This is significant because it is
advancing the practical study of TL and SWB into the realm of PM (perceptions
about PE effectiveness). This research provides a tool and methodology to explore
how individuals perceive the PE system. Through this exploration leaders will be
able to gain insights into how employees perceive the effectiveness of the PE.
This information can be used to improve the PM process. These improvements to
the PM process will ultimately enhance the performance of individuals and
groups and improve organizational effectiveness.
Limitations of the Study
Since attitudes about performance evaluations are formed over time, and it
is generally accepted that individual perceptions flow from prior attitudes, a
limitation is that the perceptions measured may be influenced by antecedent
attitudes that differ slightly from those reflected in the questionnaire. For
example, an individuals limited or improper understanding of the purpose and
objectives behind the performance evaluation system may lead to a
142
misinterpretation of effectiveness. Also, the individual may not have the ability to
make an accurate judgment of effectiveness should this view be clouded by an
ulterior motive for rating an evaluation as not effective such as personal bias with
or negative feelings for the leader and or the organization. Unidentified attitudes
could be confounding variables.
Third, this is a non-experimental study as it lacks important controls (e.g.,
random assignment) however non-equivalent group design was used to capture
differences between those with perceived transformational raters and those
without, those who perceive a secure work base and those who do not. This issue
is mitigated by the strong theoretical underpinnings of the research.
Fourth, participant reactivity or the way how participant reacts to the
experimental situation (e.g. overly cooperative, overly defensive, or hostile) was
perceived to be an issue. To avoid these problems the true purpose of the study
was not fully disclosed. Individual participants were informed about the general
purpose of the research without many specifics. Fifth, experimenter bias or the
way the experimenter influences results (e.g. by being warm and friendly with one
group of participants vs. cold and stern with other group) was a concern. To
avoid participant reactivity and experimenter bias research employed standardized
procedures.
Finally, the sample and generalizability are limitations. This research was
conducted within a military population this limits the generalizability.
143
144
References
Aguinis, H. (2007). Performance Management (2nd ed.), . Upper Saddle River,
NJ: : Pearson Prentice Hall.
Aguinis, H., & Pierce, C. A. (2008). Enhancing the relevance of organizational
behavior by embracing performance management research. Journal of
Organizational Behavior, 29(1), 139-145.
Ahmed, A., Hussain, I., & Ahmed, S. (2010). Performance Evaluations Impact on
Attitudinal Outcomes and Organizational Performance. International
Journal of Business and Management, 5(10), 7-XX.
Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and
Human Decision Processes, 50, 32.
Ajzen, I., & Fishbein, M. (1980). Understanding attitudes and predicting social
behavior. Englewood Cliffs, NJ: Prentice-Hall.
Alston, B., & Mujtaba, B. (2009). Performance Management Execution For
Effective And Continuous Employee Appraisals. Journal of Business &
Economics Research, 7(9), 25-34.
Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in
practice: A review and recommended two-step approach. Psychological
Bulletin, 103, 411423
Avolio, B., & Bass, B. M. (1988). Transformational leadership, charisma and
beyond.
In J. G. Hunt, H. R. Baliga, H. P. Dachler & C. A. Schriesheim (Eds.),
Emerging leadersbip vistas: 29-49. Lexington MA: Heath.
145
Avolio, B., Reichard, R., Hannah, S., Walumbwa, F., & Chan, A. (2009). A metaanalytic review of leadership impact research: Experimental and quasiexperimental studies. Leadership Quarterly, 20(5), 20-XX.
Avolio, B. J. (1999). Full leadership development. Thousand Oaks, CA: Sage.
Avolio, B. J., & Bass, B. M. (1995). Individual consideration viewed at multiple
levels of analysis: A multi-level framework for examining the diffusion of
transformational leadership. . The Leadership Quarterly, 6, 19-XX.
Baron, R. M., & Kenny, D. A. (1986). The moderatormediator variable
distinction in social psychological research: Conceptual, strategic, and
statistical considerations. Journal of Personality and Social Psychology,
51, 9-XX.
Bass, B., Jung, D. I., Avolio, B. J., & Berson, Y. (2003). Predicting unit
performance by assessing transformational and transactional leadership.
Journal of Applied Psychology, 88(2), 207-218.
Bass, B. M. (1985). Leadership and Performance Beyond Expectations. New
York: Free Press.
Bass, B. M. (1990). Bass and Stogdills handbook of leadership. New York: Free
Press.
Bass, B. M. (1998). Transformational Leadership: Industrial, Military, and
Educational Impact. Mahwah, NJ.: Lawrence Erlbaum Associates.
146
Bass, B. M., & Avolio, B. J. (1989). Potential biases in leadership measures: How
prototypes, leniency and general satisfaction relate to ratings and rankings
of transformational and transactional leadership constructs. . Educational
and Psychological Measurement, 49, 18.
Bass, B. M., & Bass, R. (2008). Handbook of Leadership: Theory, Research, and
Application. New York, NY: Free Press.
Bass, B. M., & Riggio, R. (2006). Transformational leadership. Mahwah, NJ:
Lawrence Earlbaum.
Bennett, T. (2009). The relationship between the subordinates perception of the
leadership style of it managers and the subordinates perceptions of
managers ability to inspire extra effort, to be effective, and to enhance
satisfaction with management. Paper presented at the Academy of
Strategic Management.
Bennis, W., & Nanus, B. (1995). Visionary leadership: Creating a compelling
sense of direction for your organization. . San Fransicso: Jossey-Bass.
Berson, Y., & Avolio, B. (2004). Transformational leadership and the
dissemination of organizational goals: A case study of a
telecommunication firm. The Leadership Quarterly, 15, 18.
Boachie-Mensah, F. O., & Seidu, P. A. (2012). Employees' Perception of
Perfonnance Appraisal System:A Case Study Intemational Joumal of
Business and Management, 7(2), 15.
147
Boerner, S., Eisenbeiss, S., & Griesser, D. (2007). Follower behavior and
organizational performance: The impact of transformational leaders.
Journal of Leadership and Organizational Studies, 13(3), 11.
Bommer, W., Rubin, R., & Baldwin, T. (2004). Setting the stage for effective
leadership: Antecedents of transformational leadership behavior. The
Leadership Quarterly, 15, 15.
Bono, J. E., & Judge, T. A. (2004). Personality and Transformational and
Transactional Leadership: A Meta-Analysis. Journal of Applied
Psychology, 89(5), 901-910. Boswell, W. R., & Boudreau, J. W. (2000).
Employee Satisfaction with Performance Appraisals and Appraisers: The
Role of Perceived Appraisal Use. Human Resource Development
Quarterly, 11(3), 283-299.
Bowlby, J. (1973). Attachment and loss: Separation, anxiety and anger. New
York: Basic Books.
Bowlby, J. (1982). Attachment and loss: Vol. 1. Attachment (2nd ed.). New York:
Basic Books (Original ed. 1969).
Branham, L. (2012). The 7 hidden reasons employees leave. (2nd ed.). New
Yourk: AMACOM.
Brannon, D., Barry, T., Kemper, P., Schreiner, A., & Vasey, J. (2007). Job
Perceptions and Intent to Leave Among Direct Care Workers: Evidence
From the Better Jobs Better Care Demonstrations. The Gerontologist,
47(6), 820-829.
148
149
150
151
152
153
Hackman, J. R., & Oldham, G. R. (1976). Motivation through the design of work:
Test of a theory. Organizational Behavior and Human Performance, 16,
250-279., 16, 29.
Hardy, L., Arthur, C. A., Jones, G., Shariff, A., Munnoch, K., Isaacs, I., &
Allsopp, A. J. (2010). The relationship between transformational
leadership behaviors, psychological, and training outcomes in elite
military recruits. The Leadership Quarterly, 21(1), 20-32.
Harrison, R. L. (2013). Using mixed methods designs in the Journal of Business
Research, 19902010. Journal of Business Research 66 (2013) 2153
2162, 66, 9.
Hazan, C., & Shaver, P. R. (1990). Love and work: An attachment-theoretical
perspective. . Journal of Personality and Social Psychology, 59(2), 10.
Hennessey, H. W., Jr., & Bernardin, H. J. (2003). The relationship between
performance appraisal criterion specificity and statistical evidence of
discrimination. Human Resource Management, 42(2), 143-158.
Hinkin, T. R. (1995). A review of scale development practices in the study of
organizations. Journal of Management, 21(5), 967-988.
Holt, D. T., Rehg, M. T., Lin, J. H. S., & Miller, J. (2007). An application of the
unfolding model to explain turnover in a sample of military officers.
Human Resource Management, 46(1), 35-49.
Hulin, C. L. (1991). Adaptation, persistence, commitment in organizations
Handbook of Industrial and Organizational Psychology (2 ed., pp. 52).
Palo Alto, CA; : Consulting Psychologists Press.
154
155
156
157
Meyer, J. P., Stanley, D. J., Herscovitch, L., & Topolnytsky, L. (2002). Affective,
Continuance, and Normative Commitment to the Organization: A Metaanalysis of Antecedents, Correlates, and Consequences. Journal of
Vocational Behavior, 61(1), 20-52. Mikulincer, M., & Shaver, P. R.
(2003). The attachment behavioral system in adulthood: Activation,
psychodynamics, and interpersonal processes. . In M. P. Zanna (Ed.),
Advances in experimental social psychology (Vol. 35, pp. 53-152. ). San
Diego, CA: Academic Press.
Mitchell, T. R., Holtom, B. C., Lee, T. W., Sablynski, C. J., & Erez, M. (2001).
Why people stay: Using job embeddedness to predict voluntary turnover.
Academy of Management Journal, 44(6), 1102-1121.
Mowday, R. T., Porter, L. W., & Steers, R. M. (1982). Employee-organizational
linkages: The psychology of commitment, absenteeism, and turnover. .
New York: Academic Press.
Murphy, K. R., & Cleveland, J. N. (1991). Performance Appraisal. An
Organizational Perspective Needham Heights, MA: Allyn and Bacon.
Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal:
Social, organizational, and goal-based perspectives. Sage.: Thousand
Oaks, CA.
Nemanich, L. A., & Keller, R. T. (2007). Transformational leadership in an
acquisition: A field study of employees. The Leadership Quarterly, 18(1),
49-68.
158
O'brien, R.,M. (2007). A caution regarding rules of thumb for variance inflation
factors. Quality and Quantity, 41(5), 673-690.
Omar, W. A. W., & FauziHussin. (2013). Transformational leadership style and
job satisfaction relationship: A study of structural equation modeling
(SEM). International Journal of Academic Research in Business and
Social Sciences, 3(2), 346-365.
Pichler, S. (2012). The social context of performance appraisal and appraisal
reactions: A meta-analysis. Human Resource Management, 51(5), 709732.
Podsakoff, P., MacKenzie, S., Moorman, S., & Fetter, R. (1990).
Transformational leader behaviors and their effects on followers' trust in
leader, satisfaction, and organizational citizenship behaviors. Leadership
Quarterly, 1,107-142., 1, 35.
Popper, M., Mayseless, O., & Castelnovo, O. (2000). Transformational
Leadership and Attachment. Leadership Quarterly, 11(2), 22.
Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for
assessing and comparing indirect effects in multiple mediator models.
Behavior Research Methods, 40, 879-891.
Pulakos, E. D., & O'Leary, R. S. (2011). Why is performance management
broken? Industrial and Organizational Psychology: Perspectives on
Science and Practice, 4(2), 18.
159
Purcell, J., Kinnie, N., Hutchinson, S., Rayton, B., & Swart, J. (2003).
Understanding the people and performance link: unlocking the black box.
. London.
Rafferty, A., & Griffin, M. (2004). Dimensions of transformational leadership:
Conceptual and empirical extensions. The Leadership Quarterly, Vol. 15,
pp.329-354., 15, 25.
Raykov, T., & Marcoulides, G. A. (2000). A first course in structural equation
modeling. . Mahwah, NJ: Lawrence Erlbaum Associates.
Rhoades, L., & Eisenberger, R. (2002). Perceived organizational support: a
review of the literature. Journal of Applied Psychology, Vol. 87 No. 4, pp.
698-714., 87(4), 16.
Roberts, G. E. (1994). Maximizing performance evaluation system acceptance:
Perspectives from municipal government personnel administrators. Public
Personnel Management, 23(4), 24.
Roberts, G. E. (2003). Employee Performance Appraisal System Participation: A
Technique that Works. , Public Personnel Management, 32(1), 8.
Ronen, S., & Baldwin, M. (2010). Hypersensitivity to Social Rejection and
Perceived Stress as Mediators between Attachment Anxiety and Future
Burnout: A Prospective Analysis. APPLIED PSYCHOLOGY: AN
INTERNATIONAL REVIEW, 59(3), 23.
Ronen, S., & Lane, S. T. (NP). The Secure Work Base scale: Development of a
measure. .
160
161
Stashevsky, S., & Koslowsky, M. (2006). Leadership team cohesiveness and team
performance, . Top of Form International Journal of Manpower, 27(1),
11.
Stentz, J. E., Plano Clark, V. L., & Matkin, G. S. (2012). Applying mixed
methods to leadership research: A review of current practices. The
Leadership Quarterly, 23, 10.
Tett, R. P., & Meyer, J. P. (1993). Job satisfaction, organizational commitment,
turnover intention, and turnover: Path analyses based on meta-analytical
findings. Personnel Psychology, 46(2), 259.
Thompson, E., & Phua, F. (2012). A Brief Index of Affective Job Satisfaction.
Group & Organization Management, 37(3), 32.
Trochim, W. M. (2006). The Research Methods Knowledge Base, 2nd Edition. ,
from http://www.socialresearchmethods.net/kb/>
Vasset, F., Marnburg, E., & Furunes, T. (2010). Employees' perceptions of justice
in performance evaluations. Nursing Management, 17(2), 30-34.
Weber, M. (1947). The theory of social and economic organization. . New York::
Free Press.
Wells, J. E., & Peachey, J. W. (2010). Turnover intentions: Do leadership
behaviors and satisfaction with the leader matter? Team Performance
Management, Vol. 17 Iss: 1/2, pp.23 - 40, 17(1/2), 17.
Wisecarver, M., Schneider, R., Foldes, H., & Cullen, M. (2011). Knowledge,
Skills, and Abilities for Military Leader Influence: U.S Army Research
Institute for the Behavioral and Social Sciences.
162
163
Appendix A (SURVEY)
Perceived Effectiveness of the performance evaluation measured 26 Item
Performance Evaluation Effectiveness Survey (Developed specifically for use in
Dissertation), 4 questions will gather demographic and descriptive data, 20
questions gather specific perceptions about PE.
1.
2.
process?
3.
Did you and your rater sit down and discuss the evaluation face to face
4.
organization
Responses will be evaluated on 5 point 1 Strongly Disagree, 2 Disagree, Neither
agree nor disagree, 4 Agree, 5 Strongly Agree
5.
6.
7.
8.
9.
10.
The Evaluation System is effective tool for retaining the best employees
11.
12.
164
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
26.
165
166
167
168
169
170
171
172