Академический Документы
Профессиональный Документы
Культура Документы
a r t i c l e i n f o a b s t r a c t
Keywords: Particle swarm optimization (PSO) originated from bird ocking models. It has become a popular research
Particle swarm optimization (PSO) eld with many successful applications. In this paper, we present a scheme of an aggregate production
Aggregate production planning (APP) planning (APP) from a manufacturer of gardening equipment. It is formulated as an integer linear pro-
Integer linear programming model gramming model and optimized by PSO. During the course of optimizing the problem, we discovered that
PSO had limited ability and unsatisfactory performance, especially a large constrained integral APP prob-
lem with plenty of equality constraints. In order to enhance its performance and alleviate the deciencies
to the problem solving, a modied PSO (MPSO) is proposed, which introduces the idea of sub-particles, a
particular coding principle, and a modied operation procedure of particles to the update rules to regu-
late the search processes for a particle swarm. In the computational study, some instances of the APP
problems are experimented and analyzed to evaluate the performance of the MPSO with standard PSO
(SPSO) and genetic algorithm (GA). The experimental results demonstrate that the MPSO variant provides
particular qualities in the aspects of accuracy, reliability, and convergence speed than SPSO and GA.
2013 Elsevier Ltd. All rights reserved.
1. Introduction by stock-keeping unit and too late to arrange for additional capac-
ity. The goal of APP is normally to meet forecasted uctuating de-
Aggregate production planning (APP) is an important technique mand requirements during a specic period in cost-effective
in Operations Management. Other essential approaches, such as manner. Typical costs include the costs of production, inventory,
master production scheduling (MPS), capacity requirements plan- subcontracting, backlog, payroll, hiring, layoff, regular-time, and
ning (CRP) and material requirements planning (MRP), are closely overtime (Silva, Figueira, Lisboa, & Barman, 2006).
associated with it. APP is medium-term capacity planning which
determines ideal levels of workforce, production, inventory, sub-
contracting, and backlog over a specic time horizon that ranges 1.1. Literature on APP domain
from 2 to 12, or even 18, months to satisfy uctuating demand
requirements with limited capacity and resource (Al-E-Hashem, Many APP models and solutions with various degree of sophis-
Aryanezhad, & Sadjadi, 2012; Graves, 2002; Stevenson, 2009). As tication have been introduced since early 1950. The pioneers of the
the name suggests, APP solves problems involving aggregate deci- eld, Holt, Modigliani, and Simon (1955) and Holt, Modigliani, and
sions. It determines aggregate capacity level in factories for a given Muth (1956), initially revealed the importance and obstacles of this
amount of periods, while without determining the quantity of each domain, and focused on the resolution of the aggregate planning
individual stock-keeping unit will be produced. The level of details problem. They formalized and quantied an aggregate problem
makes APP a useful tool for thinking about decisions with an inter- by using a quadratic approximation to the criterion function
mediate time frame that is too early to determine production levels involving costs of inventory, overtime, and employment. They also
calculated a generalized optimal solution of the problem in the
Corresponding author. Address: Department of Business Administration, Lung- form of a linear decision rule, commonly known as the LDR model.
hwa University of Science and Technology, 300, Sec. 1, Wanshou Rd., Guishan The proposed approach was applied to a paint factory to generate a
District, Taoyuan County 33306, Taiwan. Tel.: +886 2 82093211x6513; fax: +886 2 production plan by using a quadratic approximation to the actual
82093211x6510. operational costs of the factory. Hanssmann and Hess (1960)
E-mail addresses: scwang@mail.lhu.edu.tw (S.-C. Wang), mfyeh@mail.lhu. developed a model based on the linear programming approach
edu.tw (M.-F. Yeh).
1
Department of Electrical Engineering, Lunghwa University of Science and
using a linear cost structure of decision variables. It focused on
Technology, 300, Sec. 1, Wanshou Rd., Guishan District, Taoyuan County 33306, the resolution that minimizing the total cost of regular payroll
Taiwan. Tel.: +886 2 82093211x5501; fax: +886 2 82094650. and overtime, hiring and layoffs, inventory and shortages incurred
0957-4174/$ - see front matter 2013 Elsevier Ltd. All rights reserved.
http://dx.doi.org/10.1016/j.eswa.2013.10.038
3070 S.-C. Wang, M.-F. Yeh / Expert Systems with Applications 41 (2014) 30693077
during a given planning horizon. Lanzenauer and Haehling (1970) constraints. The approach successfully solved the multi-blend
extended the model of Hanssmann and Hess (1960) to a multi- problem for brass casting and determines the optimum raw mate-
product, multi-stage production system, in which optimal disag- rial purchasing policies.
gregate decisions can be made under capacity constraints. Rakes,
Franz, and James Wynne (1984) presented a chance-constrained
goal programming approach to the problem. It is a special case of 1.2. Literature implemented PSO on various elds
stochastic programming to production scheduling which incorpo-
rates probabilistic product demand. A sophisticated overview of Over the past decade, a number of computational swarm-based
earlier research is given in Nam and Logendran (1992). They com- systems have been developed. Some of them become very popular
piled the research literature of APP that is consisted of 140 journal optimization techniques in many domain researches soon after-
articles and 14 books from 17 journals, presenting a classication wards. One is particle swarm optimization (Kennedy & Eberhart,
scheme and summarizing various existing techniques into a frame- 1995a), abbreviated as PSO. PSO originated from bird ocking
work. The techniques of those researches range from simple graph- models and has become an exciting new research eld still in its
ical methods to more sophisticated search, switching-heuristic and infancy compared to other paradigms in articial intelligence.
other dynamic methods, can be broadly categorized into two Baltas, Tsafarakis, Saridakis, and Matsatsinis (2013) introduced
types: those that guarantee an exact optimal solution and those a PSO variant to a service design and diversication problem. They
that do not. designed and implemented genetic algorithm and PSO to stated-
In recent decades, depending on more assumptions made and preference data derived from conjoint consumer preferences for
advanced modeling approaches invented, the APP problem has be- service attributes in a retail setting. Their method has valuable
come quite complex and large scale. There is a trend in the re- implications for managers aiming to improve how they design
search community to solve the large complex problems by using their services. Tsafarakis, Saridakis, Baltas, and Matsatsinis (2013)
modern heuristic optimization techniques. This is mainly due to presented a new hybrid PSO approach to design an optimal indus-
the time-consuming and unsuitability of classical techniques in trial product line. The hybrid PSO searches for an optimal product
many circumstances. line in a large design space which consists of discrete and contin-
Paiva and Morabito (2009) proposed an optimization model to uous design variables. The approach illustrated through an applica-
support decisions in the APP of sugar and ethanol milling compa- tion to a simulated dataset of industrial cranes. It also yielded
nies. The model is a mixed integer programming formulation based important implications for strategic customer relationship and
on the industrial process selection and the production lot-sizing production management. Ramazanian and Modares (2011) intro-
model. Also, in their APP real case study, the application of the duced a multi-objective goal programming model for a multi-prod-
model results in 12,306 variables, where 5796 are binary and uct multi-step multi-period APP problem in the cement industry.
6902 constraints. Sillekens, Koberstein, and Suhl (2011) presented The model was reformulated as a single objective nonlinear pro-
a mixed integer linear programming model for an APP problem of gramming model. It was solved by using the expanded objective
ow shop production lines in automotive industry. In contract to function method and a proposed PSO variant whose inertia weight
traditional approaches, the model considered discrete capacity was set as a function. The simulation comparing with GA in the -
adaptions which originated from technical characteristics of nal showed that PSO gains satisfactory results than GA.
assembly lines, work regulations and shift planning. A solution With many successful applications in various domain problems,
framework containing different primal heuristics and preprocess- PSO has shown that it is a considerably promising, efcient and ro-
ing techniques is embedded into a decision support system. Zhang, bust technique for practical applications. For examples, PSO had
Zhang, Xiao, and Kaku (2012) built a mixed integer linear program- been successfully applied to scheduling problems (Chen, 2011;
ming model which characterize an APP problem with capacity Liao, Tseng, & Luarn, 2007), game theory problems (Lung & Dumit-
expansion in a manufacturing system including multiple activity rescu, 2009; Pavlidis, Parsopoulos, & Vrhatis, 2005), optimization
centers. They used a heuristic method based on capacity shifting on continuously changing environments (Parsopoulos & Vrahatis,
with linear relaxation to solve the problem. Ramezanian, Rahmani, 2001), and detection of periodic orbits (Skokos, Parsopoulos, Patsis,
and Barzinpour (2012) considered multi-period, multi-product and & Vrahatis, 2005).
multi-machine systems with setup decisions, developed a mixed Although there are many applications implemented PSO on var-
integer linear programming model for general two-phase APP sys- ious elds, however, we seldom found it applying to the APP eld.
tems. Due to the NP-hard class of the APP model, they imple- The reason may be attributed to that PSO was originally introduced
mented a genetic algorithm and tabu search for solving the model. for unconstrained and continuous optimization problems. Its oper-
In addition to the integer linear programming models of APP ations imply the existence of unrestricted and continuous explora-
problems, more complicated models have also been proposed. tions in search space, which may have limited ability in dealing
Mirzapour Al-E-Hashem, Malekly, and Aryanezhad (2011) with constrained integral APP problems. Afterwards, during the
addressed a multi-site, multi-period, multi-product APP problem process of optimizing APP problems, we did nd that PSO gains
under uncertainty in supply chain, proposed a robust multi- limited ability and inefciency in dealing with the problems, espe-
objective mixed integer nonlinear programming model, consider- cially a large constrained integral APP problem with plenty of
ing two conicting objectives simultaneously to deal with the equality constraints. Therefore, in response to ease these short-
problem. In their research, cost parameters and demand uctua- comings, we developed an effective modied mechanism for PSO,
tions are subject to uncertainty, then the problem can transform which introduced the concept of sub-particles, a particular coding
into a multi-objective linear one, and to be solved as a single- principle, and a modied operation procedure of particles to the
objective mixed integer programming model applying the update rules to regulate the search processes for a particle swarm.
LP-metrics method. Adil Baykasoglu and Gocken (2010) presented And we found that the MPSO variant gains satisfactory perfor-
a fuzzy multi-objective APP model and proposed a direct solution mance in the aspects of accuracy, reliability, and convergence
method based on ranking methods of fuzzy numbers and tabu speed than SPSO and GA. Also, there are advantages of the MPSO
search to solve the model. Sakalli, Baykoc, and Birgoren (2010) to the APP problem solving than other approaches: (i) only a few
discussed an APP model with possibilities for a blending problem parameters need to be adjusted; (ii) be able to speed up the con-
in a brass factory. Their possibilistic linear programming model is vergence to the optimal solution; (iii) can be applied to optimize
solved by fuzzy ranking concept relaxed by using Either or most of APP problems.
S.-C. Wang, M.-F. Yeh / Expert Systems with Applications 41 (2014) 30693077 3071
Besides, different companies or industries have various charac- of (1) is the previous velocity, which provides the necessary
teristics of aggregate decisions in aggregate production planning. momentum for particles to roam around the search space. The sec-
Increasingly sophisticated parameters and assumptions into APP ond part, known as the self-cognitive component, represents the
models only make them hindering and impracticable for practical personal thinking of each particle. The cognitive component
applications. Therefore, a comprehensive APP model that is easy encourages particles to move toward their own best positions
to expand and adjust, and to be optimized by the modied mech- found so far. The third part, regarded as the social inuence com-
anism of PSO we developed, is what we want to discover in this ponent, expresses the collaborative effect of particles in discover-
study. ing the global optimal solution. The social component always
In this paper, we rst propose a general APP model from a real- pulls particles to the global best position found so far.
world problem, which is organized and formulated as an integer The early PSO performed satisfactorily for simple optimization
linear programming model. During the course of implemented problems (Eberhart & Shi, 2001; Kennedy & Eberhart, 2001). How-
PSO to the constrained and discrete APP problem, we found that ever, its crucial deciencies were revealed as soon as that it was
PSO has some imperfections, especially a large constrained integral applied on complex optimization problems with large search
APP problem with plenty of equality constraints. Then a modied spaces. Therefore, renements developed to ease the deciencies
scheme of PSO is proposed. The discussions of all the processes of the early PSO model are discussed and veried by several
about proposing an APP model, optimizing the model by PSO, its researchers, and later, a new parameter, w, called inertia weight,
difculties and ndings, the proposed MPSO, the introduced sub- was introduced into (1), resulting in a new PSO variant (Eberhart
particles, and its examinations, etc., are the contribution of the & Shi, 1998; Shi & Eberhart, 1998):
paper.
The rest of the paper is organized as follows. In Section 2, we mij t 1 wmij t c1 R1 pij t xij t c2 R2 pgj t xij t 3
introduce some variants of PSO from early standard to contempo-
rary hybrids. Section 3 presents a general APP problem from a real- The rest of the equation and parameters remains the same as
world manufacturer of gardening equipment. It is formulated as an the early PSO model. A very common choice is the initialization
integer linear programming model. In Section 4, the optimization of w to a value slightly greater than 1.0 to promote explorations
of the APP model by PSO is revealed. The features of the proposed in early optimization stages, and a linear decrease towards a posi-
modied PSO for optimization of the APP model are claried in tive lower bound to eliminate oscillatory behaviors in later stages.
Section 5. The experiments and comparisons for the modied In general, a linearly decreasing scheme for w can be mathemati-
PSO with standard PSO and GA are displayed in Section 6, some cally described as a linearly decreasing time-dependent inertia
conclusions and discussions are also addressed in the nal weight as follows:
Section 7.
t
wt wmax wmax; wmin 4
T max
2. Particle swarm optimization
where t stands for the iteration counter and Tmax be the total num-
The precursors of particle swarm optimization were simulators ber of iterations; wmax and wmin are the desirable upper and lower
of social behavior for visualizing bird ocks. After realizing the po- bounds of w, usually set to 0.9 and 0.4, respectively (Shi & Eberhart,
tential of their simulation models to perform optimization, the 1998; Shi & Eberhart, 1999). Also, researches presented that the PSO
early version of PSO was published by Eberhart and Kennedy in variant with a nonlinearly varying inertia weight was applicable
1995, dened by the following equations (Eberhart & Kennedy, and successfully applied to the optimization of practical problems
1995; Eberhart, Simpson, & Dobbins, 1996; Kennedy & Eberhart, (Venter & Sobieszczanski-Sobieski, 2004). The amazing perfor-
1995b): mance improvement of the PSO variant gained by using inertia
weight with velocity clamping, rendered it the most popular PSO
mij t 1 mij t c1 R1 pij t xij t c2 R2 pgj t xij t 1
approach for a few years. Then it is so-called standard PSO (SPSO).
However, although particles were able to avoid swarm explo-
xij t 1 xij t mij t 1 2 sion and converge around the best position, they were still easily
getting trapped in local minima, especially in complex, multimodal
where i = 1, 2, . . . , N and j = 1, 2, . . . , n. N be the number of particles
problems. This deciency can be attributed to the global informa-
and n the dimension of search space A Rn; t denotes the iteration
tion exchange scheme which allows each particle to know the
counter; R1 and R2 are random variables uniformly distributed
overall best position instantly at each iteration. All particles as-
within [0, 1]; c1, c2 are weighting factors called the cognitive and so-
sume new positions in regions related to the same overall best po-
cial parameter respectively (also called acceleration coefcients). A
sition, reducing the exploration capabilities of the swarm. In order
swarm of particles is dened as a set S = {x1, x2, . . . , xN} represented
to overcome the problem, the concept of neighborhoods was intro-
as potential solutions of an objective function to be optimized.
duced. The main idea of it was the reduction of the global informa-
The position of ith particle be xi = (xi1, xi2, . . . , xin)T 2 A and each par-
tion exchange scheme to local one, where information is diffused
ticle is assumed to move within the search space A iteratively. This
only in small parts of the swarm, called neighbors, at each itera-
is possible by adjusting their position using a proper position shift
tion. The Eq. (3) then be modied as:
vi = (vi1, vi2, . . . , vin)T, called velocity, which is also adapted iteratively
to render particles capable of potentially visiting any region of A. mij t 1 wmij t c1 R1 pij t xij t c2 R2 pgi j t xij t 5
pij(t) represents the position with the best tness for the ith particle
in the jth dimension of search space, and pgj(t) the best position dis- where gi denotes the index of the best particle in the neighborhood
covered by the whole particles. of xi. The only difference between Eqs. (3) and (5) is the index of the
During iterative processes, the trajectory of each particle is ad- best position in the second parenthesis. According to Eq. (5), a
justed by dynamically altering the velocity of its own according to particle will move towards its own best position and the best
its own best ying experience (pBest) and the best ying experi- position of its neighborhood, instead of the overall best position
ence of the swarm (gBest) in search space. In (1), pi(t) represents in Eq. (3). The introduction of neighborhoods enhanced the perfor-
the position with the best tness found so far for ith particle, and mance of PSO signicantly, offering a boost to research towards the
pg(t) the best position discovered by whole particles. The rst part development of more competitive and sophisticated variants that
3072 S.-C. Wang, M.-F. Yeh / Expert Systems with Applications 41 (2014) 30693077
incorporated all presented concepts so far. To distinguish the Sets and indexes
approaches, the PSO variant that employed the overall best position nped number of periods in planning horizon
is called the global PSO variant, denoted as gBest, while the one with nwkr number of worker types
strictly smaller neighborhoods is called the local PSO variant, t index of periods in planning horizon,
denoted as lBest. t = 1, 2, . . . , nped
The good performance of the presented PSO variants attracted j index of worker types, j = 1, 2, . . . , nwkr
the interest of the scientic community. The blossoming research Parameters
prompted researchers to investigate the theoretical properties of cprd unit material cost
PSO, offering better understanding of its operations and dynamics, cinv inventory holding cost per unit of
as well as the mathematical traits for proper parameter congura- product at each period
tion. Clerc and Kennedy (2002) considered different generalized cblg backlog cost per unit of product at
PSO models and performed a dynamical system analysis of their each period
convergence. The analysis offered a solid theoretical background csct subcontracting cost per unit of product
to the algorithm. They established an investigated model as the de- chir hiring and training cost per worker of
j
fault contemporary PSO variant by transforming Eq. (1) as: type j
clof layoff cost per worker of type j
mij t 1 v mij t c1 R1 pij t xij t c2 R2 pgj t xij t 6 j
crt
j
regular time labor cost per hour of
worker type j at each period
where v is called constriction coefcient, while the rest of the equa-
tion and parameters remains the same as the early PSO model. The cot
j
overtime labor cost per hour of worker
type j at each period
variant is distinguished in literature due to its theoretical properties
hj
prd labor hours of a worker type j required
that imply the following explicit selection of its parameters (Clerc &
for producing a unit of product at each
Kennedy, 2002):
period
rt labor hours of a worker type j provided
2 hj
v p 7 for regular time at each period
j2 u u2 4uj
hot legal labor hours of a worker limited
for overtime at each period
where u = c1 + c2 and u > 4. Based on this equation, the settings,
dt forecasted demand requirements at
v = 0.729 and c1 = c2 = 2.05, are currently considered as the default
period t
parameter set of the constriction coefcients of the variant.
Decision variables
Wjt workforce sizes of worker type j at
3. Integer linear programming model for APP period t
W hir workforce sizes of worker type j hired
jt
In this section, a scenario that formally states a general APP at the beginning of period t
problem from the extension of Red Tomato Tools, a manufacturer W lof workforce sizes of worker type j laid
jt
of gardening equipment with highly seasonal demand require- off at the beginning of period t
ments in Mexico (Chopra & Meindl, 2007), is presented and formu- Hot
jt
number of overtime hours of worker
lated as an integer linear programming model. Red Tomato Tools is type j worked at period t,
a manufacturer of gardening equipment, whose operations consist Pprd units of product produced at period t
t
of the assembly of purchased parts into a multipurpose gardening Pinv units of inventory of product at the
t
tool. The demand requirements for Red Tomato Tools gardening end of period t
tools are highly seasonal. Spring is the peak season as people plant Pbt lg units of product backlogged at the end
their gardens. Red Tomato Tools has decided to use aggregate pro- of period t
duction planning to overcome the obstacle of seasonal demand and Psct
t
units of product subcontracted at
maximize prots. The options Red Tomato Tools has for handling period t
the seasonality are as follows:
(3) Cost of hiring and layoff crete optimization problems. Thus, an adjustment mechanism is
XX hir lof lof
needed for PSO to alleviate the deciencies for the APP model.
chir
j W jt c j W jt 10 To rst issue, in order to solve the APP model by PSO restricted
t j
within plenty of equality and inequality constraints, we introduce
(4) Cost of holding inventory and backlog the penalty function method, which expands the objective function
X of the APP model by importing an appropriate penalty function
v
cinv Pin
t cb lg Pbt lg 11 converted from all equality and inequality constraints in the mod-
t el. The original model is then reconstructed as a new model which
(5) Cost of production and subcontracting has expanded objective function with no constraints thereafter,
stated as follows:
X
cprd Pprd csct P sct : 12 The APP model with many equality and inequality constraints
t t
t can be formally expressed as the formulation:
min f x 18
The total cost within a planning horizon can be formulated as s:t: g i x 6 0; i 1; . . . ; p 19
the sum of previous costs from (8) to (12). Thus, the objective func-
hj x 0; j 1; . . . ; q 20
tion can be expressed as follows:
XX rt
XX ot then it can be reconstructed as a new model, whose expanded
min crtj hj W jt cot
j H jt
t t
objective function with no constraints is F(x), by importing a pen-
j j
XX hir lof lof
alty function Px as:
chir
j W jt c j W jt
t j
min Fx f x Px 21
X v
X
cinv Pin
t cb lg Pbt lg cprd P prd
t csct Psct
t 13 where the penalty function P(x) is organized as:
t t
c
Px ckg xk2 khxk2 22
2
3.2. Constraints where g x g
T
1 x; . . . ; g p x ; g i x maxg i x; 0; hx
T
h1 x; . . . ; hq x , and c be the penalty parameter.
The values of decision variables in the objective function are Therefore, the APP model presented in Section 3 can be recon-
integer and cannot be arbitrarily set. They are subject to a variety structed as a new expanded objective function with no constraints,
of constraints. The next step in setting up the aggregate production expressed as follows:
planning model is to dene constraints linking decision variables XX XX XX
rt ot hir lof lof
clearly, as follows: min crtj hj W jt cot
j Hjt chir
j W jt c j W jt
t j t j t j
X X
(1) Workforce, hiring, and layoff constraints cinv P inv b lg
Pbt lg cprd Pprd sct
Psct
t c t c t
t t
W jt W jt1 W hir lof 8 "
jt W jt 14 !#2
<X X h
rt ot
prd j W jt Hjt
(2) Capacity constraints c max Pt ;0
: t j hj
prd
X hrtj W jt Hot )
jt XXh i2
Pprd
t 6 prd
15 ot ot
max Hjt h W jt ; 0
j hj
t j
(
(3) Inventory balance constraints c XX 2
W jt W jt1 W hir lof
jt W jt
v b lg inv 2
Pin prd
t1 P t Psct
t dt P t1 P t Pbt lg 16 t j
)
X inv b lg inv
2
(4) Overtime limit constraints Pt1 Pprd sct blg
t P t dt P t1 P t P t 23
t
ot
Hot
jt 6 h W jt : 17
To second issue, an alteration method is adopted which transforms
an integral problem into its corresponding continuous problem. The
In the model, one can easily add parameters and constraints alteration is that each particle component is rounded to nearest
which limit the amount purchased from subcontractors at each integral value in PSO update rules. Hence, PSO also retained its
period, or the maximum number of employees to be hired or laid dynamics while produced solutions are integer.
off. Any other limited backlogs or inventories can also be accom- More specically, let xi = (xi1, . . . , xin)T be ith particle of the
modated in the model for practical need. swarm. Then its rounded counterpart zi = (zi1, . . . , zin)T can be de-
ned, where zij bxij 0:5c, and zij is used to replace xij. Therefore,
4. Optimization of APP model by PSO the components of a particle retain integer-valued, although the
particles velocity can be real-valued.
PSO was originally introduced for unconstrained and continu-
ous optimization problems. Its operations imply the existence of 5. The modied PSO
unrestricted and continuous explorations in search space. But to
the problem of optimizing the constrained integral APP model, The approach of the penalty function method with the alter-
there are two issues to limit PSOs performance raise: (i) restricted ation method can alleviate the deciencies of PSO to solve the con-
within plenty of equality and inequality constraints and (ii) explor- strained integral APP model. But during the course of optimizing
ing in integral subspace of n-dimensional Euclidean space. That is the reconstructed model, we found that the approach still gains
to say, PSO has limited ability in dealing with constrained and dis- unsatisfactory performance, especially a large constrained integral
3074 S.-C. Wang, M.-F. Yeh / Expert Systems with Applications 41 (2014) 30693077
APP model with plenty of equality constraints. This defect might be iteratively, according to the best searching experience of its own
attributed to that the particles have great randomness exploring in and the swarm. The update rules are as Eqs. (2) and (3), and the
large multi-dimensional integral subspace. They are inefcient to operations of the PSO is depicted in Fig. 1.
exploit the locations where meet all of the equality constraints In order to alleviate the deciency of solving the constrained
transformed. That inuences its performance to solve the APP integral linear programming model aforementioned, we dene a
problem. modied scheme of PSO. The MPSO introduces the concept of
In order to improve the problem solving by PSO aforemen- sub-particles, a particular coding principle, and a modied opera-
tioned, a modied scheme of PSO is proposed, stated as follows: tion procedure of particles to the update rules to regulate the
In SPSO, the position of ith particle xi = (xi1, xi2, . . . , xin)T is indi- search processes for a particle swarm. The main idea of the MPSO
cated as a vector which presents a potential solution of the APP is the components of ith particle partitioning into nped sub-particles
model in n-dimensional search space, where n = nped ndv, nped T
sequentially as xi xTi1 ; xTi2 ; . . . ; xTip ; . . . ; xTinped . Each sub-particle,
be the number of periods in a planning horizon, and ndv the num-
ber of decision variables in the model. Each particle moves within xip , is formed to a n dv -dimensional vector as
T
the whole n-dimensional search space, adjusting its trajectory by xip xip1 ; xip2 ; . . . ; xipd ; . . . ; xipndv represents a potential solution
dynamically adopting the velocity of its own, mi = (mi1, mi2, . . . , min)T,
of the ndv decision variables at pth period of time in planning
horizon. Each sequentially adjacent sub-particle shows successive
relationship of decision variables at a period of time in planning
START horizon. The updates of the position and velocity are by sub-
particles sequentially to meet all the constraints in the APP model.
Until the last sub-particle within a particle is updated, the particle
Initialize the swarm then renews. The update rules of the MPSO are shown in Eqs. (24)
and (25), and the operations of the MPSO is also illustrated in Fig. 2.
Evaluate the fitness for each particle mipd t 1 wmipd tc1 R1d pipd txipd tc2 R2d pgd txipd t 24
xipd t 1 xipd t mipd t 1 25
YES stopping
criterion ?
6. Computational study
NO
END Update pBest and gBest 6.1. Case description
tive values with the results of these algorithms, a quality measure- Table 3
ment called percent deviation, denoted as %Dev, is dened as the Statistical results of SPSO experiment.
Table 1
Parameters and experimental results of LINGO.
Table 2
Statistical results of MPSO experiments.
Test MPSO
SN Best Mean Std. Dev. %Dev Suc. Exe.
Rate(%) Time(sec) Fig. 3. Variation of objective values over iterations.
1 206,780 207,164.14 1,458.85 0.28 90 1.32E03
2 422,662 426,867.29 6,267.97 1.08 98 1.64E02 dimensional integral subspace, where exists plenty of equality
3 650,306 657,218.82 8,444.79 1.06 96 4.17E02 constraints. Also, the execution time is effective in these ap-
4 892,897 901,609.60 1,095.53 1.27 82 1.86E02
proaches. The comparative performances are summarized in Ta-
5 1,091,372 1,110,852.40 10,968.99 1.94 74 3.18E01
6 1,308,994 1,325,803.45 16,111.17 1.31 62 2.85E01 ble 5. The convergence characteristics over iterations for these
7 1,527,860 1,552,053.30 20,161.75 1.59 56 7.44E01 approaches is depicted in Fig. 3, that each curve represents the var-
8 1,787,031 1,820,037.64 23,696.55 1.94 86 5.12E01 iation of objective values over iterations for corresponding
Avg 11,025.70 1.309 80.5 2.42E01
approach.
3076 S.-C. Wang, M.-F. Yeh / Expert Systems with Applications 41 (2014) 30693077
It is worth mentioning that in the average of standard deviation, shortcomings, we developed an effective modied mechanism for
percent deviation, successful rate, and execution time, MPSO pro- PSO to alleviate the deciencies. And the experimental studies re-
vides better performance than SPSO, and greater than GA. Appar- vealed that the MPSO gains satisfactory performance in the aspects
ently, as a result of sub-particles introduced into the MPSO of accuracy, reliability, and convergence speed than SPSO and GA.
variant, the searching discrepancies of particles in standard devia- The discussions of all the processes about the proposed APP model,
tion and percent deviation gain decreases of 18% and 30% respec- optimizing the APP model by PSO, the difculties and ndings, the
tively than SPSO. The execution time also gets a decrease of 25% proposed MPSO, the introduced sub-particles, and its examina-
while the successful rate an increase of 10% than SPSO. Also, these tions, etc., are the focus and the contribution of this study.
performances of MPSO are greater than GA. Some research implications and managerial implications have
Therefore, we conclude that the MPSO variant possesses partic- to be mentioned when implementing these works in the future:
ular qualities in accuracy, reliability, and convergence speed for
optimizing the APP problem than SPSO and GA. (1) On the technical level, the variations that this study differs
from other PSO applications are the idea of the sub-particles,
7. Conclusions and discussions the particular coding principle and the modied operation
procedure of particles, as shown in Section 5 and Figs. 1
7.1. Conclusions and 2. In order to alleviate the deciency of PSO to the APP
problem solving, the MPSO introduced the concept of sub-
In this paper, we rst explore the important issues of PSO from particles, a particular coding principle, and a modied oper-
early precursors to contemporary standard variants. Some hybrids ation procedure of particles to the update rules to regulate
and variants are also presented for comparison. In next context, we the search processes for a particle swarm.
propose a general APP model which states a real-world APP prob- (2) The MPSO belongs to the population-based search tech-
lem from the extension of a manufacturer of gardening equipment nique, just like GA. But the differences of both are that the
in Mexico. The illustration is organized and formulated as an inte- MPSO has no manipulations of crossover, mutation, and
ger linear programming model which can be easily expanded with selection. It is based on the particular coding principle, the
adding parameters, decision variables, and constraints as needed operation procedure, and the speed of its sub-particles to
for practical use in industries. To the optimization of the APP mod- determine the search. Unlike others, these sub-particles
el, we rarely found PSO applying to the eld of APP problems in re- have memories for their search. Also, there are three advan-
searches. We also discovered that PSO has some imperfections in tages of the MPSO to the APP problem solving than others:
optimizing discrete constrained APP problems, especially a large (i) only a few parameters needed to be adjusted; (ii) be able
constrained integral problem with plenty of equality constraints. to speed up the convergence to the optimal solution; (iii) can
Therefore, in succeeding context, a modied scheme of PSO is pro- be applied to optimize most of APP problems.
posed which introduces the concept of sub-particles to the update (3) Different companies or industries have various characteris-
rules of PSO to alleviate the deciency of solving the constrained tics of aggregate decisions in aggregate production planning.
integral model. In the nal, 8 instances of APP problems with large Increasingly sophisticated parameters and assumptions into
equality constraints are implemented and experimented by MAT- an APP problem only make it hindering and impracticable
LAB and LINGO, to evaluate the performance of MPSO, SPSO and for practical applications. Therefore, this study proposed a
GA. The experimental results show that the MPSO variant gains comprehensive APP model that is easy to adjust and to be
particular qualities in accuracy, reliability, and convergence speed optimized by algorithms.
than SPSO and GA. The characteristics of this study comparing with (4) Aggregate production plans are mainly based on forecasts of
recent researches are depicted in Table 6. future demand requirements. It is important that these fore-
casts are always wrong to some degree in practice. The
7.2. Discussions aggregate production planning needs to have some exibil-
ity built into it if it is to be more useful. We recommend that
Although PSO has become a promising technique in solving a manager had better to perform sensitivity analysis on the
many practical applications and there are many successful applica- input parameters after implementing the work. It will
tions implemented PSO on various elds. However, we seldom enable the manager to choose the best solution for the range
found it applying to the eld of APP problems. The reason may of possibilities that could occur in practical applications.
be attributed to that PSO was originally introduced for uncon- (5) Despite this study inferred the MPSO variant gaining
strained and continuous problems. Its operations imply the exis- particular qualities than SPSO and GA. In order to ensure
tence of unrestricted and continuous explorations in search the performance of the problem solving of it, we suggest
space. It has limited ability in dealing with constrained integral further researchers applying the MPSO to solve more
APP problems, especially a large constrained integral problem with large complex APP problems and comparing to more
plenty of equality constraints. Therefore, in response to the algorithms.
Table 6
Characteristics of this study with current researches.
References Lung, R., & Dumitrescu, D. (2009). Evolutionary multimodal optimization for Nash
equilibria detection. In N. Krasnogor, M. Melin-Batista, J. Prez, J. M. Moreno-
Vega, & D. Pelta (Eds.), Nature inspired cooperative strategies for optimization
Al-E-Hashem, S. M. J. M., Aryanezhad, M. B., & Sadjadi, S. J. (2012). An efcient
(NICSO 2008). Berlin Heidelberg: Springer, pp. 227237.
algorithm to solve a multi-objective robust aggregate production planning in an
Mirzapour Al-E-Hashem, S. M. J., Malekly, H., & Aryanezhad, M. B. (2011). A multi-
uncertain environment. International Journal of Advanced Manufacturing
objective robust optimization model for multi-product multi-site aggregate
Technology, 58, 765782.
production planning in a supply chain under uncertainty. International Journal of
Baltas, G., Tsafarakis, S., Saridakis, C., & Matsatsinis, N. (2013). Biologically inspired
Production Economics, 134, 2842.
approaches to strategic service design: Optimal service diversication through
Nam, S.-j., & Logendran, R. (1992). Aggregate production planning A survey of
evolutionary and swarm intelligence models. Journal of Service Research, 16,
models and methodologies. European Journal of Operational Research, 61,
186201.
255272.
Baykasoglu, A. (2001). MOAPPS 1.0: Aggregate production planning using the
Paiva, R. P. O., & Morabito, R. (2009). An optimization model for the aggregate
multiple-objective tabu search. International Journal of Production Research, 39,
production planning of a Brazilian sugar and ethanol milling company. Annals of
36853702.
Operations Research, 169, 117130.
Baykasoglu, A., & Gocken, T. (2010). Multi-objective aggregate production planning
Parsopoulos, K. E., & Vrahatis, M. N. (2001). Particle swarm optimizer in noisy and
with fuzzy parameters. Advances in Engineering Software, 41, 11241131.
continuously changing environments. In Articial intelligence and soft computing.
Chen, R.-M. (2011). Particle swarm optimization with justication and designed
Pavlidis, N. G., Parsopoulos, K. E., & Vrhatis, M. N. (2005). Computing Nash equilibria
mechanisms for resource-constrained project scheduling problem. Expert
through computational intelligence methods. Journal of Computation and
Systems with Applications, 38, 71027111.
Applied Mathematics, 175, 113136.
Chopra, S., & Meindl, P. (2007). Aggregate planning in a supply chain. In Supply chain
Rakes, T. R., Franz, L. S., & James Wynne, A. (1984). Aggregate production planning
management: Strategy, planning, and operation. Upper Saddle River, NJ: Pearson
using chance-constrained goal programming. International Journal of Production
Education.
Research, 22, 673684.
Clerc, M., & Kennedy, J. (2002). The particle swarm explosion, stability, and
Ramazanian, M., & Modares, M. (2011). Application of particle swarm optimization
convergence in a multidimensional complex space. IEEE Transactions on
algorithm to aggregate production planning. Asian Journal of Business
Evolutionary Computation, 6, 5873.
Management Studies, 2, 4454.
Eberhart, & Shi, Y. (2001). Particle swarm optimization: Developments, applications
Ramezanian, R., Rahmani, D., & Barzinpour, F. (2012). An aggregate production
and resources. In Proceedings of the 2001 congress on evolutionary computation
planning model for two phase production systems: Solving with genetic
2001 (Vol. 1, pp. 8186 vol. 81).
algorithm and tabu search. Expert Systems with Applications, 39, 12561263.
Eberhart, R., & Kennedy, J. (1995). A new optimizer using particle swarm theory. In
Sakalli, U. S., Baykoc, O. F., & Birgoren, B. (2010). A possibilistic aggregate production
Proceedings of the sixth international symposium on micro machine and human
planning model for brass casting industry. Production Planning and Control, 21,
science (pp. 3943). Nagoya, Japan: IEEE.
319338.
Eberhart, R. C., & Shi, Y. (1998). Comparison between genetic algorithms and
Shi, Y., & Eberhart, R. C. (1999). Empirical study of particle swarm optimization. In
particle swarm optimization. In Proceedings of the 7th international conference on
Proceedings of the 1999 congress on evolutionary computation (Vol. 3, pp. 1950,
evolutionary programming VII (pp. 611616). Springer-Verlag.
Vol. 1953).
Eberhart, R. C., Simpson, P. K., & Dobbins, R. W. (1996). Computational intelligence PC
Shi, Y., & Eberhart, R. (1998). A modied particle swarm optimizer. In IEEE
tools. Academic Press Professional, Inc.
international conference on evolutionary computation (pp. 6973). IEEE.
Graves, S. C. (2002). Manufacturing planning and control. In P. M. Pardalos & M. G. C.
Sillekens, T., Koberstein, A., & Suhl, L. (2011). Aggregate production planning in the
Resende (Eds.), Handbook of applied optimization. New York 10016 USA: Oxford
automotive industry with special consideration of workforce exibility.
University Press.
International Journal of Production Research, 49, 50555078.
Hanssmann, F., & Hess, S. W. (1960). A linear programming approach to production
Silva, C. G. d., Figueira, J., Lisboa, J., & Barman, S. (2006). An interactive decision
and employment scheduling. Management Technology, 1, 4651.
support system for an aggregate production planning model based on multiple
Holt, C. C., Modigliani, F., & Muth, J. F. (1956). Derivation of a linear decision rule for
criteria mixed integer linear programming. Omega-International Journal of
production and employment. Management Science, 2, 159177.
Management Science, 34, 167177.
Holt, C. C., Modigliani, F., & Simon, H. A. (1955). A linear decision rule for production
Skokos, C., Parsopoulos, K. E., Patsis, P. A., & Vrahatis, M. N. (2005). Particle swarm
and employment scheduling. Management Science, 2, 130.
optimization: An efcient method for tracing periodic orbits in three-
Kennedy, J., & Eberhart, R. (1995b). Particle swarm optimization. In Proceedings IEEE
dimensional galactic potentials. Monthly Notices of the Royal Astronomical
international conference on neural networks 1995 (Vol. 4, pp. 19421948, vol.
Society, 359, 251260.
1944).
Stevenson, W. J. (2009). Operations management (10th ed.). McGraw-Hill/Irwin.
Kennedy, J., & Eberhart, R. (1995a). Particle swarm optimization. In Proceedings of
Tsafarakis, S., Saridakis, C., Baltas, G., & Matsatsinis, N. (2013). Hybrid particle
IEEE international conference on neural networks (pp. 19421948). Perth, WA,
swarm optimization with mutation for optimizing industrial product lines: An
Australia: IEEE. Vol. 4.
application to a mixed solution space considering both discrete and continuous
Kennedy, J., & Eberhart, R. C. (2001). Swarm intelligenc. Morgan Kaufmann
design variables. Industrial Marketing Management, 42, 496506.
Publishers Inc..
Venter, G., & Sobieszczanski-Sobieski, J. (2004). Multidisciplinary optimization of a
Koroec, P., Bole, U., & Papa, G. (2013). A multi-objective approach to the application
transport aircraft wing using particle swarm optimization. Structural and
of real-world production scheduling. Expert Systems with Applications, 40,
Multidisciplinary Optimization, 26, 121131.
58395853.
Zhang, R. Q., Zhang, L. K., Xiao, Y. Y., & Kaku, I. (2012). The activity-based aggregate
Lanzenauer, V., & Haehling, C. (1970). Production and employment scheduling in
production planning with capacity expansion in manufacturing systems.
multistage production systems. Naval Research Logistics Quarterly, 17, 193198.
Computers and Industrial Engineering, 62, 491503.
Liao, C.-J., Tseng, C.-T., & Luarn, P. (2007). A discrete version of particle swarm
optimization for owshop scheduling problems. Computers and Operations
Research, 34, 30993111.