Академический Документы
Профессиональный Документы
Культура Документы
53
FLOWFCHART FOR NPSO
Compute x
i
(k+1)
Compute (f(x
i
(k+1))
Reorder the particles
Generate neighborhoods I =1
k K
i = i +1
K = k+1
Start
K =1 ,Initialize x
i
(k), v
i
(k)
Compute f(x
i
(k))
Determine best particles in
the neighborhood of i
Update previous best if
necessary
I N
Stop
54
RESULT ANALYSIS
88
89
90
91
92
93
94
95
96
97
98
Haberman lens car evaluation
P
r
e
d
i
c
t
i
v
e
A
c
u
r
a
c
y
(
%
)
saga
pso
Npso
Predictive Accuracy Comparison for Dynamic
Neighborhood selection in PSO
55
RESULT ANALYSIS
Dataset Interestingness
Value
Lens 0.82
Car Evaluation 0.73
Habermans Survival 0.8
Measure of Interestingness
56
RESULT ANALYSIS
0
200
400
600
800
1000
1200
1400
1600
4 6 8 10 15 20 25 30 50
Lenses PSO
Lenses NPSO
Haberman's Survival PSO
Haberman's Survival NPSO
Car Evaluation PSO
Car Evaluation NPSO
Execution Time Comparison for Dynamic Neighborhood
selection in PSO
57
0
10
20
30
40
50
60
70
80
90
100
PSO NPSO
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
4
6
8
10
15
20
25
30
50
0
10
20
30
40
50
60
70
80
90
100
PSO NPSO
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
4
6
8
10
15
20
25
30
50
0
10
20
30
40
50
60
70
80
90
100
PSO NPSO
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
4
6
8
10
15
20
25
30
50
CONVERGENCE RATE
Car Evaluation
Lenses
Habermans Survival
datasets
58
The avoidance of premature convergence at local
optimal points tend to enhance the results
The selection of local best particles based on
neighbors (lbest) rather than particles own best
(pbest) enhances the accuracy of the rules mined
INFERENCES
59
MODULE 2
Mining AR
using PSO
Mining AR
using CPSO
Mining AR
using NPSO
Mining AR
using PSO
60
MINING AR USING SAPSO
inertia-weight parameter Is added to the velocity equation as
where, w is the inertia weight.
Three self adaptive method of inertia weight is proposed as
=
max
(
max
min
) g/G
( t+1) = (t) (
max
min
) /G
where, g is the generation index representing the current
number of evolutionary generations, and G is a redefined
maximum number of generations. Here, the maximal and
minimal weights
max
and
min
are set to 0.9 and 0.4, based on
experimental study.
61
Dataset
Highest PA achieved within 50 runs of iterations
No weight
(Normal PSO)
w = 0.5 w = 0.7
Lenses 87.5 88.09 84.75
Haberman 87.5 96.07 99.80
Car 96.4 99.88 99.84
POP Care 91.6 98.64 97.91
Zoo 83.3 96.88 98.97
EFFECT OF CHANGING W
Predictive Accuracy Comparison
62
RESULT ANALYSIS
Predictive Accuracy Comparison for Lenses Dataset
50
55
60
65
70
75
80
85
90
95
100
10 20 40 60 80 100
P
r
e
d
i
c
t
i
v
e
A
c
c
u
a
r
c
y
(
%
)
No. of Iterations
PSO
WPSO
SAPSO1
SAPSO2
SACPSO
63
Predictive Accuracy Comparison for Habermans Survival Dataset
RESULT ANALYSIS
50
55
60
65
70
75
80
85
90
95
100
10 20 40 60 80 100
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
No. o Iterations
PSO
WPSO
SAPSO1
SAPSO2
SACPSO
64
Predictive Accuracy Comparison for Post operative patient care
Lenses Dataset
RESULT ANALYSIS
50
55
60
65
70
75
80
85
90
95
100
10 20 40 60 80 100
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
No. of Iterations
PSO
WPSO
SAPSO1
SAPSO2
SACPSO
65
Predictive Accuracy Comparison for Zoo Dataset
RESULT ANALYSIS
87.5
95.45
50 50 50 50
40
50
60
70
80
90
100
10 20 40 60 80 100
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
No. of Iterations
PSO
WPSO
SAPSO1
SAPSO2
SACPSO
66
Predictive Accuracy Comparison for Car Evaluation Dataset
RESULT ANALYSIS
50
55
60
65
70
75
80
85
90
95
100
10 20 40 60 80 100
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
No. of Iterations
PSO
WPSO
SAPSO1
SAPSO2
SACPSO
67
RESULT ANALYSIS
Predictive Accuracy Comparison
70
75
80
85
90
95
100
Lenses Car Evaluation Habermans Survival Po-opert Care Zoo
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
PSO
CPSO
NPSO
WPSO
SAPSO2
SAPSO1
SACPSO
68
INFERENCES
Self adaptive methods perform better than other
methods
In term of computational efficiency SAPSO1
performs better
Setting of appropriate values for the control
parameters involved in these heuristics methods is
the key point to success in these methods
69
MODULE 3
Mining Association rules using Hybrid GA/PSO
(GPSO)
70
RELATED WORKS
S.No Method Application Year
1 Hybrid GA and PSO Global
Optimization
2009
2 Chaotic Hybrid GA
& PSO
Circle
Detection
2010
3 Hybrid GA and PSO Job shop
Scheduling
2010
4 PSO with dynamic
Inertia Weight and
PSO
Classification
Rule Mining
2012
71
HYBRID GA/ PSO (GPSO) MODEL
Genetic
Algorithm
Particle
Swarm
Optimization
Evaluate
Fitness
Upper
Lower
Initial
Population
Ranked
Population
Updated
Population
72
RESULT ANALYSIS
Predictive Accuracy Comparison
Dataset GA PSO GPSO
Lenses 75 87.5 87.5
Habermans
survival
50 90 95
Car
Evaluation
75 94.4 98
Post
operative
Patient
85 83.5 90
Zoo 92.5 95.45 95
73
0
10
20
30
40
50
60
70
80
90
100
GA PSO GPSO
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
10
20
30
40
50
0
10
20
30
40
50
60
70
80
90
100
GA PSO GPSO
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
10
20
30
40
50
Car evaluation
Dataset
Habermans
Survival Dataset
RESULT ANALYSIS
Predictive Accuracy Comparison
74
0
10
20
30
40
50
60
70
80
90
100
GA PSO GPSO
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
10
20
30
40
50
0
10
20
30
40
50
60
70
80
90
100
GA PSO GPSO
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
10
20
30
40
50
Post operative
patient care
Dataset
Lenses Dataset
RESULT ANALYSIS
Predictive Accuracy Comparison
75
0
10
20
30
40
50
60
70
80
90
100
GA PSO GPSO
P
r
e
d
i
c
t
i
v
e
A
c
c
u
r
a
c
y
(
%
)
10
20
30
40
50
Zoo Dataset
RESULT ANALYSIS
Predictive Accuracy Comparison
76
INFERENCES
Generates rule with better predictive accuracy when
compared to GA and PSO.
Global search optimization of GA and powerful stochastic
optimization offered by PSO are both combined in GPSO,
resulting in association rules with consistent accuracy.
77
Genetic Algorithm when used for mining association rules
performs better than existing methods accuracy achieved
Particle swarm optimization when adopted for mining
association rules produces results closer to GA but with
minimum execution time
Variations when introduced in both GA and PSO indicates self
adaptive mechanism performs better than others
The premature convergence being the major drawback of PSO
was handled by introducing inertia weights, chaotic maps,
neighborhood selection adaptive inertia weight
Hybrid GA/PSO model produces consistent results in
comparison with GA and PSO
CONCLUSION
78
WORK TO BE COMPLETED
Balancing with exploration an exploitation in PSO
by self adaptive accelerative coefficients
Breeding Swarms: Adding Mutation into gBest
implementing other measures as Execution time
Comparison, number of rules generated, recall.
79
CONTRIBUTION TO RESEARCH
Chaotic operators based on two maps for mining association
rule
Chaotic self adaption in PSO for mining AR
Hybrid GA/PSO (GPSO) for AR mining
80
Papers Published
CONFERENCES
K.Indira and S.Kanmani, Framework for Comparison of Association Rule Mining
Using Genetic Algorithm, In : International Conference On Computers,
Communication & Intelligence , 2010.
K.Indira and S.Kanmani, Mining Association Rules Using Genetic Algorithm: The
role of Estimation Parameters , In : International conference on advances in
computing and communications, Communication in Computer and Information
Science, Springer LNCS, Volume 190, Part 8, 639-648, 2011
K.Indira, S. Kanmani
, Gaurav Sethia.D, Kumaran.S and Prabhakar.J,
Rule
Acquisition in Data Mining Using a Self Adaptive Genetic Algorithm, In : First
International conference on Computer Science and Information Technology,
Springer LNCS Volume 204, Part 1, 171-178, 2011.
K.Indira, S.Kanmani, Prasanth, Harish and Jeeva, Population Based Search
Methods in Mining Association Rules , In : Third International Conference on
Advances in Communication, Network, and Computing CNC 2012, LNICST pp.
255261, 2012.
81
JOURNAL
K.Indira and S.Kanmani, Performance Analysis of Genetic Algorithm
for Mining Association Rules, IJCSI International Journal of Computer
Science Issues, Vol. 9, Issue 2, No 1, 368-376, March 2012
K.Indira and S.Kanmani, Rule Acquisition using Genetic Algorithm,
accepted for publication in Journal of Computing
K.Indira and S.Kanmani, Enhancing Particle Swarm optimization
using chaotic operators for Association Rule Mining, Elixir Computer
Science & Engineering Journal, 46 ,8563-8566, 2912
K.Indira and S.Kanmani, Association Rule Mining by Dynamic
Neighborhood Selection in Particle Swarm Optimization,
communicated to International journal of Swam Intelligence,
Inderscience Publications
82
JOURNAL
K.Indira and S.Kanmani, Association Rule Mining using Self Adaptive
Particle Swarm Optimization, accepted for publication in
International Journal of Computer Science Issues July Issue.
K.Indira and S.Kanmani, Measures for Improving Premature
Convergence in Particle Swarm Optimization for Association Rule
Mining, communicated to International Journal on Data
Warehousing, IGI press.
K.Indira an S.Kanmani, Mining Association Rules using Hybrid
Genetic Algorithm and Particle Swarm Optimization Algorithm
(GPSO), to communicate
83
TIME SCHEDULE
Feb-12 Apr-12 May-12 Jul-12 Aug-12 Oct-12 Dec-12 Jan-13
GA & PSO IN Rule Mining - Journal
Exporation and Exploitation Avoidance
Role of mutation in hybridisation
Synopsis - Preparation
Thesis - Preparation
84
Jing Li, Han Rui-feng, A Self-Adaptive Genetic Algorithm Based On
Real- Coded, International Conference on Biomedical Engineering
and computer Science , Page(s): 1 - 4 , 2010
Chuan-Kang Ting, Wei-Ming Zeng, Tzu- Chieh Lin, Linkage Discovery
through Data Mining, IEEE Magazine on Computational Intelligence,
Volume 5, February 2010.
Shangping Dai, Li Gao, Qiang Zhu, Changwu Zhu, A Novel Genetic
Algorithm Based on Image Databases for Mining Association Rules, 6th
IEEE/ACIS International Conference on Computer and Information
Science, Page(s): 977 980, 2007
Yamina Mohamed Ben Ali, Soft Adaptive Particle Swarm Algorithm for
Large Scale Optimization, IEEE 2010.
Yan Chen, Shingo Mabu, Kotaro Hirasawa, Genetic relation algorithm
with guided mutation for the large-scale portfolio optimization, Expert
Systems with Applications 38 (2011), 33533363.
REFERENCES
85
Xiaoyuan Zhu, Yongquan Yu, Xueyan Guo, Genetic Algorithm Based
on Evolution Strategy and the Application in Data Mining, First
International Workshop on Education Technology and Computer
Science, ETCS '09, Volume: 1 , Page(s): 848 852, 2009
Hong Guo, Ya Zhou, An Algorithm for Mining Association Rules Based
on Improved Genetic Algorithm and its Application, 3rd International
Conference on Genetic and Evolutionary Computing, WGEC '09,
Page(s): 117 120, 2009
Genxiang Zhang, Haishan Chen, Immune Optimization Based Genetic
Algorithm for Incremental Association Rules Mining, International
Conference on Artificial Intelligence and Computational Intelligence,
AICI '09, Volume: 4, Page(s): 341 345, 2009
Maria J. Del Jesus, Jose A. Gamez, Pedro Gonzalez, Jose M. Puerta,
On the Discovery of Association Rules by means of Evolutionary
Algorithms, from Advanced Review of John Wiley & Sons , Inc. 2011
REFERENCES
86
Junli Lu, Fan Yang, Momo Li, Lizhen Wang, Multi-objective Rule
Discovery Using the Improved Niched Pareto Genetic Algorithm, Third
International Conference on Measuring Technology and Mechatronics
Automation, 2011.
Hamid Reza Qodmanan, Mahdi Nasiri, Behrouz Minaei-Bidgoli, Multi
Objective Association Rule Mining with Genetic Algorithm without
specifying Minimum Support and Minimum Confidence, Expert
Systems with Applications 38 (2011) 288298.
Miguel Rodriguez, Diego M. Escalante, Antonio Peregrin, Efficient
Distributed Genetic Algorithm for Rule Extraction, Applied Soft
Computing 11 (2011) 733743.
R.J. Kuo, C.M. Chao, Y.T. Chiu, Application of particle swarm
optimization to association rule mining, Applied Soft Computing 11
(2011) 326336.
Bilal Alatas , Erhan Akin, Multi-objective rule mining using a chaotic
particle swarm optimization algorithm, Knowledge-Based Systems 22
(2009) 455460.
REFERENCES
87
Mourad Ykhlef, A Quantum Swarm Evolutionary Algorithm for mining
association rules in large databases, Journal of King Saud University
Computer and Information Sciences (2011) 23, 16.
Jing Li, Han Rui-feng, A Self-Adaptive Genetic Algorithm Based On
Real- Coded, International Conference on Biomedical Engineering
and computer Science , Page(s): 1 - 4 , 2010
Miguel Rodriguez, Diego M. Escalante, Antonio Peregrin, Efficient
Distributed Genetic Algorithm for Rule extraction, Applied Soft
Computing 11 (2011) 733743.
Hamid Reza Qodmanan , Mahdi Nasiri, Behrouz Minaei-Bidgoli, Multi
objective association rule mining with genetic algorithm without
specifying minimum support and minimum confidence, Expert Systems
with Applications 38 (2011) 288298.
REFERENCES
88
Xiaoyuan Zhu, Yongquan Yu, Xueyan Guo, Genetic Algorithm Based
on Evolution Strategy and the Application in Data Mining, First
International Workshop on Education Technology and Computer
Science, ETCS '09, Volume: 1 , Page(s): 848 852, 2009.
Junli Lu, Fan Yang, Momo Li1, Lizhen Wang, Multi-objective Rule
Discovery Using the Improved Niched Pareto Genetic Algorithm, 2011
Third International Conference on Measuring Technology and
Mechatronics Automation.
Feng Lu, Yanfeng Ge, LiQun Gao, Self-adaptive Particle Swarm
Optimization Algorithm for Global Optimization, 2010 Sixth
International Conference on Natural Computation (ICNC 2010)
Fevrier Valdez, Patricia Melin, Oscar Castillo, An improved
evolutionary method with fuzzy logic for combining Particle Swarm
Optimization and Genetic Algorithms, Applied Soft Computing 11
(2011) ,26252632.
89