2009 International Conference on Research Challenges in Computer Science

A fuzzy classification method based on quantum genetic algorithm

and its application in pattern recognition

Zhou Rigui1, 2 Cao Jian1,*
(1. College of Information Engineering, East China JiaoTong University, 330013, Nanchang, Jiangxi, P.
R. China
2. Key Laboratory for Quantum Information and Measurements of Ministry of Education, Tsinghua
University, 100084, Beijing, P. R. China)

Abstract: A fuzzy classification system is its application has been involved in automatic
constructed based on quantum genetic algorithm control, image recognition, artificial intelligence
(QGA) and fuzzy theory. Firstly, fuzzy rules are and decision-making etc.
generated from numerical data for classification Many other subjects have been also
problems, in which number axis is fuzzy introduced in the learning of fuzzy rules. For
partitioned with trapezoid method. Second, it uses example, Hisao Ishibuchi et al optimize fuzzy
QGA to select significant fuzzy rules and removes rules to construct a classification system using
unnecessary rules, so fuzzy rules reach an genetic algorithm in 1994[4]. Also based on
optimization state. Finally, the feasibility and the genetic algorithm, Yu-fei Yuan and Hui-jun
validity of this QGA-based approach to fuzzy Zhuang find an optimal set of fuzzy rules to
classification system are verified through the build a fuzzy classification system in 1996[5].
pattern recognition. Recently, Cai Guo-qiang et al proposes an
approach to design fuzzy classification systems
Keywords: fuzzy classification; fuzzy partition;
based on the Max-M in ant colony algorithm[6].
quantum genetic algorithm
Based on boosting fuzzy classification, Luo Jun
I. INTRODUCTION advances a novel method for text categorization
[7]
In 1965, L.A.Zadeh, a professor in . Shen Shao-hao presents a gait recognition
university of California, published his algorithm based on genetic-fuzzy classification
[1] [8]
well-known paper “Fuzzy Sets” on .
information and control, in which he firstly Moreover after Quantum Computing was
proposed fuzzy set theory with a concept of first proposed in the 1980s, its combining with
"membership function", from then on, fuzzy the subjects in other areas is an important
mathematics was founded. In 1968, Zadeh forefront topic recently. Just based on quantum
[2]
further proposed a “fuzzy algorithm” concept ， genetic algorithm, this paper constructs a fuzzy
he noted that most realistic problems tend to be classification system.
complex, and many complex problems are either II. FUZZY SET
algorithmically unsolvable or, if solvable in Fuzzy set is the theory applying a
principle, are computationally infeasible. mathematical approach to deal with human
Motivated by this idea, E.H.Mamdani applied semantic ambiguity, especially for the
fuzzy theory to control boiler and steam engine description of something, such as very flashy
[3]
for the first time in 1974 . Apart from fuzzy shoes, a beautiful girl, good food…and so on. In
control, there are many other studies on fuzzy Crisp sets A, elements belong to A or not, that is,
theory, In the ensuing 30 years, Fuzzy Characteristic functions f ( x) of Crisp sets is as
mathematics gained significant development and ⎧1 if x ∈ A
follows: f ( x) = ⎨ . However, f ( x) of
has achieved amazing fruitful achievement in the ⎩ 0 if x ∉ A
theory and application. And now the domain of fuzzy set, namely, membership function, does
* Corresponding author

978-0-7695-3927-0/09 $26.00 © 2009 IEEE 187

DOI 10.1109/ICRCCS.2009.55
not equal only to 1 or 0, and could be equal to all this paper is showed in Fig.4.
values belong to [0, 1]. We can choose any type
of membership function, e.g. triangular,
trapezoid, exponential. In this paper, we use Fig.3 triangular partition

trapezoid membership function, which is

described in detail as follows:
Fig.4 trapezoid partition
So the membership function of Ai is as
follows:
Fig.1 trapezoid membership
⎧0 x<a
⎪ ( x − a ) / (b − a ) a< x<b
⎧0 x<a ⎪⎪
⎪ ( x − a ) / (b − a ) a< x<b fi ( x) = ⎨ 1 b< x<c
⎪⎪ ⎪( d − x ) / ( d − c )
trapezoid ( x : a, b, c, d ) = ⎨ 1 b<x<c c<x<d
⎪
⎪( d − x ) / ( d − c ) c<x<d ⎪⎩ 0 x>d
⎪
⎪⎩ 0 x>d
Where a=i-2, b=i-1, c=i, and d=i+1.
Where a, b, c, d are the parameters of trapezoid B. If-Then rules generation
as shown in Fig.1
A subspace (e.g. Ai × Aj in two-dimension
III. FUZZY RECOGNITION SYSTEMS
In this section, based on a partition method
pattern space) include a fuzzy rule Rij :
with rectangular fuzzy rules proposed by Hisao
Ishibuchi [4], we describe a generation method of
Rij : if x1 is Ai and x2 is Aj
trapezoid fuzzy rules from numerical data.
A. Fuzzy partition
Then (x1, x2) belongs to Cij with the probability of Pij
Let us consider a simple classification
system in two-dimension pattern space [0,1]×
Where Cij is a classification which will be
[0,1]. We apply a partition method of trapezoid
fuzzy rules as shown in Fig.2. determined in the follow learning procedure. We
can train these parameters through a group of
learning data. For example, we have N learning

patterns x p = ( x p1 , x p 2 ) , p = 1, 2,..., N which

belong to M classifications. Cij and Pij can be

determined by the following method.

Fig.2 fuzzy partition with trapezoid function Pc (c = 1, 2,..., M ) represents the probability of
In Fig.2 each axis is divided into 7 subsets, so
xp belonging to classification C ,and
the space is partitioned into 49 fuzzy subspaces,
and each subspace actually includes a fuzzy rule. pc = ∑ ( f (x i p1 ) × f j ( x p 2 )) .Find the maximum
For the general case, the axis is divided into α x p ∈C

px among Pc , px = max{ p1 , p2 ,..., pM } . And

fuzzy subsets { A1 A2 ...... Aα } . In his paper, Hisao
Cij = x , that is, Cij is classification x . Pij is
Ishibuchi divides axis as Fig.3. We apply
trapezoid membership function and employ
the probability of Cij = x ,
equivalence partition in each axis, the method in

188
 M M in the generation t , besides
Pij = [ px − ∑ pc ( M − 1)] ∑p c .
c =1 c =1
c≠ x ⎡α tj1 α tj 2 α tj 3 ... α tjα 2 ⎤
p tj = ⎢ t ⎥
⎢⎣ β j1 β j 2 β j 3 ... β jα 2 ⎥⎦
t t t
C. Fuzzy recognition system
x=（ x1 , x2） is a new pattern can be
classified by the following method. αt ,βt ( i = 1, 2, 3, ..., m ) are all equal to 1 .
ji ji
2
pc = ∑ f i ( x1 ) × f j ( x2 ) × pij is the probability of Step 2 Measurement
x∈c

x∈c , find the maximum pt among Measuring the population to convert

Pc (c = 1, 2,..., M ) , pt = max{ p1 , p2 ,..., pM } , chromosome’s quantum encoding to binary

and finally x=（ x1 , x2） belongs to encoding, thereby its fitness is calculated.

classification t with the probability of pt . Aftermeasurement R(t ) = {b1t , b2t , b3t ,..., bnt } ,
IV. CLASSIFICATION BASED ON QGA
We optimize fuzzy control rules applying where btj ( j = 1, 2, 3, ..., n ) is the individual j
this computing manner. The objectives are to
in the generation t , which is binary string
maximum the number of correctly classified
patterns by the fuzzy rules and minimize the determined by α tji , β tji ( i = 1, 2, 3, ..., m ) . The
number of the fuzzy rules. Based on these two
process of measurement is: Produce a
objectives we formulate a combinatorial
2
optimization problem. random number r (value in 0~1), if r< α tji

Object function: w ncp × ncp ( s ) − w s × ns then set this bit to 0, else to 1.

Constraint: R ⊆ Rall Step3 Fitness calculation

Where ncp(s) is the number of correctly Evaluate each individual with the object
classified patterns and ns is the number of the function w ncp × ncp ( s ) − w s × ns and store the
fuzzy rules, w ncp , w s are weights of ncp(s)
largest fitness individual.
and ns respectively. Step 4 Quantum Gates update
In section 3.1, the axis is divided into α
Applying U to each p tj ( j = 1, 2, 3, ..., n ) in P(t ) :
subsets, in the two-dimension space, there are
α 2 subspaces, and the number of generation ⎡α tji ⎤ ⎡cos θ − sin θ ⎤ ⎡α tji ⎤
fuzzy rules is also α 2 . We construct a sequence ⎢ t ⎥=⎢ ⎢ ⎥
⎢⎣ β ji ⎥⎦ ⎣ sin θ cos θ ⎥⎦ ⎢⎣ β jit ⎥⎦
to denote these α 2 rules: R = R1 R2 R3 ...Rα 2
θ = S (α tji , β tji ) • Δθ tji , S (α tji , β tji ) represents
Ri = 1, or 0 (i = 1, 2,..., α 2 ) represents Ri
for the direction of quantum gates rotation, and
belongs to Rall or not respectively. QGA for the
Δθ tji for the angle of rotation. The direction and
fuzzy rules selection is presented in detail as
follows: angle of rotating in traditional QGA are
Step 1 Quantum initialization pre-given [9]
The population P(t ) is constructed Step 5 t=t+1, when t reach the preset number,
the algorithm is terminated，else switches to step
with n individuals, P(t ) = { p1t , p2t ,..., pnt } ,
2 to continue running,

where p tj ( j = 1, 2, 3, ..., n ) is the individual j

189
 V. SIMULATION RESULTS anonymous referees for their helpful comments
We apply QGA to the classification and suggestions to improve the presentation of
problem in Fig.5 (two-class classification this paper. This work is supported by the
problem in two dimension space). N in every National Natural Science Foundation of China
population is set to 20, iterations is 1000, and under Grant No.60873069, China Postdoctoral
Science Foundation funded project under Grant
w ncp =15, w s =1.
NO.20080440401, the item of science and
•
⊕ technology awarded by Education Bureau of
•
•
⊕
Jiangxi Province under Grant No. GJJ09211, and
⊕
⊕

•
•
•
⊕
the 2009’s Natural Science Foundation of
⊕
• • Jiangxi Province with the title of “The research
of the Non-classical neural network model”.
Fig.5 a classification problem
REFERENCES
From the following figures, we can see all the
[1] [1]L.A.Zadeh. Fuzzy sets. Information and Control. 8:
given patterns are correctly classified by three 338-353, 1965.
fuzzy rules. And the recognition result is as Fig.6 [2] [2]L.A.Zadeh. Fuzzy algorithm. Information and
Control. 12: 94-102, 1968.
shown. [3] [3]E.H.Mamdani. Application of fuzzy algorithms for
⊕ ⊕
control of simple dynamic plant. Proc.inst.Elec.Eng..
• • 121:1585-1588, 1974.
• •
• • [4] [4]Hisao Ishibuchi, Ken Nozaki, Naohisa Yamamoto
⊕ ⊕ ⊕ ⊕
⊕
•
⊕
•
Hideo Tanaka. Construction of fuzzy classification
• • systems with rectangular fuzzy rules using genetic
• ⊕
⊕ • ⊕
⊕
• • • • algorithms . Fuzzy Sets and Systems 65: 237-253, 1994
[5] [5]Yufei Yuan and Huijun Zhuang . A genetic
algorithm for generating fuzzy classification rules .
Fuzzy Sets and Systems 28:1-19, 1996.
a b
[6] [6]Cai Guo-qiang, Jia Li-min, Xing Zong-yi, Liu Qin.
•
⊕
•
⊕ Design of Ant Colony Algorithm-based Fuzzy
• • Classification System[J]. Fuzzy System sand
• •
⊕ ⊕ ⊕ ⊕ Mathematics. 22(4): 87-98, 2008
⊕ ⊕
•
•
•
• [7] [7]LuoJun, Kuang Hang. Text categorization based on
• ⊕
⊕ • ⊕
⊕ genetic fuzzy classification and Boosting method.
• • • • Computer Applications[J]. 28(9): 2386-2391. 2008
[8] [8]Shen Shao-hao,Xia Li-min, Sun Zheng-jun. Gait
Recognition Based on Genetic Fuzzy Classification.
c d Computer Science[J]. 36(1):190-193.2009
[9] [9]Yang Jun-an, Li Bin, Zhuang Zhen-quan. Research
Fig.6 three rules selected by QGA and the recognition result
of quantum genetic algorithms and its application in
VI. CONCLUSION blind source separation [J].Journal of Electronics,
20(1): 62-68,2003.
Based on quantum genetic algorithm, this [10] [10]Xing Huan-lai, Pan Wei, Zou Xi-hua. A Novel
Improved Quantum Genetic Algorithm for
paper proposes a fuzzy classification system. We Combinatorial Optimization Problems [J] . Acta
apply trapezoid fuzzy partition, calculate the Electronica Sinica, 35(10):1999-2002, 2007.
[11] [11]Luo Hong-min,Wang Jia-ying,Zhu Pei-min,et al.
membership function of every subspace in detail, Quantum genetic algorithm and its application in
and formulate a fuzzy rules system. Through magnetotelluric data inversion[J]. Chinese J. Geophys.
(in Chinese) , 52 (1) :260-267, 2009 .
selecting the fuzzy rules based on QGA, the [12] [12]Li Cheng-zu. Quantum Communication and
Quantum Computing[M]. Changsha: Defense
number of correctly recognized pattern is Technology University Press, 2000.
maximized and the number of the fuzzy rules is [13] [13]Li Shiyong , Li Panchi. A quantum genetic
algorithm based on real encoding and gradient
minimized. As shown in the simulation of information of object function [J ] . Journal of Harbin
Institute of Technology . 38 (8) : 1216 – 1218, 2006.
pattern recognition, this fuzzy classification
[14] [14]Nielsen M.A., Chuang I.L.: Quantum Computation
method based on QGA is feasible and effective. and Quantum Information. Cambridge University
Press, London (2000)
ACKNOWLEDGMENT [15] [15]Rigui,Z.,Qiang,X.,etal. Multi-pattern high probable
quantum search algorithm[J]. Nanjing University
Aeronaut and Astronaut . 39(2): 227–230, 2007.
The authors would like to thank the

190