Proceedings of the International Conference on Communication and Electronics Systems (ICCES 2018)

IEEE Xplore Part Number:CFP18AWO-ART; ISBN:978-1-5386-4765-3

An Efficient Decision Support Model Based on

Ensemble Framework of Data Mining Features
Assortment & Classification Process
Priyanka Sharma
M.Tech Scholar, Deptt. of CSE
RCEW, Jaipir, Rajasthan, India
Sonal Saxena Dr. Yatendra Mohan Sharma
Asst. Prof. Deptt. of CSE Assoc. Prof., Dept. of CSE,
RCEW, Jaipir, Rajasthan, India BBCET, Jaipur, Rajasthan, India

Abstract— Over past decades, to expand the fitness and

success of verdict a bunch of decision support models on the base
of data mining classification techniques has proposed by
numerous researchers. However, introduced practices have
benefited the users in different ways but due to inadequate build
procedure, use of solitary classification technique or incorporate
the functionality of arbitrarily picked methods into a single
practice each approach face dissimilar complexity and fail to
obtain utmost results with different state of affairs. The selection
of the appropriate classification algorithm for a given data-set is
an important and complex issue, full of research challenges. On
the other hand building different model for dissimilar data sets
increase cost and time with lacking of correctness. This dilemma
of accessible decision support systems has considered into this
paper by proposing a new dynamic ensemble framework of data
mining classification method with condensed feature selection
procedure. The experimental results depicts that proposed
approach has produce more precise outcomes in comparison of
classical approaches.
Keywords—Data Mining, Classification Techniques, Feature
Reduction, Ensemble Framework.
I. INTRODUCTION
Typically, notion of decision support system (DSS) is very
extensive, different investigators has discussed it in dissimilar
way. Over past decades, much of investigators have verified
that decisions builds by human beings can be outlying from
optimal judgment and it deteriorate with difficulty and tension.
On the other hand in much of crucial working fields and in
situations excellence of verdict is essential, in medical area an
incorrect or delayed decision may cause of hazard for sick
person. To support human being judgment and augment the
quality of build decisions much of schemes have been
intended in programming form of computer. The implemented
schemes employ as sole or incorporated tool for support of
tough decision building task in quick way. Such milieus are
habitually known as decision support systems [1].
DSS is an adjustable and interactive tool which examines
the statistics with a set of rule to facilitate decision makers in
term to improve the effectiveness of build decisions [2]. A
decision support system can be intended for dissimilar process
such as simulation, analyzing, forecasting and optimization
task [3-5]. The figure 1.1 depicted the class in DSS.
Fig. 1. Different Categories in Decision Support System
However, with advanced technologies, speedy and more
exact calculative outcomes the digital systems has builds the
faith level of its users but rapid growth in amount of data and
origination of naïve practice on daily basis has increase the
trust fears on digital information. On the other hand most of
studied models are not suitable for examines the statistics with
unstable data sets, model face hitch and be unsuccessful to
provide an efficient outcome for support or build an admirable
decision [6]. Therefore accessible approaches lacks in term of
accuracy. Over past decades a good number of researchers
have exposed that accuracy of analyzed data can be lift up
with the advanced methods of data mining. A good amount of
researchers have also demonstrate that instead of sole scheme
of data mining an ensemble algorithms are more capable to
create high precise and efficient outcome to support decision
making process with good accuracy. Therefore, the work that
incorporated into this paper gives a more concentration on to
design and utilize an effective decision support practice using
hybrid scheme.
To overcome the deficiency of obtainable decision support
methods and picks up reliability ratio in term of recognition
accuracy the proposed approach has analyzed the performance
of Naïve Bayes, Decision Tree, KStar, IBK and Hoeffding
tree, most popular classification methods of data mining with
5 different feature selection methods. Subsequent to analyzing
the act of each selected algorithm without an involvement of
human action the proposed approach automatically opt the
best two dissimilar forecast methods with reduces size of
feature set and incorporates the working functionality of
selected algorithm into a layered approach.

978-1-5386-4765-3/18/$31.00 ©2018 IEEE 487

 Proceedings of the International Conference on Communication and Electronics Systems (ICCES 2018)
IEEE Xplore Part Number:CFP18AWO-ART; ISBN:978-1-5386-4765-3
II. RELATED WORK
Over past few decades a number of decision support model
have proposed to improve the accuracy and efficiency of build
decision by integrating an exclusive method of data mining.
However, each approach associates their unique benefits and
limitation.
Li et al. [7] have discussed a decision support model for
credit. They employ chronological mixture of kernel
procedures for improve interpretability of credit classification
models. Lalit Dole, Jayant Rajurkar [8] have present a
decision support model on the base of modified version of
Naïve Bayes (NB) classification algorithm of data mining to
predict an average grade point of graduating students. They
have gathered data through surveys. Veenita Kunwar et. al. [9]
have employed Naïve bayes and Artificial Neural
Network(ANN) for building an efficient prediction model for
Chronic Kidney Disease(CKD). They have considered age,
diabetes, blood pressure and RBC count as simulation
parameters. The investigational outputs illustrated that from
ANN method Naïve bayes approach has outperformed.
Meryem Ouahilal et al. [10] have introduced a decision
support model for stock market. They have shown a
proportional investigation over Decision Tree, Multiple Linear
and Support Vector Regression with L’Oréal financial dataset.
Their analysis outcomes have demonstrates that SV regression
produced the best forecasts. Yicheng Jiang et al. [11] have
depicts a three-layer based decision support system for
judgment of patient’s disease. The introduced approach
exploits constructive information to crack inexactness of the
knowledge by adding the “property” to the two-layer
knowledge base. The designed approach iteratively computes
disease probability with Naive Bayes classification algorithm
which significantly reduces the dependencies between
attributes. Additionally, authors have stated that designed
approach was employed by two experienced doctors for
clinical decision building process whose has find that
proposed three-layer model is more effective for
recommendations.
Saeed Piri et al. [12] have proposed a clinical decision
support system (CDSS) for diabetic retinopathy. The authors
have analyzed data from >1.4 million diabetic patients to
demonstrate that build ensemble technique produced more
accurate outcomes in comparison of obtainable methods. To
improve quality of build approach the authors has given more
consideration over the data cleaning and preparation by
analyzing the data distribution and percentage of missing
value, select key values which have enough and significant
predictive powers. Emrana Kabir Hashi et al. [13] have
proposed a new expert clinical Decision Support System for
judge the diseases of diabetes patient’s more accurately. They
have employ data mining classification technique Decision
Tree and K-Nearest Neighbor (KNN) for the diseases
diagnosis process. To trained the build model authors have
employed 70% data for training and remain 30% for testing.
At the training time approach produced 100% accuracy while
at testing phase decision tree and KNN provide 90.43% and
76.96% accuracy respectively. The authors have evaluated
their approach with the previous proposed approaches [14-17]
which has employed same data set for model training and
978-1-5386-4765-3/18/$31.00 ©2018 IEEE
testing. The experimental outcomes have demonstrated that in
comparison of evaluated approaches the introduced model
have produced best accuracy (90.43%). Yung-Fu Chen et al.
[18] have proposed a clinical decision support system for
fracture prediction. For the training and testing of designed
model authors has take patients data from National
HealthInsurance Research Database (NHIRD), aged 20 years
and older visited clinic in between 2002 to 2010. The authors
has elect genetic algorithm (GA) and support vector machine
(SVM) for building the new decision support systems for
clinical judgment. The experimental results have shown that
proposed approach has achieves sensitivity of 69.84–77.00%
and an AUC of 0.7495–0.7590. With same procedure a group
of authors has builds a support model for patients of asthma
[19]. In [20-22] different group of authors have build
dissimilar decision support model for unrelated work. Each
one has depicted the advantages of designed model in
comparison of other accessible approaches. All the models
builds with the classification methods of data mining which
shows that data mining methods are more useful to design an
efficient decision support model.
III. PROPOSED APPROACH
To fabricate competent and precise decisions support
model five popular data mining algorithms Naïve Bayes,
Decision Tree, KStar, IBK and Hoeffding tree has considered
with different feature assortment actions and data sets.
Typically, before analyzing the act of each algorithm over
selected datasets a feature assortment procedure has executed
with five different procedures of data mining. Each algorithm
evaluated with selected sets of features over data set and at last
the classification method has elected with feature selection
procedure by which it produced higher accuracy results. On
the base of performance evaluation of each approach two best
classification methods has opted by proposed mechanism
which incorporates selected methods into a layer form. The
proposed mechanism automatically selects best two suitable
classification mechanisms and feature assortment procedure
for supplied data set, no need of manually efforts. A 10 fold
cross validation process has also integrated in proposed
approach to train build model automatically with a procedure
of testing. Following steps illustrate the working methodology
of proposed mechanism in easy way.
Dataset, UCI Library Data Preprocessing
Classification Techniques NB, Analysis an act of
each Classification
DT, KStar, IBK, Hoeffding Tree
Method with 5
assorted Feature
Feature Selection Selection
Methods Procedures
Build an Ensemble Framework Opt Best Two
lively on base of integrating Methods with feature
functionality of opted methods
Assortment process
into layer form
Fig. 2. Building Procedure of Proposed Framework
488
 Proceedings of the International Conference on Communication and Electronics Systems (ICCES 2018)
IEEE Xplore Part Number:CFP18AWO-ART; ISBN:978-1-5386-4765-3
IV. EXPERIMENT & RESULT ANALYSIS
To clarify an efficiency of proposed approach over
classical and modern decision support mechanism different
experiments has performed with dissimilar data sets which
have collected from UCI library.
First experiment has performed for assisting in area of
clinical decision, opted diabetes dataset to depict an act of
proposed methodology in excess of classical and other
proposed approaches. This selected dataset enclose 768
instances, 268 positive and 500 negative tested instances. This
data set has evaluated to know that a patient is diabetic or not.
Among of 9 original attributes of opted dataset different
feature selection method provide dissimilar condensed set of
feature as shown in figure 3.
Fig. 3. Assorted Features from Diabities Data set by Different Data Mining
Methods
Subsequent to feature assortment process each opted
classification algorithm has evaluates 5 times, each time with
the different feature set as elected by dissimilar feature
assortment procedure. At the end of evaluation procedure the
best performance of executed algorithm has measured for
comparison work. On the base of best accuracy rate the
proposed model elect two classification approaches along with
feature assortment procedure and build an ensemble
framework for enhance the accurateness of evaluation
procedure which improve the performance of decision support
system. Over diabetes dataset the best outcomes of each
classification method along with proposed approach has
illustrated in following figure 4.
Fig. 4. Act of Classical Data Mining Methods & Anticipated Hybrid
Algorithm with Assorted Features for Recognition of Diabetes
978-1-5386-4765-3/18/$31.00 ©2018 IEEE
Above figure evidently shown that proposed hybrid
framework has produced improved accuracy results in
assessment of other classical methods. The proposed
framework lively ensemble the features of Naïve Bayes and
Hoefdding tree in a layer form because in individual
assessment these two methods have outperformed in
comparison of decision tree, KStar and IBK classification
technique.
To ensure an effectiveness of proposed mechanism the
proposed approach has again evaluated with a different type of
data set. This time a labor dataset has opted which consists 57
instances with 17 attributes. Same as previous experiment
before starting the classification procedure a feature
assortment procedure has performed. The recommended
feature set of each method are illustrated in figure 5.
Fig. 5. Assorted Features from Labor Data set by Different Data Mining
Methods
Fig. 6. Act of Classical Data Mining Methods & Anticipated Hybrid
Algorithm with Assorted Features for Labor Verdict
The comparative value depicts in above figure 6 shows the
muscularity of proposed approach. Both of above experiment
have performed with dissimilar dataset but improve results of
proposed mechanism has shown that intended approach is
performed better in comparison of classical methods of data
mining.
For testing an additional effectiveness of proposed
approach over modern decision support model dissimilar
experiment has performed with the Australian credit data set
as used by Yoichi Hayashi [23]. This dataset consist 690
instances with 14 attributes. The instances are two types,
307positive and 383negative instances. The figure 7
489
 Proceedings of the International Conference on Communication and Electronics Systems (ICCES 2018)
IEEE Xplore Part Number:CFP18AWO-ART; ISBN:978-1-5386-4765-3
demonstrates the selected feature set by different feature
assortment method of data mining.
Fig. 7. Assorted Features from Australian Credit Data set
Same as above executed experiment all the opted
classification approaches has evaluated with each of assorted
feature set and collect the best performance of each algorithm
along with feature assorted method. At last proposed
mechanism lively opted the best two method whose have
outperformed in term of high accuracy and generate an
ensemble framework by combining the functionality of opted
methods in to a layer form. The result depicted in figure 8
evidently proof that proposed mechanism has produce more
accurate result in comparison or obtainable methods.
Fig. 8. Act of Classical Data Mining Methods & Anticipated Hybrid
Algorithm with Assorted Features for Australian Credit Data set
The evaluation outcomes of proposed approach at credit
risk data set of Australian has shown that proposed approach
is capable to produce more accurate statistics in comparison of
other evaluated algorithms. The above results evidently proves
that proposed approach is reliable and effective.
V. CONCLUSION
This paper intended an appropriate decision support model
for multi region. Based on a number of researchers'
experiences, the proposed model lively elect the most
appropriate group of classification and feature assortment
procedure for supplied dataset and pooled the opted method
functionality in to a layer format to enhance the level of
accuracy. The act of proposed model has examined with five
978-1-5386-4765-3/18/$31.00 ©2018 IEEE
different most popular classification algorithms over three
different type of dataset, Diabetes, Labor and credit risk of
Australia dataset. Each experiment outcomes shows that
proposed approach has enhance of prediction accuracy.
REFERENCES
[1] Shakiba Khademolqorani, Ali Zeinal Hamadani “An Adjusted Decision
Support System through Data Mining and Multiple Criteria Decision
Making” 2nd International Conference on Integrated Information,
Elsevier, Procedia - Social and Behavioral Sciences 73 ( 2013 ), pp. 388
– 395.
[2] R.Rupnik, M. Kukar “Decision Support System To Support Decision
Processes With Data Mining” Journal of information and organizational
sciences, Volume 31, Number 1 (2007), pp. 217-231.
[3] J. H. Heinrichs and J.S. Lim. Integrating Web-based Data Mining Tools
with Business Models for Knowledge Management. Decision Support
Systems, Vol. 35, No. 1, 2003, pp. 103-112.
[4] C. C. Kuan. Decision Support System for Tourism Development:
System Dynamics Approach. Journal of Computer Information Systems,
Vol. 45, No. 1, 2004, pp. 104-112.
[5] A. Patelis, K. Metaxiotis, K. Nikolopoulos and V. Assimakopoulos.
ForTV: Decision Support System for Forecasting Television
Viewership. Journal of Computer Information Systems, Vol. 46, No. 1,
2003, pp. 25-34.
[6] Emrana Kabir Hashi, Md. Shahid Uz Zaman and Md. Rokibul Hasan
“An Expert Clinical Decision Support System to Predict Disease Using
Classification Techniques” IEEE, International Conference on
Electrical, Computer and Communication Engineering (ECCE),
February 16-18, 2017, pp. 396-400.
[7] Li, J., Wei, L., Li, G., Xu, W.,An evolution strategy-based multiple
kernels multi-criteria programming approach: The case of credit
decision making, Decision support system, 2011, pp. 292-298.
[8] Lalit Dole, Jayant Rajurkar “A Decision Support System for Predicting
Student Performance” International Journal of Innovative Research in
Computer and Communication Engineering, Vol. 2, Issue 12, December
2014, pp.- 7232-7237.
[9] Veenita Kunwar, Khushboo Chandel, A. Sai Sabitha, Abhay Bansal
“Chronic Kidney Disease Analysis Using Data Mining Classification
Techniques” IEEE 6th International Conference - Cloud System and Big
Data Engineering (Confluence), 2016, pp.-300-305.
[10] Meryem Ouahilal, Mohammed El Mohajir, Mohamed chahhou, Badr
Eddine El Mohajir “A Comparative Study of Predictive Algorithms for
Business Analytics and Decision Support systems: Finance as a Case
Study” IEEE, International Conference on Information Technology for
Organizations Development (IT4OD) 2016.
[11] Yicheng Jiang,1 Bensheng Qiu,1 Chunsheng Xu, and Chuanfu Li “The
Research of Clinical Decision Support System Based on Three-Layer
Knowledge Base Model” Journal of Healthcare Engineering Volume
2017, Article ID 6535286, pp.- 1-8.
[12] Saeed Piri, Dursun Delen, Tieming Liu, Hamed M. Zolbanin, “A data
analytics approach to building a clinical decision support system for
diabetic retinopathy: Developing and deploying a model ensemble”
Elsevier journal, Decision Support Systems, 2017.
[13] Emrana Kabir Hashi, Md. Shahid Uz Zaman and Md. Rokibul Hasan
“An Expert Clinical Decision Support System to Predict Disease Using
Classification Techniques” IEEE International Conference on Electrical,
Computer and Communication Engineering (ECCE), February 16-18,
2017. pp.- 396-400.
[14] A. Iyer, S. Jeyalatha and R. Sumbaly, “Diagnosis of diabetes using
classification mining techniques,” Int. J. of Data M. & Know. Manag.
Process, IJDKP, United Arab Emirates, vol. 5, pp. 1-14, January 2015.
[15] Y. Hayashi and S. Yukita, “Rule extraction using Recursive-Rule
extraction algorithm with J48graft combined with sampling selection
techniques for the diagnosis of type 2 diabetes mellitus in the Pima
Indian dataset,” Informatics in Medicine Unlocked, ELSEVIER, Vol. 2,
pp. 92-104, 2016.
490
 Proceedings of the International Conference on Communication and Electronics Systems (ICCES 2018)
IEEE Xplore Part Number:CFP18AWO-ART; ISBN:978-1-5386-4765-3
[16] S. Sa’di, A. Maleki, R. Hashemi, Z. Panbechi and K. Chalabi.
“Comparison of data mining algorithms in the diagnosis of type II
diabetes,” Int. J. on Comput. Sci. & App., Vol. 5, pp.1-12, October
2015.
[17] G.Huang, K.Huang, T.Lee, J. Tzu-Ya and Weng, “An interpretable
rulebased diagnostic classification of diabetic nephropathy among type 2
diabetes patients,” Huang et al. BMC Bioinformatics, Vol. 16, pp.55-65,
2015.
[18] Yung-Fu Chen ,Chih-Sheng Lin,Kuo-An Wang, La Ode Abdul Rahman,
Dah-Jye Lee, Wei-Sheng Chung and Hsuan-Hung Lin “Design of a
Clinical Decision Support System for Fracture Prediction Using
Imbalanced Dataset” Hindawi Journal of Healthcare Engineering
Volume 2018, Article ID 9621640, 13 pages.
[19] M. Monadi, Y. Javadian, M. Cheraghi, B. Heidari, and M. Amiri,
“Impact of treatment with inhaled corticosteroids on bone mineral
density of patients with asthma: related with age,” Osteoporosis
International, vol. 26, no. 7. 2015, pp. 2013–2018.
978-1-5386-4765-3/18/$31.00 ©2018 IEEE
[20] Stanislaw Drosio and Stanislaw Stanek “Building a safe society
environment: a summary of hybrid approaches to crisis decision support
systems” Journal of Decision systems 2018, Vol. 2 7 , No. s1, pp.- 181–
190.
[21] Shakuntala Jatav1 and Vivek Sharma “An Algorithm For Predictive
Data Mining Approach In Medical Diagnosis” International Journal of
Computer Science & Information Technology (IJCSIT) Vol 10, No 1,
February 2018, pp.- 11-20.
[22] Mohamed Hamada and Mohammed Hassan “Artificial Neural Networks
and Particle Swarm Optimization Algorithms for Preference Prediction
in Multi-Criteria Recommender Systems” MDPI Journal Informatics
2018, pp.-1-16.
[23] Yoichi Hayashi “Application of a rule extraction algorithm family based
on the Re-RX algorithm to financial credit risk assessment from a Pareto
optimal perspective” Elsevier Operations Research Perspectives 3,
2016, pp.- 32–42.
491