ROLE OF DATA WAREHOUSING & DATA MINING IN E-GOVERNANCE

Vaibhav Panwar
Ass Pr!" & H#a$ MCA D#%
Insi&# !" Mana'#(#n S&$i#s D#hra$&n
E(ai)*%anwar+vaibhav,'(ai)+-!(
A.STRACT
E-governance is the application of information & communication technologies to
transform the efficiency, effectiveness, transparency and accountability of
informational & transactional exchanges with in government, between govt. & govt.
agencies of National, State, Municipal & ocal levels, citi!en & businesses, and to
empower citi!ens through access & use of information. "overnments deal with
large amount of data. #o ensure that such data is put to an effective use in
facilitating decision-ma$ing, a data warehouse is constructed over the historical
data. %t permits several types of &ueries re&uiring complex analysis on data to be
addressed by decision-ma$ers.
#his 'aper deals with scope and use of data warehousing & (ata mining in all the
dimensions of e-governance li$e G!v#rn(#n ! Cii/#n 0G1C2 Cii/#n !
G!v#rn(#n 0C1G2 G!v#rn(#n ! '!v#rn(#n 0G1G2 G!v#rn(#n !
.&sin#ss 3G!v#rn(#n ! NGO 0G1N2+#heir are many methodology used to
increase the efficiency of E-governance .#hree complimentary trends are Daa
war#h!&sin'3 OLAP 3Daa (inin'+ )y using these techni&ue we find that data
warehousing is very helpful in analy!ing *urrent & +istorical data finding useful
pattern & support decision strategies .,-' is useful in solving complex &ueries &
views , interactive online analysis of data ..sing (ata mining techni&ue &
algorithm, automatic discovery of pattern & other interesting trends are find out
4#5w!r$s/ E-governance, ,-' ,(ata warehousing, (ata Mining
6 + INTRODUCTION
E-governance involves the application of %nformation and *ommunication #echnologies
by government agencies for information and service delivery to citi!ens, business and
government employees. %t is an emerging field, faced with various implementation
problems related to technology, employees, flexibility and change related issues, to
mention a few. "lobal shifts towards increased deployment of %# infrastructure by
governments emerged with the advent of the 0orld 0ide 0eb. 0ith the increase in
%nternet and mobile connections, the citi!ens are learning to exploit their new mode of
access in wide ranging ways. #hey have started expecting more and more information
and services online from governments and corporate organi!ations to enhance their civic,
professional and personal lives .#he concept of e-governance come into existence in
%ndia during the seventies with a focus on development of government applications in the
areas of defense, economic monitoring, planning and the inclusion of %nformation
#echnology to manage data intensive functions related to elections, census, tax
1
administration etc. #he role & efforts made by National %nformatics *enter 2N%*3 to
connect all the district head&uarters during the eighties was a very new innovative
approach .
4rom the early nineties, %# technologies were supplemented by %*# technologies to
extend its use for wider applications with policy implementation & emphasis on
reaching out to rural areas and ta$ing in greater inputs from N",s and private sector.
#here has been an increase involvement of international agencies under the framewor$ of
e-governance for development to cataly!e the development of e-governance laws and
technologies in developing countries. 4or governments, the motivation to shift from
manual processes to %#-enabled processes may be increased efficiency in administration
and service delivery, but this shift can be conceived as a worthwhile investment with
potential for returns.
E-governance is the process of service delivery and information dissemination to citi!ens
using electronic means providing the following benefits over the conventional system
5 %ncreased efficiency in various "overnmental processes
5 #ransparency and anticorruption in all transactions
5 Empowerment of citi!ens and encouragement of their participation in governance.
#he main ob6ective of E-"overnance is to change organi!ation into e-organi!ation. -n e-
organi!ation needs to focus on the following things/-

develop customer orientation
manage customer relationships
streamline business processes
communicate better
organi!e information
wor$ more flexibly
ma$e better decisions.
coordinate activities better

1+ NEED FOR E-GOVERNANCE
1+6 Pr# -!n$ii!ns !" E-G!v#rnan-#
Some of the pre conditions for an effective e-governance that could be listed as
4ormulation of new set of cyber laws to replace traditional set of rule &
regulations for effective replacement of e-governance
Simplification of procedure, rationali!ation of various administrative processes
restructuring of government and mindset of bureaucrats to adopt according to e-
governance.
(e-layering or re-layering of decision-ma$ing of levels
Security and privacy are the two ma6or concerns
7
1+1 Fa-!r n#-#ssar5 "!r s&--#ss"&) #-'!v#rnan-#
'olitical commitment
Effective administrative leadership
Effective handling of +8 issues
%nvolvement of staff at design stage
%nnovative funding strategy and revenue model
-ppropriate administrative structure
*ommon infrastructure and database creation
#raining & Motivation
7+ IMPLEMENTATION ISSUE IN E-GOVERNANCE
#he government of %ndia, li$e all over the world, has began investing large amounts in
%nformation and *ommunication #echnology2%*#3.#he ob6ect behind these investment is
to improve the efficiency of government function by, especially enabling citi!en centric
services. #here are some technical issue which need to be discussed apart from above
mentioned issue. #he -bove mentioned issue can be resolved by the government but as
far as technical issue are concerned they need more focus to resolve the issue.
Some of technical issue related to e-governance are
#echnical %nfrastructure support by the government
*ollection of arge amount of data
-nalysis of the data So that accurate (ecision can be made
,nline Support to all department of "overnment organi!ation
8etrieval of meaningful (ata
'resentation of meaningful data so fast decision can be made
E-governance ,meaning the electronic-governance ,has evolved as an information age
model of governance that see$s to reali!e process and structure for harshening the
potentialities of information & communication technologies at various level of
government and public sector .E-governance is the commitment to utili!e appropriate
technologies to enhance governmental relationships in order to encourage the fair &
efficient delivery of services .#he %*# model uses the new technologies to maintain the
data in government organi!ation .Some of these are discussed in this paper which is very
popular technologies now a days .
%ncreasingly, government organi!ation, are analy!ing current and historic data to identify
useful patterns from the large database so that they can support their business strategy
#heir main emphasis is on complex, interactive, exploratory analysis of very large dataset
created by the integration of data from across all the part of the organi!ation and that data
is fairly static #hree complementary trends are their
13 (ata warehouse
73 ,-'
93 (ata Mining
9
8+ ROLE OF DATA WARE HOUSE IN E-GOVERNANCE
8+6 N##$ "!r $aa war#h!&s#
"overnments deal with enormous amount of data. %n order that such data is put to an
effective use in facilitating decision-ma$ing, a data warehouse is constructed over the
historical data. %t permits several types of &ueries re&uiring complex analysis on data to
be addressed by decision-ma$ers.
0hen used properly, it can help planners and decision ma$ers in ma$ing informed
decisions leading to positive impact on targeted group of citi!ens. +owever to use
information to it:s fullest potential, the planners and decision ma$ers need instant access
to relevant data in a properly summari!ed form. %n spite of ta$ing lots of initiative for
computeri!ation, the "overnment decision ma$ers are currently having difficulty in
obtaining meaningful information in a timely manner because they have to re&uest and
depend on %# staff for ma$ing special reports which often ta$es long time to generate. -n
%nformation 0arehouse can deliver strategic intelligence to the decision ma$ers and
provide an insight into the overall situation. #his greatly facilitates decision-ma$ers in
ta$ing micro level decisions in a timely manner without the need to depend on their %#
staff. )y organi!ing person and land-related data into a meaningful %nformation
0arehouse, the "overnment decision ma$ers can be empowered with a flexible tool that
enables them to ma$e informed policy decisions for citi!en facilitation and accessing
their impact over the intended section of the population.
8+1 .#n#"i !" a $aa war#h!&s# "!r #-'!v#rnan-#
*iti!en facilitation is the core ob6ective of any "overnment body. 4or facilitating the
citi!ens of a state or a country, it is important to have the right information about the
people and the places of the concerned territory. +ence a data warehouse built for
e"overnance can typically have data related to person and land. Such a data warehouse
can be beneficial to both the "overnment decision ma$ers and citi!ens as well in the
following manner/
8+1+6 .#n#"i "!r h# $#-isi!n (a9#rs
They do not have to deal with the heterogeneous and sporadic information generated by
various state-level computerization projects as they can access current data with a high
granularity from the information warehouse.
#hey can ta$e micro-level decisions in a timely manner without the need
to depend on their %# staff.
#hey can obtain easily decipherable and comprehensive information
without the need to use sophisticated tools.
#hey can perform extensive analysis of stored data to provide answers to
the exhaustive &ueries to the administrative cadre. #his helps them to
formulate more effective strategies and policies for citi!en facilitation
;
8+1+1 .#n#"i "!r h# -ii/#ns
#hey are the ultimate beneficiaries of the new policies formulated by the
decision ma$ers and policy planner:s extensive analysis on person and
land-related data.
#hey can view fre&uently as$ed &ueries whose results will already be
there in the database and will be immediately shown to the user saving the
time re&uired for processing.
#hey can have easy access to the "overnment policies of the state.
#he web access to %nformation 0arehouse enables them to access the
public domain data from anywhere.
#he data warehouse has enough potential to access the impact of various welfare schemes
across the population of the state. #he planners can design schemes focused on specific
target groups and achieve high impact. #he decision-ma$ers can carry out analysis of
population profile across the state in areas of economy, education, family units, shelter,
etc. #he warehouse can also be used for rural and urban development planning,
agricultural yield and cropping pattern analysis and much more. #hese analyses will help
in ma$ing decisions that are focused and the benefit of the government policies can reach
the intended group. The various types and number of queries that can be handled by the data
warehouse are limited only by the intelligence of the person using the data warehouse and the data fed to
it.
:+ ROLE OF DATA MINING IN E-GOVERNANCE
%t is well $nown that in %nformation #echnology 2%#3 driven society, $nowledge is one of
the most significant assets of any organi!ation. #he role of %# in E-governance is well
established. <nowledge 'ragmatic use of (atabase systems, (ata 0arehousing and
<nowledge Management technologies can contribute a lot to decision support systems in
E-governance. <nowledge discovery in databases is well-defined process consisting of
several distinct steps. (ata mining is the core step, which results in the discovery of
hidden but useful $nowledge from massive databases. - formal definition of <nowledge
discovery in databases is given as /=(ata mining is the non trivial extraction of implicit
previously un$nown and potentially useful information about data>. (ata mining
technology provides a user- oriented approach to novel and hidden patterns in the data.
#he discovered $nowledge can be used by the E-governance administrators to improve
the &uality of service. #raditionally, decision ma$ing in E-governance is based on the
ground information, lessons learnt in the past resources and funds constraints. +owever,
data mining techni&ues and $nowledge management technology can be applied to create
$nowledge rich environment. -n organi!ation may implement <nowledge (iscovery in
databases 2<((3 with the help of a s$illed employee who has good understanding of
organi!ation. <(( can be effective at wor$ing with large volume of data to determine
meaningful pattern and to develop strategic solutions. -nalyst and policy ma$ers can
learn lessons from the use of <(( in other industries E-governance data is massive. %t
includes centric data, resource management data and transformed data. E-governance
organi!ations must have ability to analy!e data. #reatment records of millions of patients
can be stored and computeri!ed and data mining techni&ues may help in answering
several important and critical &uestions related to organi!ation .
?
:+1 4n!w)#$'# Dis-!v#r5 in E-'!v#rnan-#
(ata mining is an essential step of $nowledge discovery. %n recent years it has attracted
great deal of interest in %nformation industry. <nowledge discovery process consists of an
iterative se&uence of data cleaning, data integration, data selection, data mining pattern
recognition and $nowledge presentation. %n particulars, data mining may accomplish
class description, association, classification, clustering, prediction and time series
analysis. (ata mining in contrast to traditional data analysis is discovery driven. (ata
mining is a young interdisciplinary field closely connected to data warehousing, statistics,
machine learning, neural networ$s and inductive logic programming. (ata mining
provides automatic pattern recognition and attempts to uncover patterns in data that are
difficult to detect with traditional statistical methods. 0ithout data mining it is difficult to
reali!e the full potential of data collected within healthcare organi!ation as data under
analysis is massive, highly dimensional, distributed and uncertain.
Daa Minin' C5-)#
4or "overment organi!ation to succeed they must have the ability to capture, store and
analy!e data ,nline analytical processing 2,-'3 provides one way for data to be
analy!ed in a multi-dimensional capacity. 0ith the adoption of data warehousing and
data analysis@,-' tools, an organi!ation can ma$e strides in leveraging data for better
decision ma$ing. Many organi!ations struggle with the utili!ation of data collected
through an organi!ation online transaction processing 2,#'3 system that is not
integrated for decision ma$ing and pattern analysis. 4or successful E-governance
organi!ation it is important to empower the management and staff with data warehousing
based on critical thin$ing and $nowledge management tools for strategic decision
ma$ing. (ata warehousing can be supported by decision support tools such as data mart,
,-' and data mining tools. - data mart is a subset of data warehouse. %t focuses on
selected sub6ects. ,nline analytical processing 2,-'3 solution provides a multi-
I$#ni"5 h#
Pr!b)#( in h#
'!v#rn(#n
E(%)!5 !" Daa
Minin' #-hni;&#
! #<ra-
4n!w)#$'#
Ana)5/# h#
$is-!v#r#$
4n!w)#$'#
M#as&r#
#""#-iv#n#ss !"
$is-!v#r#$
9n!w)#$'#
A
dimensional view of the data found in relational databases. 0ith stored data in two
dimensional format ,-' ma$es it possible to analy!e potentially large amount of data
with very fast response times and provides the ability for users to go through the data and
drill down or roll up through various dimensions as defined by the data structure.#he
traditional manual data analysis has become insufficient and methods for efficient
computer assisted analysis indispensable. - (ata 0arehouse is a semantically consistent
data store that serves as a physical implementation of a decision support data model and
stores the information on which an enterprise needs to ma$e strategic decisions. - data
warehouse is also often viewed as architecture constructed by integrating data from
multiple heterogeneous sources to support structured and@or ad-hoc &ueries, analytical
reporting and decision ma$ing
:+7 Daa Minin' #-hni;&# in E-'!v#rnan-#
#here are various data mining techni&ues available with their suitability dependent on the
domain application. Statistics provide a strong fundamental bac$ground for &uantification
and evaluation of results. +owever, algorithms based on statistics need to be modified
and measured before they are applied to data mining

:+8 CLASSIFICATION OF DATA MINING TECHNI=UE
Some of the data mining techni&ue we discuss as they are very useful in e-
governance organi!ation
:+8+6 R&)# In$&-i!n
8ule induction/ is the process of extracting useful Bif thenC rules from data based on
statistical significance. - 8ule based system constructs a set of if-then-rules. <nowledge
represents has the form %4 conditions #+EN conclusion #his $ind of rule consists of two
parts. #he rule antecedent 2the %4 part3 contains one or more conditions about value of
predictor attributes where as the rule conse&uent 2#+EN part3 contains a prediction about
the value of a goal attribute. -n accurate prediction of the value of a goal attribute will
improve decision-ma$ing process. %4-#+EN prediction rules are very popular in
data miningD they represent discovered $nowledge at a high level of abstraction.
8ule %nduction Method has the potential to use retrieved cases for predictions.
:+8+1 D#-isi!n r##
%t is a $nowledge representation structure consisting of nodes and branches organi!ed in
the form of a tree such that, every internal non-leaf node is labeled with values of the
attributes. #he branches coming out from an internal node are labeled with values of the
attributes in that node. Every node is labeled with a class 2a value of the goal attribute3.
#ree based models which include classification and regression trees, are the common
implementation of induction modeling. (ecision tree models are best suited for data
mining. #hey are in expensive to construct, easy to interpret, easy to integrate with
database system and they have comparable or better accuracy in many applications.
#here are many (ecision tree algorithms such as +.N#S algorithm
2this is one of the earliest algorithm3, *-8#, %(9, *;.?
CONCLUSION
E
- large number of e-"overnance applications are already in operation in most of the
states and at the centre. #he necessary (0M infrastructure has been created at the head-
&uarter and sufficient number of officials have been trained on (0M. #his is the right
time for introducing (0M in the e-"overnance arena and to further strengthen the e-
"overnance system .,nce the desired results are achieved, the same can be replicated in
other sectors of the government.
REFERENCES
1. Ester M., 0ittmann 8./ F%ncremental "enerali!ation for Mining in a (ata
0arehousing EnvironmentF, 'roc. Ath %nt. *onf. on Extending (atabase
#echnology, Galencia, Spain, 1HHI, in/ ecture Notes in *omputer Science, Gol.
19EE, Springer, 1HHI, pp. 19?-1?7.
7. 4ayyad .., 'iatets$y-Shapiro "., and Smyth './ F<nowledge (iscovery and (ata
Mining/ #owards a .nifying 4ramewor$F, 'roc. 7nd %nt. *onf. on <nowledge
(iscovery and (ata Mining, 'ortland, ,8, 1HHA, pp. I7-II.
9. "ueting 8. +./ F-n %ntroduction to Spatial (atabase SystemsF, #he G()
Journal, Gol. 9, No. ;, ,ctober 1HH;, pp. 9?E-9HH.
;. +an J., *ai K., *ercone N./ F(ata-driven (iscovery of Luantitative 8ules in
8elational (atabasesF, %EEE #ransactions on <nowledge and (ata Engineering,
Gol.?, No. 1, 1HH9, pp. 7H-;M.
?. <aufman ., 8ousseeuw '. J./ F4inding "roups in (ata/ -n %ntroduction to
*luster -nalysisF, John 0iley & Sons, 1HHM.
A. Mumic$ %. S., Luass (., Mumic$ ). S./ FMaintenance of (ata *ubes and
Summary #ables in a 0arehouseF, 'roc. -*M S%"M,( %nt. *onf. on
Management of (ata, 1HHE, pp. 1MM-111.
E. Ng 8. #., +an J./ FEfficient and Effective *lustering Methods for (ata MiningF,
'roc. 7Mth %nt. *onf. on Gery arge (ata )ases, Santiago, *hile, 1HH;, pp. 1;;-
155.
I