MAHARISHI UNIVERSITY OF INFORMATION

TECHNOLOGY
NOIDA CAMPUS

ECONOMICS PROJECT

ON

BIG DATA ANALYTICS, BUSINESS

INTELLIGENCE TOOLS AND
APPLICATIONS

SUBMITTED BY – RITWIK SINHA

COURSE – B.TECH. COMPUTER AND DATA SCIENCE
SEMESTER – 05
ENROLLMENT NUMBER – MUIT0217050005
 INDEX
1. What is Big Data Analytics?
2. History of Big Data
3. Why BIG DATA?
4. What is different with BIG DATA today?
5. Descriptive and Predictive analytics
6. What is Business Intelligence?
7. Why use BUSINESS INTELLIGENCE tools?
8. Different BUSINESS INTELLIGENCE tools
9. BUSINESS INTELLIGENCE applications
10. BIG DATA ANALYTICS vs. BUSINESS INTELLIGENCE
11. BASOA: Big Data Analytics Services Oriented
Architecture
12. Conclusion
13. Future Planning
14. References
INTRODUCTION AND DEEP RESEARCH

What is Big Data Analytics?

The complex process of examining large and varied data sets, or big
data, to uncover information such as hidden patterns, unknown
correlations, market trends and customer preferences that can help
organizations make informed business decisions is known as BIG
DATA analytics.

History of Big Data

It was around 2005, Big Data, which had been used without a name,
was labelled by Roger Mougalas. He was referring to a large set of
data that, at the time, was almost impossible to manage and process
using the traditional business intelligence tools available.
Additionally, Hadoop, which could handle Big Data, was created in
2005. Hadoop was based on an open-sourced software framework
called Nutch, and was merged with Google’s MapReduce. Hadoop is
an Open Source software framework, and can process structured and
unstructured data, from almost all digital sources. Because of this
flexibility, Hadoop (and its sibling frameworks) can process Big Data.
In the past few years, there has been a massive increase in Big Data
start-ups, all trying to deal with Big Data and helping organizations to
understand Big Data and more and more companies are slowly
adopting and moving towards Big Data. However, while it looks like
Big Data is around for a long time already, in fact Big Data is as far as
the internet was in 1993. The large Big Data revolution is still ahead
of us so a lot will change in the coming years.

Why BIG DATA?

In 2011 the McKinsey report on Big Data: The next frontier for
innovation, competition, and productivity, states that in 2018 the
USA alone will face a shortage of 140.000 – 190.000 data scientist as
well as 1.5 million data managers.

In a study conducted by IDC, the Market Intelligence firm estimated

that the global production of data would would grow 10x between
2015 and 2020.

With the astronomical growth in collectible data, it soon became

evident that traditional data technologies such as data warehouses
and relational databases were not well-suited to operate with the
influx of unstructured data. The early Big Data innovation projects
were open-sourced under the Apache Software Foundation, with
most significant contributions coming from the likes of Google,
Yahoo, Facebook, IBM, academia, and others.
Moreover, we have entered into a new era where new challenges
are evolving like “variety” of open source technologies, Machine
Learning use cases, and the rapid development across the big data
ecosystem. These have added new challenges around how to keep
up with the ever-growing information, while balancing how to
ensure the effectiveness of advanced analytics in such a noisy
environment.

What is different with BIG DATA today?

As data grows exponentially, enterprises need to continuously scale

their infrastructure to maximize the economic value of the data. In
the early years of Big Data (roughly 2008), when Hadoop was first
getting recognition by larger enterprises, it was extremely expensive
and inefficient to stand up a useful production system. Using Big
Data also meant that there needed to be the right people and
software technology, as well as hardware to handle the data and
velocity of queries coming in. Aligning everything to operate
synchronously was an extremely daunting task, and caused many Big
Data projects to fail.

By 2013, the notion of the enterprise cloud for analytics was

becoming popularized by Amazon Web Services (AWS) and a few
number of other Silicon Valley companies (VMWare, Microsoft, and
IBM) started emerging with their take of enterprise solutions for
companies to take advantage of leveraging cloud computing. It
wasn’t until AWS announced their earnings in 2015 of nearly $5
billion in revenue for the year, which the world truly started to take
notice.
The cloud has shaped into a market-changer today as businesses,
large and tiny, can have instantaneous access to infrastructure and
advanced technologies with a few clicks. This allows the Data Admin
and DevOps teams to be the enabler of the entire platform
operation, and no longer a bottle neck. Back to the earlier comment
on the 4 V’s of big data, this is where cloud provides a great
infrastructure to enable companies to grow beyond their existing
systems:

1. Volume – information is growing and data has an expiration

date with value, having cheap cloud storage enables companies
to take on massive amounts of data without worrying about
what is and isn’t valuable.

2. Variety – demand for analysing on unstructured data is

growing, which is driving the need different frameworks such
as Deep Learning in order to process. Ephemeral cloud
computing servers allow companies to test different big data
engines against the same data iteratively.

3. Velocity – complexity of analytics problems require several

steps of big data (e.g. Machine Learning is estimated to be
~80% ETL in compute resources), which cloud computing
companies can scale up/down according to demand.
 4. Value – demand for AI driven applications is pushing demand
for modern big data
architectures, which
allow applications,
storage and compute
resources each to be
scaled out individually.

Descriptive and
Predictive analytics

Descriptive Analytics:-
Descriptive Analytics will help an organization to know what has
happened in the past, it would give you the past analytics using the
data that are stored. For a company, it is necessary to know the past
events that help them to make decisions based on the statistics using
historical data. For example, you might want to know how much
money you lost due to fraud and many more.

Predictive Analytics:-
Predictive Analytics will help an organization to know what might
happen next, it predicts future based on present data available. It
will analyse the data and provide statements that have not
happened yet. It makes all kinds of predictions that you want to
know and all predictions are probabilistic in nature.

.Descriptive Analytics uses Data Aggregation and Data Mining

techniques to give you a knowledge about past but Predictive
Analytics uses Statistical analysis and Forecast techniques to know
the future.
.Descriptive Analytics is used when you need to analyse and explain
different aspects of your organization whereas Predictive Analytics is
used when you need to know anything about the future and fill the
information that you do not know.
.Reports generated by Descriptive analysis are accurate but the
reports generated by Predictive analysis are not 100% accurate it
may or may not happen in future.

What is Business Intelligence?

Business intelligence comprise the strategies and technologies used

by enterprises for the data analysis of business information. BI
technologies provide historical, current and predictive views of
business operations.
Further, the term Business Intelligence (BI) refers to technologies,
applications and practices for the collection, integration, analysis,
and presentation of business information. The purpose of Business
Intelligence is to support better business decision making.

Why use BUSINESS INTELLIGENCE tools?

Business intelligence tools are all about helping you understand

trends and deriving insights from your data so that you can make
tactical and strategic business decisions. BI tools can help businesses
of all shapes and sizes make sense of complex, big data and drive
profits!
 First off, data discovery, which used to be limited to the expertise of
advanced analytics specialists, is now something everyone can do
using BI tools. And not only that, these tools give you the insights you
need to achieve things like growth, resolve issues that are urgent,
collect all your data in one place, forecast future outcomes and so
much more.

In fact, many SMB businesses are hopping on the BI bandwagon,

especially as the prevalence of big data continues to rise. In fact,
according to BetterBuys, this market is so popular that it is predicted
to grow to $20 billion by 2019.

Different BUSINESS INTELLIGENCE tools

1. SAP Business Intelligence

SAP Business Intelligence offers several advanced analytics

solutions including real-time BI predictive analytics, machine
learning, and planning & analysis. The Business Intelligence
platform in particular, offers reporting & analysis, data
visualisation & analytics applications, office integration and
mobile analytics. SAP is a robust software intended for all roles
(IT, end uses and management) and offers tons of
functionalities in one platform.

2. MicroStrategy

MicroStrategy is a business intelligence tool that offers

powerful (and high speed) dashboarding and data analytics
 which help monitor trend, recognise new opportunities,
improve productivity and more. Users can connect to one or
various sources, whether the incoming data is from a
spreadsheet, cloud-based or enterprise data software. It can be
accessed from your desktop or via mobile.

3. Sisense

Not really tech-savvy? Then the Sisense business intelligence

tool might be for you. This user-friendly tool allows anyone
within your organisation to manage large and complex datasets
as well as analyse and visualise this data without your IT
department getting involved. It lets you bring together data
from a wide variety of sources as well including Adwords,
Google Analytics and Salesforce. Not to mention, because it
uses in-chip technology, data is processed quite quickly
compared to other tools.

4. SAS Business Intelligence

While SAS’ most popular offering is its advanced predictive

analytics, it also provides a great business intelligence platform.
It is self-service tool that allows to leverage data and metrics to
make informed decisions about their business. Using their set
of APIs, you are provided with lots of customisation options,
and SAS ensures high-level data integration and advanced
analytics & reporting.

5. Yellowfin BI
 Yellowfin BI is a business intelligence tool and ‘end-to-end’
analytics platform that combines visualisation, machine
learning, and collaboration. You can also easily filter through
tons of data with intuitive filtering (e.g. checkboxes and radio
buttons) as well open up dashboards just about anywhere
(thanks to this tool’s flexibility in accessibility (mobile,
webpage, etc.).

6. Dundas BI

Dundas BI is a flexible, browser-based business intelligence tool

that lets users connect to many data sources in real-time. It
offers great visualisations in charts, tables and graphs that are
customisable and can be viewed from both desktops and
mobile devices. Users can also build their own reports and drill-
down and certain performance metrics for analysis. Dundas
provides support to companies of all different sizes and across
various industries.

7. TIBCO Spotfire

TIBCO Spotfire is a self-service business intelligence tool that

offers executive dashboards, data visualisation, analytics and
KPI push to mobile devices. This tool is great for collaborating
with your digital team as users can define their own KPIs and
send alerts to both iPhones and Androids. TIBCO Spotfire can
be integrated with many CRMs, ERPs, and of course Excel and
Access.

8. Systum
 Systum is a Business Intelligence tool that helps organisations
streamline and consolidate processes across multiple B2B and
B2C channels so that they can boost productivity as well as
efficiency. It includes a number of sales features, built-in CRM,
Inventory Management, a B2B portal and more. Systum also
offers a wide range of integration options with – among others
– Amazon, eBay, and Quickbooks.

9. Microsoft Power BI

Microsoft Power BI is a web-based business analytics tool suite

which excels in data visualisation. It allows users to identify
trends in real-time and has brand new connectors that allow
you to up your game in campaigns. Because it’s web-based,
Microsoft Power BI can be accessed from pretty much
anywhere. This software also allows users to integrate their
apps and deliver reports and real-time dashboards.

10. Tableau

Tableau is a Business Intelligence software for data discovery

and data visualisation. With the software you can easily
analyse, visualise and share data, without IT having to
intervene. Tableau supports multiple data sources such as MS
Excel, Oracle, MS SQL, Google Analytics and SalesForce.
Tableau is free for personal use. However, if you want more,
the price can go up quickly. But of course, this will give you
something in return: well-designed dashboards that are very
easy to use. Additionally Tableau also offers three standalone
products: Tableau Desktop (for anyone) and Tableau Server
 (analytics for organisations), which can be run locally and
Tableau Online (hosted analytics for organisations).

11. Oracle BI

Oracle BI is an enterprise portfolio of technology and

applications for business intelligence. This technology gives
users pretty much all BI capabilities, such as dashboards,
proactive intelligence, alerts, ad hoc, and more.

BUSINESS INTELLIGENCE applications

The key general categories of business intelligence applications are:

 Spreadsheets
 Reporting and querying software
 Online analytical processing (OLAP)
 Digital dashboards
 Data mining
 Business activity monitoring
 Data warehouse

BIG DATA ANALYTICS vs. BUSINESS INTELLIGENCE

Business Intelligence is often times referred to as the first two

descriptive and diagnostic stages of 4 steps to big data. BI is often
hosted in a data warehouse where data is very structured in nature
and only explains “what, where, and how” something happened (for
example: 10 of the same shoes were purchased from 3 different
stores that ran the same promotion, while the other 2 stores sold no
shoes). This data is often used in reporting and gathering insights
into popularity trends and interactions based on recent events.

Big Data Analytics takes this a step further, as the technology can
access a variety of both structured and unstructured datasets (such
as user behaviour or images). Big data analytics tools can bring this
data together with the historical information to determine what the
probability of an event were to happen based on past experiences.
BASOA: Big Data Analytics Services Oriented
Architecture

In BASOA, big data analytics service provider, big data analytics

service requestor, big data analytics service broker are three main
players.
Big data analytics service provider include analytics developers,
analytics vendors, analytics systems or software and other
intermediaries.
Big data analytics service requestor, include organizations,
governments and all level business decision makers such as CEO, CIO
and CFO as well as managers, etc.
Big data analytics service broker includes all the entities that
facilitate the development of big data analytics services, which
include popular presses etc.

BASOA is an architecture for supporting business decision making

with big data analytics services. The theory of big data analytics
providers, brokers and requestors of the BASOA can facilitate the
understanding and development of BI and business decision making.
E.g., from a deep analysis of the BASOA, an enterprise and its CEO
can know who are the best big data analytics providers and brokers
in order to improve his business, market performance, and
competition.
 CONCLUSION

The availability of Big Data, low-cost commodity hardware,

and new information management and analytic software
have produced a unique moment in the history of data
analysis. The convergence of these trends means that we
have the capabilities required to analyse astonishing data
sets quickly and cost-effectively for the first time in history.
These capabilities are neither theoretical nor trivial. They
represent a genuine leap forward and a clear opportunity to
realize enormous gains in terms of efficiency, productivity,
revenue, and profitability.

The Age of Big Data is here, and these are truly revolutionary
times if both business and technology professionals continue
to work together and deliver on the promise.
 FUTURE PLANNING

1. Explore big data analytics and its applications in e-

commerce and cloud services, and realize BASOA using
intelligent agents’ technology.

2. Look at some implementation related issues for

developing BASOA based e-commerce systems such as
how to collect, store, and process big data – by whom,
for what, access rights, and many more.

REFERENCES

1. datafloq.com
2. dataversity.net
3. qubole.com
4. educba.com
5. olap.com
6. mopinion.com
7. oreilly.com