Академический Документы
Профессиональный Документы
Культура Документы
Big Data
A 2013 HorizonWatching Trend Report
HorizonWatching Community
Note: This presentation represents my thoughts and ideas.not those of my employer. Chamberlin, whchamb@gmail.com
- Bill
HorizonWatching Community
Big Data refers to how to collect, store, and manage information that comes into an enterprise so that it can be harvested for decision making
Big data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications. The challenges include capture, curation, storage, search, sharing, analysis, and visualization. Wikipedia (Big Data)
Every day, we create 2.5 quintillion bytes of data so much that 90% of the data in the world today has been created in the last two years alone. This data comes from everywhere: sensors used to gather climate information, posts to social media sites, digital pictures and videos, purchase transaction records, and cell phone GPS signals to name a few. This data is big data. IBM (Big Data)
3 January 17, 2013 Big Data: A 2013 HorizonWatching Trend Report 2013 HorizonWatching Creative Commons Attribution License
HorizonWatching Community
3. Analytics and Visualizaton: For those implementing Big Data, there will be an increased interest
in Analytics and Visualization capablities.
4. Data Scientists: There will be a rush to hire skilled Big Data Scientists, often via services like
Kaggle, who are specialist in designing how a firm collects, stores, and manages big data.
5. Increased Competition: IBM, EMC, SAP, SAS, and Oracle all increase competitive efforts, leading
to better solutions and services
6. Big Data as a Service: Service Providers emerge to handle the whole stack.
7. Data Protection: CIOs implement automated systems to handle all replication, deduplication,
backup, and restoration.
8. Followers Left in Dust: Organizations that do not implement Big Data solutions risk loosing their
competitive edge.
9. CMOs overwhelmed: CMOs are not prepared to handle all the big data. In 2013 marketing needs
to learn to work better with IT
10. Education and Training: Big Data Services firms will offer extensive training and certification
programs to try to help fill the shortages of skilled Data Scientists.
HorizonWatching Community
Like the Cloud term in 2008-9, everyone is trying to define exactly what Big Data is.
IDC defines Big Data technologies as a new generation of technologies and architectures designed to extract value economically from very large volumes of a wide variety of data by enabling high-velocity capture, discovery, and/or analysis. IDC (Big Data)
Big data in general is defined as high volume, velocity and variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making. Gartner (link)
Big data is the frontier of a firms ability to store, process, and access (SPA) all of the data it needs to operate effectively, make decisions, reduce risks, and create better customer experiences. Forrester Research (link)
HorizonWatching Community
Challenges
Different sources of data (enterprise apps, web, search, video, mobile, social conversations and sensors) Traditional relational databases / data warehouses not designed for new types of data Unstructured or semi-structured text is difficult to query. Culture, skills, and business processes
Most organizations are ill prepared to address both the technical and management challenges posed by big data; as a direct result, few will be able to effectively exploit this trend for competitive advantage. Gartner
(link)
Implications
Emerging capabilities to store and process vast quantities of structured and unstructured data are bringing about changes in technology and business landscapes Big data is driving need for advanced analytics and visualization capabilities to help organizations glean the insights and make decisions
6 January 17, 2013 Big Data: A 2013 HorizonWatching Trend Report 2013 HorizonWatching Creative Commons Attribution License
HorizonWatching Community
Growth in Jobs "By 2015, 4.4 million IT jobs globally will be created to support big data. Gartner (link)
7 January 17, 2013 Big Data: A 2013 HorizonWatching Trend Report 2013 HorizonWatching Creative Commons Attribution License
HorizonWatching Community
The Big Data trend presents a huge challenge (and opportunity) for Information Management professionals
A New Era of Information Management Clearly, the big data revolution is fostering a powerful new type of data science. Having more comprehensive data sets at our disposal will enable more fine-grained long-tail analysis, microsegmentation, next best action, customer experience optimization, and digital marketing applications
Forrester (link)
The volume, velocity and variety of data that is relevant to mainstream enterprise IT has grown to the point that it has pushed many applications to the limits of their capacity. Old application architecture principles can no longer satisfy the new business requirements.
Gartner (link)
HorizonWatching Community
Forrester: Big Data and Big Data Blog Posts Frost & Sullivan: Search for Big Data
HorizonWatching Community
10
HorizonWatching Community
11
HorizonWatching Community
12
HorizonWatching Community
Social Media
Blog: Big Data Hub Blog Twitter: @IBMbigdata and Twitter Hashtag: #bigdata Facebook: IBM-Big-Data LinkedIn: IBM big data YouTube: IBM Big Data Google+: IBM big data DeveloperWorks: Information Management Community
13 January 17, 2013 Big Data: A 2013 HorizonWatching Trend Report
HorizonWatching Community
HorizonWatching Community
15