4 Barriers Stand Between You and Big Data Insight Thor Olavsrud, CIO April 09, 2013 Over

the past three years or so, the buzz around big data has continued to grow. While some dismiss it as so much hype, businesses around the world are taking notice: In its recently released 5th annual Digital IQ Survey, consulting firm PwC found that 62 percent of respondents believe big data can give them a competitive advantage.But believing in the power of big data is one thing; leveraging big data for actionable insights is another. PwC also found that 58 percent of respondents agree that moving from data to insight is a major challenge. "The amount of information and data that we're collecting now is truly enormous in terms of the volume that is outside the four walls of the organization," says Anand Rao, principal at PwC. "Organizations don't have the right people, they don't have the right structure in place and they're still struggling with some of the tools and techniques." PwC surveyed 1,108 respondents from 12 countries and across a variety of industries. The respondents were evenly divided between IT and business leaders, and more than 75 percent worked in organizations with revenues of more than $1 billion. PwC found that organizations struggle with four major big data barriers:

1. They're blind to the importance of visualization. 2. They're investing more in gathering data than analyzing it. 3. They're facing a talent gap. 4. They're struggling with insufficient systems to rapidly process information.

Businesses Blind to the Importance of Visualization When it comes to actually deriving insight from the trove of data at most organizations' disposal, visualization is fundamental. Visualization helps put data into context and bring business cases to life. In many cases, advanced visualization capabilities allow organizations to glean insights that would be

impossible otherwise. For instance, due to archaic records and inaccurate information, most utilities have no idea where all of their underground assets are located, resulting in all-too-common service interruptions for residents when a power line is accidently cut or a water line bursts. To avoid these problems, the City of Las Vegas took advantage of smart data to develop a living model of its utilities network. VTN Consulting helped the city aggregate data from various sources into a single real-time 3D model created with Autodesk technology. The model includes both above and below ground utilities, and is being used to visualize the location and performance of critical assets located under the city. And yet, only 26 percent of global survey respondents are using data visualization. But the picture is very different when you focus in on top performing companiesthose respondents that reported revenue growth of greater than five percent and whose companies are in the top quartile for revenue, profitability and innovation. Those organizations lead the pack in terms of plans to invest more in data visualization in 2013. "The kind of visualization that most people are moving toward is having dashboards of information where you can zoom in or zoom outeasily digestible to the business user," says Rao. "It's more hindsight analysis, basically backward looking. Most organizations are getting that. But now that we understand what happened or did not happen based on actions we took, we want to look into the future. That requires visualization that is much more dynamic."

Investing More in Gathering Data than Analyzing It Companies are investing significant amounts in gathering data, Rao and Halter say, but perhaps not enough to integrate, merge and analyze it: 32 percent of organizations have invested more than $1 million in gathering, storing and retrieving internal data, but only 26 percent have invested more than $1 million in analysis of internal data. Rao and Halter say respondents from the financial services, insurance and healthcare industries appear to be investing the most in data integration, and one-third of top performers likewise are investing more than $1 million in integrating third-party data. Organizations may be hoarding data without analyzing it because IT and the business are locked into old ways of working with data.

"The traditional model of how business and IT work together traditionally no longer works in this field," says Oliver Halter, principal at PwC. "Business and IT always have had difficulties talking to each other. Traditionally, business creates requirements and IT executes. In the world of exploring data, that doesn't work so well anymore. The knee-jerk reaction of IT is, 'We're going to collect data and manage it, and you guys figure out what to do with that.'" But the sophisticated analysis required to glean meaning from big data is often beyond business users. "Those things are complicated and your typical business user doesn't know about it," Halter says. "I think what we're looking for is a new organizational approach, which means new talent and new ways of exploring that data."

They're Facing a Talent Gap And that leads to the third big data barrier: the talent gap. As Rao and Halter note, it's no secret that companies often lack talent in the skills necessary to interpret big data. Only 44 percent of PwC's survey respondents said they have a sufficient pipeline of talent to undertake deep analysis of data, though top performers were more likely to feel they have a sufficient talent pipeline. But Rao and Halter say that companies often overlook their existing talent: individuals in marketing analysis, actuarial groups and pricing/product development. These individuals can serve as a great starting point for talent to translate data into insight. "Organizations that have been successful early have created new organizational models," Halter says. "They've created centers of excellence where business and IT come together. I have worked with clients where we literally created entirely new structures on the side of the IT organization. The teams have to be much more nimble, much more agile." "The business person needs to understand more about data analytics, visualization, all of that," adds Rao. "You need someone who understands the business, can translate the business from a problem into a solution. They have to understand enough about analytics to know that this type of problem requires that type of solution or analytics technique. If you can't find a single person, a team approach could work."

Struggling With Insufficient Systems to Rapidly Process Information The fourth big data barrier is existing systems. Rao and Halter note that big

data demands increased computing power to rapidly gather, store and analyze massive volumes of data. But many organizations doubt their ability to do so with their current systems. Forty-one percent of respondents in the Americas, 33 percent of respondents in Europe and 49 percent of respondents in Asia-Pacific said their systems can't process large volumes of data from different sources. Even top performers mostly aligned with the pack with regard to confidence in their processing power. But Rao and Halter say they believe that organizations often struggle with this issue because they're looking at the entirety of the data available to them rather than focusing on a particular problem. "When companies don't have a hypothesis or problem in hand that they want to solve, that's when they a big data overload," Rao says. "There's all this information out there and they don't know what to do with it. If you approach it from a perspective of a particular problem like, 'I'm trying to grow a market with this specific segment,' it becomes much clearer. Most organizations are just overwhelmed with all the information available rather than focusing just on the problem that has to be solved." That's also the best way to get a rapid return on investment to a big data problem, Rao says. "The best way to get your ROI is to home in on a couple of key questions," he says. "Get a group of people solely focused on that." Halter adds that there is one thing that the companies most successful in leveraging big data have in common. "The companies that achieve success, there's one thing that unites them," he says. "All of them out there ahead of the curve have a very senior executive that for whatever reason saw the potential early and just rammed it through the organization." "I think big data is becoming more and more an umbrella message," he adds. "It's not just big data, it's data everywhere. It's how do you use data big and small to get ahead of the curve. There's no way out of it. It's not just large files and Hadoop; it's really about changing your culture to a more analytical culture." Thor Olavsrud covers IT Security, Big Data, Open Source, Microsoft Tools and Servers for CIO.com. Follow Thor on Twitter @ThorOlavsrud. Follow everything from CIO.com on Twitter @CIOonline,Facebook, Google + and LinkedIn. Email Thor at tolavsrud@cio.com