News

Gartner: Big Data Deployments Going Slow

A serious shortage of workers in big data is predicted for the future as well.

Big data is becoming a big deal for developers, as witnessed by the rise of Hadoop among other technologies.

That jibes with a survey conducted this summer by Gartner Inc., which found high interest in big data among organizations.

Per the June survey, 64 percent of respondents said their organizations were investing in, or planning to invest in, the sort of technologies that are used for big data analyses, up from 58 percent in Gartner's 2012 survey. The June survey drew its data from 720 members of Gartner's Research Circle around the world.

However, few organizations are actually carrying it out with big data deployments. Less than eight percent deployed those technologies, according to Gartner's survey.

"For big data, 2013 is the year of experimentation and early deployment," said Frank Buytendijk, research vice president at Gartner, in a released statement. "Adoption is still at the early stages with less than eight percent of all respondents indicating their organization has deployed big data solutions. Twenty percent are piloting and experimenting, 18 percent are developing a strategy, 19 percent are knowledge gathering, while the remainder has no plans or don't know."

Organizations indicated that they plan to use big data techniques to improve customer experiences (55 percent) or address process efficiencies (49 percent). The industries that typically use big data include "media and communications, banking, and services," according to Gartner's announcement.

Gartner found that organizations are still trying to figure out the value of big data. In last year's survey, respondents were challenged by "governance issues."

In a July Webcast, "Information 2020: Big Data and Beyond," Buytendijk noted that "85 percent of organizations will not get out of big data what they hoped to get out of it." He described big data as a new way of analyzing and storing data vs. the traditional world of using relational databases and data warehouses, although he argued for the benefits of both approaches.

Big data depends on "the three V's," which are variety, velocity and volume, Buytendijk said. He added that the information infrastructure for this big data approach will get better in three years or so, but it's based on the reusability of data. The big data style focuses on the immediate use of data, Hadoop, tool proliferation and hackathons. The next step is to figure out the outcome for the data.

Buytendijk suggested that organizations should try experimenting with big data at this point. He said that information can be considered as an asset that can contribute to the top and bottom lines of an organization. However, he warned that organizations should not "cross the creepy line" by violating customer privacy. On the creepy side, he noted that retailer Target infamously tracked a 16-year-old girl with pregnancy ads. Another example is GPS service provider TomTom, which collected automobile traffic reports from its users that had the potential to be used by police to track speeders.

Big data is expected to generate jobs, but there's a shortage of personnel for it.

"By 2015, big data demand will reach 4.4 million jobs globally, but only one third of those jobs will be filled," Buytendijk said.

Gartner has published a new report on the topic this month. It plans to talk more about big data at its ITxpo event next month.

About the Author

Kurt Mackie is senior news producer for 1105 Media's Converge360 group.

comments powered by Disqus

Featured

  • AI for GitHub Collaboration? Maybe Not So Much

    No doubt GitHub Copilot has been a boon for developers, but AI might not be the best tool for collaboration, according to developers weighing in on a recent social media post from the GitHub team.

  • Visual Studio 2022 Getting VS Code 'Command Palette' Equivalent

    As any Visual Studio Code user knows, the editor's command palette is a powerful tool for getting things done quickly, without having to navigate through menus and dialogs. Now, we learn how an equivalent is coming for Microsoft's flagship Visual Studio IDE, invoked by the same familiar Ctrl+Shift+P keyboard shortcut.

  • .NET 9 Preview 3: 'I've Been Waiting 9 Years for This API!'

    Microsoft's third preview of .NET 9 sees a lot of minor tweaks and fixes with no earth-shaking new functionality, but little things can be important to individual developers.

  • Data Anomaly Detection Using a Neural Autoencoder with C#

    Dr. James McCaffrey of Microsoft Research tackles the process of examining a set of source data to find data items that are different in some way from the majority of the source items.

  • What's New for Python, Java in Visual Studio Code

    Microsoft announced March 2024 updates to its Python and Java extensions for Visual Studio Code, the open source-based, cross-platform code editor that has repeatedly been named the No. 1 tool in major development surveys.

Subscribe on YouTube