Story image

Gartner: Big Data is pregnant with analytics

25 Jun 2015

We are at the interesting point: big data time is over. It is now big data analytics time.

Many organiszations are at the point when they have figured out how to get data in Hadoop (or other big data stores), but not — how to get the data out and derive value from it. These companies are becoming increasingly nervous under the pressure of rapidly growing amounts of unprocessed data (a.k.a. WRITE ONLY data that nobody will ever read).

The convergence of cloud, mobility and social computing that started several years ago culminated now in the first truly widespread big data analytics use case — the Internet of Things, IoT. Companies in very different industries — insurance, oil and gas, healthcare, transportation and agriculture among many others — are deploying sensors and collecting data, generated by them.

The rise of data lakes reflects the nature of the current point in time. Data lakes signify uncertainty, when organizations want to store more and more data generated with enormous speed, hoping to make sense of this data someday. Companies need a conventional name for a data storage that allows them to keep their options open for future analysis — this is a data lake. The more data is in the lake, the harder it is to separate the signal from the noise. The signal is there, among a myriad of other signals, go fish.

Analytics is the way out of the data lakes, it will help to find value in big data stores. However, analytics is now different: it is not just a clever tool for analysis, but also the whole architecture to put data in the analytic-ready form. And remember, it is big data analytics — different solutions and algorithms are required at scale.

Moore’s law is still hard at work: for example, server memory is measured now in terabytes compared to gigabytes two years ago, so clusters of severs can keep tens of terabytes in memory — this paves the road to fast in-memory analytics. Apache Spark — a fast, in-memory processing and analytical framework — came to focus at the right time, in the right place: it is leading the shift from big data storage to big data analysis.

In early 2014, I wrote in a blog post, “The rocket ship of big data analytics is launched and on its way to orbit.” Happy to report: the rocket ship of big data analytics reached orbit!

By Svetlana Sicular, Gartner

ECI unveils new SD-WAN solution
"Digital transformation is top of mind for much of the C-suite, which is combatting increasingly complex operations with the need to streamline costs."
Connectivity in an age where the application is king
If you want to turn your organisation into a digital enterprise, you need to transform the edge, because that's where all the applications are delivered closest to the user.
BitTitan expands cloud offerings in China to meet Office 365 growth
“With so much growth in China’s cloud-computing market, we are delighted to be expanding our product offerings."
Data center growth sees new leader for Vertiv Singapore
Singapore is witnessing unprecedented growth in data center and colocation industries, fueled by the rapid pace of digital technology.
Server Technology beats out competition at DCS Awards
Server Technology has taken out the top spot for the Data Centre PDU Innovation of the Year at the DCS Awards.
Container survey shows adoption accelerating while security concerns remain top of mind
The report features insights from over 500 IT professionals.
LogRhythm releases cloud-based SIEM solution
LogRhythm Cloud provides the same feature set and user experience as its on-prem experience.
IGEL & ControlUp bring analytics to endpoints everywhere
The strategic partnership allows IGEL to integrate with ControlUp’s real-time monitoring and analytics capabilities via the IGEL Universal Management Suite (UMS).