Big Data/Analytics Zone is brought to you in partnership with:

Ben Kepes is an analyst, and entrepreneur, an commentator, and a business adviser. His interests include a diverse range of industries from manufacturing to property technology. As a commentator he has a broad presence both in the traditional media and as an extensive blogger. He sits on the boards of a number of organizations, both commercial and not-for-profit. Ben is a DZone MVB and is not an employee of DZone and has posted 197 posts at DZone. You can read more from them at their website. View Full User Profile

On Organizations’ Real Requirements Around Big Data

12.16.2012
| 2559 views |
  • submit to reddit

Every time another vendor takes the “big data” moniker and applies it to some legacy system a cat somewhere on the internet dies. Like “cloud” a couple of years ago, big data has become the term de jour – and vendors seem to think that simply using it will give them some magic power to up their revenues, their margins and their count of unicorns and rainbows. Yeah, in case you didn’t realize, the overuse of the term makes me cringe.

But that doesn’t mean that big data isn’t a valid concept per se. We live in a world where the amount of information is increasing rapidly. Where the number of individual devices connected to the net is exponentially rising. where organizations want to make some sense of the world around them – all reasons where big data can help.

So it was interesting to see the results of a survey that GigaSpaces commissioned into the use of big data in industry, and the pressing drivers for this use. The survey that GigaSpaces did was of 243 IT executives and developers spanning a bunch of different industries. Obviously 243 is a small number, and no doubt the survey pool was skewed somewhat by the focus, network and perspective of GigaSpaces, but as a general snapshot, it’s informative. So, some interesting statistics:

  • 80% say big data processing is “mission critical”
  • 70% have a need to process big data in real time
  • 80% are planning to move their big data processing to the cloud

So – what does this all mean?

MyPOV

Like I said, big data provides a real opportunity for organizations to make smarter decisions in a more rapid manner. But to get over the line in terms of selling projects within an enterprise – big data initiatives really can’t require a significant investment in kit. They also can’t create a drain on existing hardware. A move to cloud processing is therefore a natural step. At the same time, there is little point in assessing big data after the fact – the goal of big data is to be able to react to trends near instantaneously.

It’s interesting that the past couple of weeks have seen some interesting announcements from both AWS and HP about big data analysis initiatives that deliver on both these trends – likely a sign of things to come. Big data is going to be an important industry shift over the next few years – but users need to have products that allow it to harness big data insights rapidly and outside of their existing technology kit – this survey reiterates that fact.

Published at DZone with permission of Ben Kepes, author and DZone MVB. (source)

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)