Big Data/Analytics Zone is brought to you in partnership with:

Eric is living in Chapel Hill, NC. By night, he writes and edits science fiction. On weekends, he spends too much time making plumbers hop on things. Eric has posted 249 posts at DZone. You can read more from them at their website. View Full User Profile

Nathan Marz's "Lambda Architecture" Approach to Big Data

01.04.2013
| 8260 views |
  • submit to reddit

Over at Database Tutorials and Videos, you can read a fascinating excerpt of Nathan Marz's Big Data (partially available now in an early-access edition from Manning). The article covers Marz's innovative new big data methodology that he calls "lambda architecture":

Computing arbitrary functions on an arbitrary dataset in real time is a daunting problem. There is no single tool that provides a complete solution. Instead, you have to use a variety of tools and techniques to build a complete Big Data system.


The lambda architecture solves the problem of computing arbitrary functions on arbitrary data in real time by decomposing the problem into three layers: the batch layer, the serving layer, and the speed layer.

The full article is available at Database Tutorials and Videos and is well worth the read.

Published at DZone with permission of its author, Eric Gregory.

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)