Big Data/BI Zone is brought to you in partnership with:

Eric is a Content Curator with DZone, living in Chapel Hill, NC. By night, he writes and edits science fiction. On weekends, he spends too much time making plumbers hop on things. Eric is a DZone MVB and is not an employee of DZone and has posted 212 posts at DZone. You can read more from them at their website. View Full User Profile

BigQuery Gets 'Big JOIN' and More New Features

03.21.2013
| 2074 views |
  • submit to reddit

Google recently announced some major new features for its BigQuery analytics tool, including SQL-esque join and aggregate functionality, native TIMESTAMP support, and an expanded web UI. The "Big JOIN" feature is probably the headline addition here, coming in response to developer demand. According to Google:

Our new Big JOIN feature gives users the ability to produce a result set by merging data from two large tables by a common key. Big JOIN simplifies data analysis that would otherwise require a data transformation step, by allowing users to specify JOIN operations using SQL.

Popular web applications produce user activity logs that can grow by billions of rows each week. Dividing users into smaller groups is a key step for analysis. However, each group of users can number in the millions. To handle this for such large volumes, we've enabled Big Group Aggregations, which significantly increases the number of distinct values that can be grouped in a result set.

To use these new features, simply add the EACH modifier to JOIN or GROUP BY clauses.

You can find out more at the Google Developers blog.