Google ditches MapReduce for its own Cloud Dataflow

Analytics

by Amy-jo Crowley| 26 June 2014

The analytics service is based on Google’s own technologies Flume and MillWheel.

Google has replaced its MapReduce analytics service in favour of a cloud analytics system it has built called Cloud Dataflow.

MapReduce is based on the popular Apache Hadoop-based analytics platform and analyses data in batch mode, which allows companies to build their own big data application using low-cost hardware.

Cloud Dataflow, announced at Google's I/O keynote in San Francisco, is based on Google's own technologies, Flume and MillWheel, and does not have the same scaling restrictions of MapReduce.

The service, which is not yet available to developers, claims to allow companies to more easily build complex 'data pipelines', view trends and be alerted to insights in real-time.

Cloud Dataflow is expected to take on Amazon Web Services' Redshift, a datawarehouse service, and Elastic MapReduce, which uses Hadoop to crunch large datasets.

Other services announced on Google's cloud platform include Cloud Save, Cloud Debugging, Cloud Tracing, which provides latency statistics across different groups, and Cloud Monitoring.

Comments
Post a comment

Comments may be moderated for spam, obscenities or defamation.
Privcy Policy

We have updated our privacy policy. In the latest update it explains what cookies are and how we use them on our site. To learn more about cookies and their benefits, please view our privacy policy. Please be aware that parts of this site will not function correctly if you disable cookies. By continuing to use this site, you consent to our use of cookies in accordance with our privacy policy unless you have disabled them.