12 August 2009, 08:40

Amazon Clouds speak Pig Latin

Amazon has announced that it's Amazon Elastic MapReduce service, an implementation of Google's MapReduce algorithm based on Hadoop, now supports the Pig Latin programming language. Pig Latin is described as an "SQL-like transformation language" that allows developers to run complex processes on compute clusters without having to learn how to work directly with MapReduce and dealing with the associated complexity of decomposing a problem so that it can work with MapReduce.

Pig Latin, like Hadoop, has been developed under the Apache Software Foundation and was originally developed by Yahoo. The hope is that Pig Latin with a Hadoop cluster will simplify running computational tasks with large peta-byte range data sets, by allowing developers to work in an interactive shell to manipulate the distributed data and processing. When a Pig Latin program has been refined it can then be executed, and re-run in future, in batch mode. Hadoop is an open source implementation of Google's MapReduce algorithm and is used by Amazon, AOL, FaceBook and Yahoo among others. Both Hadoop and Pig Latin are available under the Apache Licence 2.0.

(djwm)

« previous | next »

Print Version | Send by email | Permalink: http://h-online.com/-742909