Cascading Tube

Posted by & filed under java.

Usage example of Cascading Tube EXAMPLE I Step 0 is pure cascading flow example Cascading. Step 0. Short description of method: it takes logs from one source and produces tree different reports public FlowDef flow(Tap pv, Tap trans, Tap transToFirstSource, Tap transToLastSource, Tap transDistributedAmongSources) { // agregation Pipe transPipe = new Each(“trans”, new Fields(“t_quantity”, “t_itemCost”),… Read more »

so little time…

Posted by & filed under java.

And so many ideas. I have found an interesting reading nathanmarz.com. I was just seeking some hadoop related solution and found that guy. Looks interesting, so I will follow his twitts for a while. I use feedly instead of google reader, I hate it on my mobile when it comes to run it first time… Read more »

Wrażenia po Hadoop in Spotify

Posted by & filed under hadoop.

Wczoraj byłem z Jarkiem na spotkaniu w Wawie pt. Hadoop in Spotify. Fajny klaster 190 nodów a wkrótce 690 – impressive. Było kilka rzeczy dla których warto było się tam wybrać m.in projekty-narzędzia z jakich korzystają i z których my moglibyśmy: 1. https://github.com/spotify/snakebite – szybka komunikacja z hdfs (wzgledem wolnej “hdfs dfs -ls /”) 2…. Read more »