Three day of Mapping and Reducing…

I am spending today, tomorrow, and Friday at the University of Washington at an NSF-funded workshop on how to use Hadoop to write map-reduce computations.

I already know map-reduce of course but it’s interesting to get some hands-on experience on Hadoop. Fun!

6 responses to “Three day of Mapping and Reducing…”

  1. SteveL

    Have fun, but avoid looking at the internals too much, as they are, well, messy. But dont worry…I have plans there.

  2. Well, i am not really interacting with Hadoop. We are using the IBM plugin for eclipse so evreything is automated.

    Still… not very impressed with the experience but it’s nice to fire Eclipse again (even though I lost >30mins trying to figure out that the exception I was getting related to the fact that eclipse doesn’t support 64bit Java).

    Oh fun!

  3. Yeah, it is easier to use Hadoop from the command line than the eclipse plugin, in my opinion. It was nice to meet you there, Savas. It sounds like the UW cluster that Aaron is using for that workshop has very limited access for the command line.

  4. Great to meet you too Owen. You are doing awesome stuff with Hadoop! congrats.

    I am sorry I left before the end of the day today. I hope we meet soon again.

    cheers,

    .savas.

  5. Arijit

    Hi Savas

    How did you find Hadoop? Actually I’m working on this one right now – played around with some examples and it indeed seems interesting. I’m curious to know which IBM MR plugin did you use? The one on the IBM site seems to work with Hadoop 0.7.2 to 0.12.x (https://www.alphaworks.ibm.com/tech/mapreducetools/requirements). Has there been any updates on this?

    Cheers

    Arijit

  6. Arijit

    Hi Savas

    Not sure if you’re online. I’ve a question about this Hadoop eclipse plugin – can’t put the entire question here, but here’s the link – http://tinyurl.com/6qvk8j. I’m trying to follow it up with the forum, but haven’t received any answer yet. As you’ve recently used the plugin, I thought you might be able to help. Can you please send me an email regarding this one?

    Hope all’s well with you…

    Cheers

    Arijit