Archivo de la etiqueta: Hadoop

Rank operator is at PIG! :’)

Ok, maybe it happened some time ago (one month?). But, I was bussy! Some good news after 2 months and a half of hard work, guided by Gianmarco De Francisci Morales, I don’t have words to thank him for his time … Sigue leyendo

Publicado en Hadoop, Pig | Etiquetado , , | Deja un comentario

Install s3cmd tools on OSX

After looking for a way to access to s3 bucket, I found this self-explanatory site of how to install s3cmd on OSX

Publicado en ec2 | Etiquetado , , | Deja un comentario

ERROR 4010: Cannot find hadoop configurations in classpath

Setting up pig for e2e tests isn’t a daily-work task, it requires patience and sometimes more patience. Let me first explain the situation: Hadoop 1.0.1-SNAPSHOT, Apache Pig version 0.10.0-SNAPSHOT (r1156275) and Pig version 0.8.1 (obviously, you need an old towards tests). One … Sigue leyendo

Publicado en Hadoop, Pig | Etiquetado , , , | Deja un comentario

ERROR 2999: Unexpected internal error. Failed to create DataStorage

After some days looking for how to solve this annoying exception: ERROR 2999: Unexpected internal error. Failed to create DataStorage I think that this is best solution (after all is on Apache-FAQ): Apache – FAQ – Q: What shall I do … Sigue leyendo

Publicado en Hadoop, Pig | Etiquetado , , , , | Deja un comentario

Hadoop can’t replicate to nodes

«org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:aavendan cause:java.io.IOException: File /usr/local/hadoop/tmp/hadoop-aavendan/mapred/system/jobtracker.info could only be replicated to 0 nodes, instead of 1» This exception was thrown twice during my tests, looks weird (because I´m working in a local node, so no reason!) After looking for around … Sigue leyendo

Publicado en Hadoop, Varios | Etiquetado , | Deja un comentario