mongodb - Mongo-Hadoop streaming -


i'm new mongodb , hadoop. i'm trying access mongodb data input hadoop mapreduce job. don't quite know how specify collection use data from. tried:

hadoop jar/usr/local/cellar/hadoop/2.6.0/libexec/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar  -input user/test/input/ -output user/test/output/ -inputformat com.mongodb.hadoop.mapred.mongoinputformat -outputformat com.mongodb.hadoop.mapred.mongooutputformat -io mongodb -d mongo.input.uri=mongodb://localhost/my_dbs.collectionname  -d stream.io.identifier.resolver.class=com.mongodb.hadoop.streaming.io.mongoidentifierresolver  -mapper /users/wordcountmapper.py  -reducer /users/wordcountreducer.py  -libjars /usr/local/cellar/hadoop/2.6.0/libexec/share/hadoop/tools/lib/mongo-hadoop-streaming.jar

but following error:

error streaming.streamjob: unrecognized option: -d usage: $hadoop_prefix/bin/hadoop jar hadoop-streaming.jar [options]

and when tried this, error:

 hadoop jar /usr/local/cellar/hadoop/2.6.0/libexec/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar  -input user/input/  -output user/test/output  -inputformat com.mongodb.hadoop.mapred.mongoinputformat  -outputformat com.mongodb.hadoop.mapred.mongooutputformat  -io mongodb -jobconf mongo.input.uri=mongodb://localhost/my_dbs.collectionname  -jobconf stream.io.identifier.resolver.class=com.mongodb.hadoop.streaming.io.mongoidentifierresolver  -mapper /users/wordcountmapper.py  -reducer /users/wordcountreducer.py  -libjars /usr/local/cellar/hadoop/2.6.0/libexec/share/hadoop/tools/lib/mongo-hadoop-streaming.jar  `error streaming.streamjob: unrecognized option: -libjars usage: $hadoop_prefix/bin/hadoop jar hadoop-streaming.jar [options]`

please help.

please check this link better idea on how connect mongodb hadoop.

edit:

or,

instead of giving jar -libjars option, can directly write in driver program as:

args.add("-libjars"); args.add("/some/path/to/your/jar");

-

Popular posts from this blog

html/hta mutiple file in audio player -

ok started coding .hta application , pretty html page .hta extension , adde mp3 player , did work <object data="test.mp3" type="audio/mp3" width="200" height="40"> <param name="src" value="test.mp3"> <param name="autostart" value="0"> </object> but it's 1 song playing again , again , plz there way add multiple files playlist believe it's should added "src" parameters not sure, i'm starting did add "," in between , , tried ";" none of them working i'm waiting answers :d i wanna know if can show me how become familiar tag see it's helpful , powerful activex, audio,video,pdf .... files i'm waiting impatiently [i don't know object, plz plz more clear] get inspired example hta_audio_player.hta <html> <head> <title>hackoo audio player playlist hackoo 2014</title> <hta:app...
Read more

debugging - Reference - What does this error mean in PHP? -

what this? this number of answers warnings, errors , notices might encounter while programming php , have no clue how fix. community wiki, invited participate in adding , maintaining list. why this? questions "headers sent" or "calling member of non-object" pop on stack overflow. root cause of questions same. answers questions typically repeat them , show op line change in his/her particular case. these answers not add value site because apply op's particular code. other users having same error can not read solution out of because localized. sad, because once understood root cause, fixing error trivial. hence, list tries explain solution in general way apply. what should here? if question has been marked duplicate of this, please find error message below , apply fix code. answers contain further links investigate in case shouldn't clear general answer alone. if want contribute, please add "favorite" error message, warning or notic...
Read more