首页 > 为啥我的hadoop streaming 无法执行reduce任务?

为啥我的hadoop streaming 无法执行reduce任务?

RT。显示结果如下:
[gabriel@alienware bin]$ ./hadoop jar ../contrib/streaming/hadoop-streaming-1.1.2.jar -input input -output output -mapper /bin/cat -reducer usr/bin/wc
packageJobJar: [/tmp/hadoop-gabriel/hadoop-unjar7679007167852267598/] [] /tmp/streamjob5343206746589744583.jar tmpDir=null
13/04/03 15:20:45 INFO util.NativeCodeLoader: Loaded the native-hadoop library
13/04/03 15:20:45 WARN snappy.LoadSnappy: Snappy native library not loaded
13/04/03 15:20:45 INFO mapred.FileInputFormat: Total input paths to process : 2
13/04/03 15:20:45 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-gabriel/mapred/local]
13/04/03 15:20:45 INFO streaming.StreamJob: Running job: job_201304030301_0015
13/04/03 15:20:45 INFO streaming.StreamJob: To kill this job, run:
13/04/03 15:20:45 INFO streaming.StreamJob: /home/gabriel/software/hadoop-1.1.2/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:9001 -kill job_201304030301_0015
13/04/03 15:20:45 INFO streaming.StreamJob: Tracking URL: http://localhost.localdomain:50030/jobdetails.jsp?jobid=job_201304030301_0015
13/04/03 15:20:46 INFO streaming.StreamJob: map 0% reduce 0%
13/04/03 15:20:50 INFO streaming.StreamJob: map 33% reduce 0%
13/04/03 15:20:51 INFO streaming.StreamJob: map 67% reduce 0%
13/04/03 15:20:52 INFO streaming.StreamJob: map 100% reduce 0%

就一直卡在这里,不动了,是reduce的设置有问题么?另外日志怎么看呢?


[gabriel@alienware bin]$ ./hadoop jar ../contrib/streaming/hadoop-streaming-1.1.2.jar -input input -output output -mapper /bin/cat -reducer usr/bin/wc

"usr/bin/wc" 前面少打了一个"/"?

【热门文章】
【热门文章】