资源说明:已经测试过workcount例子程序!
[hadoop@test Desktop]$ hadoop jar wordcount.jar \
> /user/hadoop/input/file* /user/hadoop/output
18/05/25 19:51:32 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
18/05/25 19:51:32 INFO mapreduce.JobSubmissionFiles: Permissions on staging directory /tmp/hadoop-yarn/staging/hadoop/.staging are incorrect: rwxrwxrwx. Fixing permissions to correct value rwx------
18/05/25 19:51:34 INFO input.FileInputFormat: Total input paths to process : 3
18/05/25 19:51:35 INFO mapreduce.JobSubmitter: number of splits:3
18/05/25 19:51:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1527248744555_0001
18/05/25 19:51:36 INFO impl.YarnClientImpl: Submitted application application_1527248744555_0001
18/05/25 19:51:36 INFO mapreduce.Job: The url to track the job: http://test:8088/proxy/application_1527248744555_0001/
18/05/25 19:51:36 INFO mapreduce.Job: Running job: job_1527248744555_0001
18/05/25 19:51:49 INFO mapreduce.Job: Job job_1527248744555_0001 running in uber mode : false
18/05/25 19:51:49 INFO mapreduce.Job: map 0% reduce 0%
18/05/25 19:52:20 INFO mapreduce.Job: map 100% reduce 0%
18/05/25 19:52:29 INFO mapreduce.Job: map 100% reduce 100%
18/05/25 19:52:31 INFO mapreduce.Job: Job job_1527248744555_0001 completed successfully
18/05/25 19:52:32 INFO mapreduce.Job: Counters: 49
File System Counters
FILE: Number of bytes read=186
FILE: Number of bytes written=491001
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=471
HDFS: Number of bytes written=40
HDFS: Number of read operations=12
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=3
Launched reduce tasks=1
Data-local map tasks=3
Total time spent by all maps in occupied slots (ms)=86763
Total time spent by all reduces in occupied slots (ms)=5836
Total time spent by all map tasks (ms)=86763
Total time spent by all reduce tasks (ms)=5836
Total vcore-milliseconds taken by all map tasks=86763
Total vcore-milliseconds taken by all reduce tasks=5836
Total megabyte-milliseconds taken by all map tasks=88845312
Total megabyte-milliseconds taken by all reduce tasks=5976064
Map-Reduce Framework
Map input records=6
Map output records=24
Map output bytes=225
Map output materialized bytes=198
Input split bytes=342
Combine input records=24
Combine output records=15
Reduce input groups=5
Reduce shuffle bytes=198
Reduce input records=15
Reduce output records=5
Spilled Records=30
Shuffled Maps =3
Failed Shuffles=0
Merged Map outputs=3
GC time elapsed (ms)=647
CPU time spent (ms)=4390
Physical memory (bytes) snapshot=893743104
Virtual memory (bytes) snapshot=8465371136
Total committed heap usage (bytes)=659030016
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=129
File Output Format Counters
Bytes Written=40
本源码包内暂不包含可直接显示的源代码文件,请下载源码包。