-
Notifications
You must be signed in to change notification settings - Fork 0
/
palyer_select_job_run_log.txt
64 lines (64 loc) · 5.39 KB
/
palyer_select_job_run_log.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
17/12/31 19:54:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/12/31 19:54:45 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
17/12/31 19:54:45 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
17/12/31 19:54:45 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
17/12/31 19:54:45 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
17/12/31 19:54:45 INFO input.FileInputFormat: Total input paths to process : 1
17/12/31 19:54:45 INFO mapred.JobClient: Running job: job_local1770719442_0001
17/12/31 19:54:45 INFO mapred.LocalJobRunner: OutputCommitter set in config null
17/12/31 19:54:45 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
17/12/31 19:54:45 INFO mapred.LocalJobRunner: Waiting for map tasks
17/12/31 19:54:45 INFO mapred.LocalJobRunner: Starting task: attempt_local1770719442_0001_m_000000_0
17/12/31 19:54:45 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
17/12/31 19:54:45 INFO util.ProcessTree: setsid exited with exit code 0
17/12/31 19:54:45 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4331d29e
17/12/31 19:54:45 INFO mapred.MapTask: Processing split: file:/home/cloudera/workspace/playercount/player.txt:0+11601
17/12/31 19:54:45 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
17/12/31 19:54:45 INFO mapred.MapTask: io.sort.mb = 100
17/12/31 19:54:45 INFO mapred.MapTask: data buffer = 79691776/99614720
17/12/31 19:54:45 INFO mapred.MapTask: record buffer = 262144/327680
17/12/31 19:54:45 INFO mapred.LocalJobRunner:
17/12/31 19:54:45 INFO mapred.MapTask: Starting flush of map output
17/12/31 19:54:45 INFO mapred.MapTask: Finished spill 0
17/12/31 19:54:45 INFO mapred.Task: Task:attempt_local1770719442_0001_m_000000_0 is done. And is in the process of commiting
17/12/31 19:54:45 INFO mapred.LocalJobRunner:
17/12/31 19:54:45 INFO mapred.Task: Task 'attempt_local1770719442_0001_m_000000_0' done.
17/12/31 19:54:45 INFO mapred.LocalJobRunner: Finishing task: attempt_local1770719442_0001_m_000000_0
17/12/31 19:54:45 INFO mapred.LocalJobRunner: Map task executor complete.
17/12/31 19:54:45 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
17/12/31 19:54:45 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3726b44d
17/12/31 19:54:45 INFO mapred.LocalJobRunner:
17/12/31 19:54:45 INFO mapred.Merger: Merging 1 sorted segments
17/12/31 19:54:45 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 1308 bytes
17/12/31 19:54:45 INFO mapred.LocalJobRunner:
17/12/31 19:54:45 INFO mapred.Task: Task:attempt_local1770719442_0001_r_000000_0 is done. And is in the process of commiting
17/12/31 19:54:45 INFO mapred.LocalJobRunner:
17/12/31 19:54:45 INFO mapred.Task: Task attempt_local1770719442_0001_r_000000_0 is allowed to commit now
17/12/31 19:54:45 INFO output.FileOutputCommitter: Saved output of task 'attempt_local1770719442_0001_r_000000_0' to /home/cloudera/workspace/playercount/output2
17/12/31 19:54:45 INFO mapred.LocalJobRunner: reduce > reduce
17/12/31 19:54:45 INFO mapred.Task: Task 'attempt_local1770719442_0001_r_000000_0' done.
17/12/31 19:54:46 INFO mapred.JobClient: map 100% reduce 100%
17/12/31 19:54:46 INFO mapred.JobClient: Job complete: job_local1770719442_0001
17/12/31 19:54:46 INFO mapred.JobClient: Counters: 20
17/12/31 19:54:46 INFO mapred.JobClient: File System Counters
17/12/31 19:54:46 INFO mapred.JobClient: FILE: Number of bytes read=24860
17/12/31 19:54:46 INFO mapred.JobClient: FILE: Number of bytes written=282545
17/12/31 19:54:46 INFO mapred.JobClient: FILE: Number of read operations=0
17/12/31 19:54:46 INFO mapred.JobClient: FILE: Number of large read operations=0
17/12/31 19:54:46 INFO mapred.JobClient: FILE: Number of write operations=0
17/12/31 19:54:46 INFO mapred.JobClient: Map-Reduce Framework
17/12/31 19:54:46 INFO mapred.JobClient: Map input records=136
17/12/31 19:54:46 INFO mapred.JobClient: Map output records=45
17/12/31 19:54:46 INFO mapred.JobClient: Map output bytes=1216
17/12/31 19:54:46 INFO mapred.JobClient: Input split bytes=117
17/12/31 19:54:46 INFO mapred.JobClient: Combine input records=45
17/12/31 19:54:46 INFO mapred.JobClient: Combine output records=45
17/12/31 19:54:46 INFO mapred.JobClient: Reduce input groups=45
17/12/31 19:54:46 INFO mapred.JobClient: Reduce shuffle bytes=0
17/12/31 19:54:46 INFO mapred.JobClient: Reduce input records=45
17/12/31 19:54:46 INFO mapred.JobClient: Reduce output records=45
17/12/31 19:54:46 INFO mapred.JobClient: Spilled Records=90
17/12/31 19:54:46 INFO mapred.JobClient: CPU time spent (ms)=0
17/12/31 19:54:46 INFO mapred.JobClient: Physical memory (bytes) snapshot=0
17/12/31 19:54:46 INFO mapred.JobClient: Virtual memory (bytes) snapshot=0
17/12/31 19:54:46 INFO mapred.JobClient: Total committed heap usage (bytes)=447741952