23:43:13,506 INFO myScheduler-1 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:43:13,533 INFO Test worker context.TestContextManager - @TestExecutionListeners is not present for class [class org.springframework.data.hadoop.mapreduce.StreamingTest]: using defaults.
23:43:13,534 INFO Test worker xml.XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [org/springframework/data/hadoop/streaming/basic.xml]
23:43:13,526 ERROR myScheduler-1 security.UserGroupInformation - PriviledgedActionException as:trisberg (auth:SIMPLE) cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://sandbox:8020/ide-test/runner/output-4 already exists
23:43:13,536 WARN myScheduler-1 mapreduce.JobRunner - Cannot start job [custom-jar-job]
org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://sandbox:8020/ide-test/runner/output-4 already exists
at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:146)
at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:441)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:340)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)
at org.springframework.data.hadoop.mapreduce.JobExecutor$2.run(JobExecutor.java:201)
at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:48)
at org.springframework.data.hadoop.mapreduce.JobExecutor.startJobs(JobExecutor.java:172)
at org.springframework.data.hadoop.mapreduce.JobExecutor.startJobs(JobExecutor.java:164)
at org.springframework.data.hadoop.mapreduce.JobRunner.call(JobRunner.java:52)
at org.springframework.data.hadoop.mapreduce.JobRunner.call(JobRunner.java:33)
at org.springframework.data.hadoop.mapreduce.JobRunner.invoke(JobRunner.java:88)
at org.springframework.data.hadoop.mapreduce.JobRunner.call(JobRunner.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:273)
at org.springframework.scheduling.support.MethodInvokingRunnable.run(MethodInvokingRunnable.java:65)
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:51)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
23:43:13,542 ERROR myScheduler-1 support.MethodInvokingRunnable - Invocation of method 'call' on target class [class org.springframework.data.hadoop.mapreduce.JobRunner] failed
java.lang.IllegalStateException: org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://sandbox:8020/ide-test/runner/output-4 already exists
at org.springframework.data.hadoop.mapreduce.JobExecutor$2.run(JobExecutor.java:213)
at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:48)
at org.springframework.data.hadoop.mapreduce.JobExecutor.startJobs(JobExecutor.java:172)
at org.springframework.data.hadoop.mapreduce.JobExecutor.startJobs(JobExecutor.java:164)
at org.springframework.data.hadoop.mapreduce.JobRunner.call(JobRunner.java:52)
at org.springframework.data.hadoop.mapreduce.JobRunner.call(JobRunner.java:33)
at org.springframework.data.hadoop.mapreduce.JobRunner.invoke(JobRunner.java:88)
at org.springframework.data.hadoop.mapreduce.JobRunner.call(JobRunner.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:273)
at org.springframework.scheduling.support.MethodInvokingRunnable.run(MethodInvokingRunnable.java:65)
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:51)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://sandbox:8020/ide-test/runner/output-4 already exists
at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:146)
at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:441)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:340)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)
at org.springframework.data.hadoop.mapreduce.JobExecutor$2.run(JobExecutor.java:201)
... 21 more
23:43:13,669 INFO Test worker xml.XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [org/springframework/data/hadoop/hadoop-ctx.xml]
23:43:13,685 INFO Test worker support.GenericApplicationContext - Refreshing org.springframework.context.support.GenericApplicationContext@2095e01b: startup date [Wed Sep 25 23:43:13 EDT 2013]; root of context hierarchy
23:43:13,716 INFO Test worker config.PropertyPlaceholderConfigurer - Loading properties file from class path resource [test.properties]
23:43:13,717 INFO Test worker annotation.AutowiredAnnotationBeanPostProcessor - JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
23:43:13,718 INFO Test worker support.DefaultListableBeanFactory - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@14eca35e: defining beans [ppc,hadoopFs,hadoopResourceLoader,hadoopConfiguration,cfg-init,fs-init,rl-init,org.springframework.data.hadoop.scripting.HdfsScriptRunner#0,vanilla-stream-job,ns-stream-job,props,org.springframework.context.annotation.internalConfigurationAnnotationProcessor,org.springframework.context.annotation.internalAutowiredAnnotationProcessor,org.springframework.context.annotation.internalRequiredAnnotationProcessor,org.springframework.context.annotation.internalCommonAnnotationProcessor]; root of factory hierarchy
23:43:13,741 WARN Test worker conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
23:43:13,764 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:43:13,801 INFO Test worker config.PropertiesFactoryBean - Loading properties file from class path resource [props.properties]
23:43:13,802 INFO Test worker config.PropertiesFactoryBean - Loading properties file from class path resource [cfg-1.properties]
23:43:13,803 INFO Test worker config.PropertiesFactoryBean - Loading properties file from class path resource [cfg-2.properties]
packageJobJar: [] [/Users/trisberg/.gradle/caches/artifacts-26/filestore/org.apache.hadoop/hadoop-streaming/2.1.0-beta/jar/1bd54d1ffd47e683506298e7355eeae4b7d7bd99/hadoop-streaming-2.1.0-beta.jar] /var/folders/b1/gp8_tqw94t37ctkb1gtbly2c0000gn/T/streamjob2317635299565189407.jar tmpDir=null
23:43:14,312 WARN Test worker conf.Configuration - session.id is deprecated. Instead, use dfs.metrics.session-id
23:43:14,314 INFO Test worker jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
23:43:14,507 INFO Test worker mapred.FileInputFormat - Total input paths to process : 1
23:43:14,564 INFO Test worker mapreduce.JobSubmitter - number of splits:1
23:43:14,588 WARN Test worker conf.Configuration - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
23:43:14,589 WARN Test worker conf.Configuration - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
23:43:14,596 INFO Test worker mapreduce.JobSubmitter - Submitting tokens for job: job_local136401617_0001
23:43:14,626 WARN Test worker conf.Configuration - file:/tmp/hadoop-trisberg/mapred/staging/trisberg136401617/.staging/job_local136401617_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
23:43:14,626 WARN Test worker conf.Configuration - file:/tmp/hadoop-trisberg/mapred/staging/trisberg136401617/.staging/job_local136401617_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
23:43:14,745 WARN Test worker conf.Configuration - file:/tmp/hadoop-trisberg/mapred/local/localRunner/job_local136401617_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
23:43:14,746 WARN Test worker conf.Configuration - file:/tmp/hadoop-trisberg/mapred/local/localRunner/job_local136401617_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
23:43:14,761 INFO Test worker mapreduce.Job - The url to track the job: http://localhost:8080/
23:43:14,762 INFO Test worker mapreduce.Job - Running job: job_local136401617_0001
23:43:14,763 INFO Thread-476 mapred.LocalJobRunner - OutputCommitter set in config null
23:43:14,767 INFO Thread-476 mapred.LocalJobRunner - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
23:43:14,784 INFO Thread-476 mapred.LocalJobRunner - Waiting for map tasks
23:43:14,786 INFO LocalJobRunner Map Task Executor #0 mapred.LocalJobRunner - Starting task: attempt_local136401617_0001_m_000000_0
23:43:14,818 INFO LocalJobRunner Map Task Executor #0 util.ProcfsBasedProcessTree - ProcfsBasedProcessTree currently is supported only on Linux.
23:43:14,819 INFO LocalJobRunner Map Task Executor #0 mapred.Task - Using ResourceCalculatorProcessTree : null
23:43:14,821 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - Processing split: hdfs://sandbox:8020/user/trisberg/test:0+20151
23:43:14,850 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - numReduceTasks: 1
23:43:14,856 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
23:43:14,976 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - (EQUATOR) 0 kvi 26214396(104857584)
23:43:14,976 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - mapreduce.task.io.sort.mb: 100
23:43:14,977 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - soft limit at 83886080
23:43:14,977 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - bufstart = 0; bufvoid = 104857600
23:43:14,977 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - kvstart = 26214396; length = 6553600
23:43:15,001 INFO LocalJobRunner Map Task Executor #0 streaming.PipeMapRed - PipeMapRed exec [/bin/cat]
23:43:15,028 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
23:43:15,028 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - user.name is deprecated. Instead, use mapreduce.job.user.name
23:43:15,028 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - map.input.start is deprecated. Instead, use mapreduce.map.input.start
23:43:15,028 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap
23:43:15,029 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - mapred.tip.id is deprecated. Instead, use mapreduce.task.id
23:43:15,029 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords
23:43:15,030 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
23:43:15,030 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - map.input.length is deprecated. Instead, use mapreduce.map.input.length
23:43:15,031 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
23:43:15,032 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - mapred.work.output.dir is deprecated. Instead, use mapreduce.task.output.dir
23:43:15,032 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - map.input.file is deprecated. Instead, use mapreduce.map.input.file
23:43:15,033 WARN LocalJobRunner Map Task Executor #0 conf.Configuration - mapred.job.id is deprecated. Instead, use mapreduce.job.id
23:43:15,162 INFO LocalJobRunner Map Task Executor #0 streaming.PipeMapRed - R/W/S=1/0/0 in:NA [rec/s] out:NA [rec/s]
23:43:15,163 INFO LocalJobRunner Map Task Executor #0 streaming.PipeMapRed - R/W/S=10/0/0 in:NA [rec/s] out:NA [rec/s]
23:43:15,167 INFO LocalJobRunner Map Task Executor #0 streaming.PipeMapRed - R/W/S=100/0/0 in:NA [rec/s] out:NA [rec/s]
23:43:15,180 INFO Thread-481 streaming.PipeMapRed - MRErrorThread done
23:43:15,180 INFO Thread-480 streaming.PipeMapRed - Records R/W=653/1
23:43:15,197 INFO LocalJobRunner Map Task Executor #0 streaming.PipeMapRed - mapRedFinished
23:43:15,200 INFO LocalJobRunner Map Task Executor #0 mapred.LocalJobRunner -
23:43:15,200 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - Starting flush of map output
23:43:15,201 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - Spilling map output
23:43:15,201 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - bufstart = 0; bufend = 20804; bufvoid = 104857600
23:43:15,202 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - kvstart = 26214396(104857584); kvend = 26211788(104847152); length = 2609/6553600
23:43:15,254 INFO LocalJobRunner Map Task Executor #0 mapred.MapTask - Finished spill 0
23:43:15,257 INFO LocalJobRunner Map Task Executor #0 mapred.Task - Task:attempt_local136401617_0001_m_000000_0 is done. And is in the process of committing
23:43:15,266 INFO LocalJobRunner Map Task Executor #0 mapred.LocalJobRunner - Records R/W=653/1
23:43:15,266 INFO LocalJobRunner Map Task Executor #0 mapred.Task - Task 'attempt_local136401617_0001_m_000000_0' done.
23:43:15,266 INFO LocalJobRunner Map Task Executor #0 mapred.LocalJobRunner - Finishing task: attempt_local136401617_0001_m_000000_0
23:43:15,266 INFO Thread-476 mapred.LocalJobRunner - Map task executor complete.
23:43:15,303 INFO Thread-476 util.ProcfsBasedProcessTree - ProcfsBasedProcessTree currently is supported only on Linux.
23:43:15,304 INFO Thread-476 mapred.Task - Using ResourceCalculatorProcessTree : null
23:43:15,309 INFO Thread-476 mapred.Merger - Merging 1 sorted segments
23:43:15,315 INFO Thread-476 mapred.Merger - Down to the last merge-pass, with 1 segments left of total size: 22110 bytes
23:43:15,315 INFO Thread-476 mapred.LocalJobRunner -
23:43:15,331 INFO Thread-476 streaming.PipeMapRed - PipeMapRed exec [/usr/bin/wc]
23:43:15,333 WARN Thread-476 conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
23:43:15,334 WARN Thread-476 conf.Configuration - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
23:43:15,377 INFO Thread-476 streaming.PipeMapRed - R/W/S=1/0/0 in:NA [rec/s] out:NA [rec/s]
23:43:15,378 INFO Thread-476 streaming.PipeMapRed - R/W/S=10/0/0 in:NA [rec/s] out:NA [rec/s]
23:43:15,380 INFO Thread-476 streaming.PipeMapRed - R/W/S=100/0/0 in:NA [rec/s] out:NA [rec/s]
23:43:15,401 INFO Thread-484 streaming.PipeMapRed - Records R/W=653/1
23:43:15,402 INFO Thread-485 streaming.PipeMapRed - MRErrorThread done
23:43:15,405 INFO Thread-476 streaming.PipeMapRed - mapRedFinished
23:43:15,420 INFO Thread-476 mapred.Task - Task:attempt_local136401617_0001_r_000000_0 is done. And is in the process of committing
23:43:15,424 INFO Thread-476 mapred.LocalJobRunner -
23:43:15,425 INFO Thread-476 mapred.Task - Task attempt_local136401617_0001_r_000000_0 is allowed to commit now
23:43:15,440 INFO Thread-476 output.FileOutputCommitter - Saved output of task 'attempt_local136401617_0001_r_000000_0' to hdfs://sandbox:8020/user/trisberg/output/_temporary/0/task_local136401617_0001_r_000000
23:43:15,441 INFO Thread-476 mapred.LocalJobRunner - Records R/W=653/1 > reduce
23:43:15,441 INFO Thread-476 mapred.Task - Task 'attempt_local136401617_0001_r_000000_0' done.
23:43:15,764 INFO Test worker mapreduce.Job - Job job_local136401617_0001 running in uber mode : false
23:43:15,764 INFO Test worker mapreduce.Job - map 100% reduce 100%
23:43:15,764 INFO Test worker mapreduce.Job - Job job_local136401617_0001 completed successfully
23:43:16,028 INFO Test worker mapreduce.Job - Counters: 34
File System Counters
FILE: Number of bytes read=32777881
FILE: Number of bytes written=634592
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=48854
HDFS: Number of bytes written=29407422
HDFS: Number of read operations=2665
HDFS: Number of large read operations=0
HDFS: Number of write operations=718
HFTP: Number of bytes read=0
HFTP: Number of bytes written=0
HFTP: Number of read operations=0
HFTP: Number of large read operations=0
HFTP: Number of write operations=0
Map-Reduce Framework
Map input records=653
Map output records=653
Map output bytes=20804
Map output materialized bytes=22117
Input split bytes=90
Combine input records=0
Combine output records=0
Reduce input groups=409
Reduce shuffle bytes=0
Reduce input records=653
Reduce output records=1
Spilled Records=1306
Shuffled Maps =0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=0
Total committed heap usage (bytes)=617611264
File Input Format Counters
Bytes Read=20151
File Output Format Counters
Bytes Written=26
23:43:16,135 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:43:16,560 INFO Test worker mapred.FileInputFormat - Total input paths to process : 1
23:43:16,615 INFO Test worker mapreduce.JobSubmitter - number of splits:2
23:43:16,623 WARN Test worker conf.Configuration - mapred.jar is deprecated. Instead, use mapreduce.job.jar
23:43:16,623 WARN Test worker conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
23:43:16,623 WARN Test worker conf.Configuration - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
23:43:16,623 WARN Test worker conf.Configuration - mapred.cache.archives is deprecated. Instead, use mapreduce.job.cache.archives
23:43:16,623 WARN Test worker conf.Configuration - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
23:43:16,623 WARN Test worker conf.Configuration - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
23:43:16,623 WARN Test worker conf.Configuration - mapred.cache.archives.filesizes is deprecated. Instead, use mapreduce.job.cache.archives.filesizes
23:43:16,623 WARN Test worker conf.Configuration - mapred.job.name is deprecated. Instead, use mapreduce.job.name
23:43:16,623 WARN Test worker conf.Configuration - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
23:43:16,623 WARN Test worker conf.Configuration - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
23:43:16,624 WARN Test worker conf.Configuration - mapred.cache.archives.timestamps is deprecated. Instead, use mapreduce.job.cache.archives.timestamps
23:43:16,624 WARN Test worker conf.Configuration - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
23:43:16,624 WARN Test worker conf.Configuration - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
23:43:16,624 WARN Test worker conf.Configuration - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
23:43:16,645 INFO Test worker mapreduce.JobSubmitter - Submitting tokens for job: job_1380140057116_0032
23:43:16,693 INFO Test worker impl.YarnClientImpl - Submitted application application_1380140057116_0032 to ResourceManager at sandbox/172.16.87.151:8050
23:43:16,697 INFO Test worker mapreduce.Job - The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1380140057116_0032/
23:43:16,697 INFO Test worker mapreduce.Job - Running job: job_1380140057116_0032
23:43:25,993 INFO Test worker mapreduce.Job - Job job_1380140057116_0032 running in uber mode : false
23:43:25,993 INFO Test worker mapreduce.Job - map 0% reduce 0%
23:43:37,318 INFO Test worker mapreduce.Job - map 100% reduce 0%
23:43:43,719 INFO Test worker mapreduce.Job - map 100% reduce 100%
23:43:43,722 INFO Test worker mapreduce.Job - Job job_1380140057116_0032 completed successfully
23:43:43,757 INFO Test worker mapreduce.Job - Counters: 43
File System Counters
FILE: Number of bytes read=22117
FILE: Number of bytes written=310109
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=22544
HDFS: Number of bytes written=25
HDFS: Number of read operations=9
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=2
Launched reduce tasks=1
Data-local map tasks=2
Total time spent by all maps in occupied slots (ms)=18040
Total time spent by all reduces in occupied slots (ms)=4560
Map-Reduce Framework
Map input records=653
Map output records=653
Map output bytes=20804
Map output materialized bytes=22123
Input split bytes=180
Combine input records=0
Combine output records=0
Reduce input groups=409
Reduce shuffle bytes=22123
Reduce input records=653
Reduce output records=1
Spilled Records=1306
Shuffled Maps =2
Failed Shuffles=0
Merged Map outputs=2
GC time elapsed (ms)=71
CPU time spent (ms)=3250
Physical memory (bytes) snapshot=620855296
Virtual memory (bytes) snapshot=3415543808
Total committed heap usage (bytes)=469696512
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=22364
File Output Format Counters
Bytes Written=25