23:42:36,114 INFO Test worker context.TestContextManager - @TestExecutionListeners is not present for class [class org.springframework.data.hadoop.mapreduce.JobKillTests]: using defaults.
23:42:36,117 INFO Test worker xml.XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [org/springframework/data/hadoop/mapreduce/JobKillTests-context.xml]
23:42:36,189 INFO Test worker xml.XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [org/springframework/data/hadoop/batch-common.xml]
23:42:36,222 INFO Test worker xml.XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [org/springframework/data/hadoop/hadoop-ctx.xml]
23:42:36,235 INFO Test worker support.DefaultListableBeanFactory - Overriding bean definition for bean 'mainJob': replacing [Generic bean: class [org.springframework.batch.core.configuration.xml.SimpleFlowFactoryBean]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null] with [Generic bean: class [org.springframework.batch.core.configuration.xml.JobParserJobFactoryBean]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null]
23:42:36,259 INFO Test worker support.DefaultListableBeanFactory - Overriding bean definition for bean 'taskExecutor': replacing [Generic bean: class [org.springframework.core.task.SyncTaskExecutor]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in class path resource [org/springframework/data/hadoop/batch-common.xml]] with [Generic bean: class [org.springframework.core.task.SimpleAsyncTaskExecutor]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in class path resource [org/springframework/data/hadoop/mapreduce/JobKillTests-context.xml]]
23:42:36,259 INFO Test worker support.GenericApplicationContext - Refreshing org.springframework.context.support.GenericApplicationContext@14ad6b49: startup date [Wed Sep 25 23:42:36 EDT 2013]; root of context hierarchy
23:42:36,267 INFO Test worker config.PropertyPlaceholderConfigurer - Loading properties file from class path resource [test.properties]
23:42:36,270 INFO Test worker annotation.AutowiredAnnotationBeanPostProcessor - JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
23:42:36,272 INFO Test worker support.DefaultListableBeanFactory - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@7dddc564: defining beans [jobRepository,transactionManager,jobLauncher,taskExecutor,ppc,hadoopFs,hadoopResourceLoader,hadoopConfiguration,cfg-init,fs-init,rl-init,org.springframework.data.hadoop.scripting.HdfsScriptRunner#0,org.springframework.batch.core.scope.StepScope#0,script,nop-script,org.springframework.beans.factory.config.CustomEditorConfigurer,org.springframework.batch.core.configuration.xml.CoreNamespacePostProcessor,do-hadoop,mainJob,killer-runner,victim-job,hdp-tasklet,tasklet-victim-job,org.springframework.context.annotation.internalConfigurationAnnotationProcessor,org.springframework.context.annotation.internalAutowiredAnnotationProcessor,org.springframework.context.annotation.internalRequiredAnnotationProcessor,org.springframework.context.annotation.internalCommonAnnotationProcessor]; root of factory hierarchy
23:42:36,302 WARN Test worker conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
23:42:36,302 WARN Test worker conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
23:42:36,307 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:42:36,344 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:42:36,353 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:42:37,724 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:42:37,767 INFO SimpleAsyncTaskExecutor-1 support.SimpleJobLauncher - Job: [FlowJob: [name=mainJob]] launched with the following parameters: [{}]
23:42:37,774 INFO SimpleAsyncTaskExecutor-1 job.SimpleStepHandler - Executing step: [do-hadoop]
23:42:37,783 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:37,799 INFO SimpleAsyncTaskExecutor-2 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:37,801 INFO SimpleAsyncTaskExecutor-2 mapreduce.JobTasklet - Starting job [tasklet-victim-job]
23:42:37,815 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:37,830 INFO SimpleAsyncTaskExecutor-2 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:37,869 WARN SimpleAsyncTaskExecutor-2 mapreduce.JobSubmitter - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
23:42:37,891 INFO SimpleAsyncTaskExecutor-2 input.FileInputFormat - Total input paths to process : 5
23:42:38,345 INFO SimpleAsyncTaskExecutor-2 mapreduce.JobSubmitter - number of splits:5
23:42:38,377 WARN SimpleAsyncTaskExecutor-2 conf.Configuration - mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
23:42:38,378 WARN SimpleAsyncTaskExecutor-2 conf.Configuration - mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
23:42:38,378 WARN SimpleAsyncTaskExecutor-2 conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
23:42:38,378 WARN SimpleAsyncTaskExecutor-2 conf.Configuration - mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
23:42:38,378 WARN SimpleAsyncTaskExecutor-2 conf.Configuration - mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
23:42:38,407 INFO SimpleAsyncTaskExecutor-2 mapreduce.JobSubmitter - Submitting tokens for job: job_1380140057116_0029
23:42:38,412 INFO SimpleAsyncTaskExecutor-2 mapred.YARNRunner - Job jar is not present. Not adding any jar to the list of resources.
23:42:38,474 INFO SimpleAsyncTaskExecutor-2 impl.YarnClientImpl - Submitted application application_1380140057116_0029 to ResourceManager at sandbox/172.16.87.151:8050
23:42:38,493 INFO SimpleAsyncTaskExecutor-2 mapreduce.Job - The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1380140057116_0029/
23:42:38,494 INFO SimpleAsyncTaskExecutor-2 mapreduce.Job - Running job: job_1380140057116_0029
23:42:38,830 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:43,278 INFO SimpleAsyncTaskExecutor-1 mapreduce.JobTasklet - Cancelling job tasklet
23:42:43,297 INFO SimpleAsyncTaskExecutor-3 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:43,347 INFO SimpleAsyncTaskExecutor-3 mapreduce.JobTasklet - Killing job [tasklet-victim-job]
23:42:43,350 INFO SimpleAsyncTaskExecutor-3 impl.YarnClientImpl - Killing application application_1380140057116_0029
23:42:43,374 WARN SimpleAsyncTaskExecutor-3 mapreduce.Counters - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
23:42:43,390 INFO SimpleAsyncTaskExecutor-3 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:43,447 INFO SimpleAsyncTaskExecutor-1 support.SimpleJobRepository - Parent JobExecution is stopped, so passing message on to StepExecution
23:42:43,448 INFO SimpleAsyncTaskExecutor-1 step.ThreadStepInterruptionPolicy - Step interrupted through StepExecution
23:42:43,448 INFO SimpleAsyncTaskExecutor-1 step.AbstractStep - Encountered interruption executing step: Job interrupted status detected.
23:42:43,450 INFO SimpleAsyncTaskExecutor-1 support.SimpleJobRepository - Parent JobExecution is stopped, so passing message on to StepExecution
23:42:43,451 INFO SimpleAsyncTaskExecutor-1 job.AbstractJob - Encountered interruption executing job: Job interrupted by step execution
23:42:43,453 INFO SimpleAsyncTaskExecutor-1 support.SimpleJobLauncher - Job: [FlowJob: [name=mainJob]] completed with the following parameters: [{}] and the following status: [STOPPED]
23:42:43,629 INFO SimpleAsyncTaskExecutor-2 mapreduce.Job - Job job_1380140057116_0029 running in uber mode : false
23:42:43,629 INFO SimpleAsyncTaskExecutor-2 mapreduce.Job - map 0% reduce 0%
23:42:43,676 INFO SimpleAsyncTaskExecutor-2 mapreduce.Job - Job job_1380140057116_0029 failed with state KILLED due to: Application killed by user.
23:42:43,690 INFO SimpleAsyncTaskExecutor-2 mapreduce.Job - Counters: 0
23:42:43,766 INFO SimpleAsyncTaskExecutor-2 mapreduce.JobTasklet - Completed job [tasklet-victim-job]
23:42:43,770 WARN SimpleAsyncTaskExecutor-2 mapreduce.Counters - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
23:42:43,788 INFO SimpleAsyncTaskExecutor-2 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:43,840 INFO SimpleAsyncTaskExecutor-2 mapreduce.JobTasklet - Job [tasklet-victim-job] killed by shutdown
23:42:43,889 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:43,946 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:43,997 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:44,012 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:44,026 INFO SimpleAsyncTaskExecutor-4 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:44,027 INFO SimpleAsyncTaskExecutor-4 mapreduce.JobRunner - Starting job [victim-job]
23:42:44,042 INFO SimpleAsyncTaskExecutor-4 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:44,060 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:44,102 ERROR Test worker security.UserGroupInformation - PriviledgedActionException as:trisberg (auth:SIMPLE) cause:java.io.IOException: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1380140057116_0030' doesn't exist in RM.
at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:244)
at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:120)
at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:241)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2048)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2044)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2042)
23:42:44,142 WARN SimpleAsyncTaskExecutor-4 mapreduce.JobSubmitter - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
23:42:44,164 INFO SimpleAsyncTaskExecutor-4 input.FileInputFormat - Total input paths to process : 5
23:42:44,264 INFO SimpleAsyncTaskExecutor-4 mapreduce.JobSubmitter - number of splits:5
23:42:44,271 WARN SimpleAsyncTaskExecutor-4 conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
23:42:44,691 INFO SimpleAsyncTaskExecutor-4 mapreduce.JobSubmitter - Submitting tokens for job: job_1380140057116_0030
23:42:44,696 INFO SimpleAsyncTaskExecutor-4 mapred.YARNRunner - Job jar is not present. Not adding any jar to the list of resources.
23:42:44,712 INFO SimpleAsyncTaskExecutor-4 impl.YarnClientImpl - Submitted application application_1380140057116_0030 to ResourceManager at sandbox/172.16.87.151:8050
23:42:44,716 INFO SimpleAsyncTaskExecutor-4 mapreduce.Job - The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1380140057116_0030/
23:42:45,137 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:45,192 INFO SimpleAsyncTaskExecutor-5 client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:45,240 INFO SimpleAsyncTaskExecutor-5 mapreduce.JobRunner - Killing job [victim-job]
23:42:45,243 INFO SimpleAsyncTaskExecutor-5 impl.YarnClientImpl - Killing application application_1380140057116_0030
23:42:50,209 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050
23:42:50,260 INFO Test worker client.RMProxy - Connecting to ResourceManager at sandbox/172.16.87.151:8050