23:44:12,385 INFO Test worker context.TestContextManager - @TestExecutionListeners is not present for class [class org.springframework.data.hadoop.scripting.ScriptingBatchTest]: using defaults.
23:44:12,386 INFO Test worker xml.XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [org/springframework/data/hadoop/scripting/ScriptingBatchTest-context.xml]
23:44:12,437 INFO Test worker xml.XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [org/springframework/data/hadoop/batch-common.xml]
23:44:12,452 INFO Test worker xml.XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [org/springframework/data/hadoop/hadoop-ctx.xml]
23:44:12,470 INFO Test worker support.DefaultListableBeanFactory - Overriding bean definition for bean 'mainJob': replacing [Generic bean: class [org.springframework.batch.core.configuration.xml.SimpleFlowFactoryBean]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null] with [Generic bean: class [org.springframework.batch.core.configuration.xml.JobParserJobFactoryBean]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null]
23:44:12,470 INFO Test worker support.GenericApplicationContext - Refreshing org.springframework.context.support.GenericApplicationContext@13eefd10: startup date [Wed Sep 25 23:44:12 EDT 2013]; root of context hierarchy
23:44:12,507 INFO Test worker config.PropertyPlaceholderConfigurer - Loading properties file from class path resource [test.properties]
23:44:12,513 INFO Test worker annotation.AutowiredAnnotationBeanPostProcessor - JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
23:44:12,516 INFO Test worker support.DefaultListableBeanFactory - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@34328dbf: defining beans [jobRepository,transactionManager,jobLauncher,taskExecutor,ppc,hadoopFs,hadoopResourceLoader,hadoopConfiguration,cfg-init,fs-init,rl-init,org.springframework.data.hadoop.scripting.HdfsScriptRunner#0,org.springframework.batch.core.scope.internalStepScope,org.springframework.beans.factory.config.CustomEditorConfigurer,org.springframework.batch.core.configuration.xml.CoreNamespacePostProcessor,bean,ns,ns2,mainJob,tasklet,script,script-tasklet,org.springframework.data.hadoop.scripting.HdfsScriptRunner#1,nested-script-tasklet,org.springframework.context.annotation.internalConfigurationAnnotationProcessor,org.springframework.context.annotation.internalAutowiredAnnotationProcessor,org.springframework.context.annotation.internalRequiredAnnotationProcessor,org.springframework.context.annotation.internalCommonAnnotationProcessor]; root of factory hierarchy
23:44:12,543 WARN Test worker conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
23:44:12,550 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:44:12,588 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:44:12,591 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:44:12,601 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:44:12,608 INFO Test worker support.SimpleJobLauncher - Job: [FlowJob: [name=mainJob]] launched with the following parameters: [{}]
23:44:12,614 INFO Test worker job.SimpleStepHandler - Executing step: [bean]
23:44:12,629 INFO Test worker job.SimpleStepHandler - Executing step: [ns]
hdfs://sandbox:8020
Created file 3741bb92-1e28-4169-be6e-4cd2134a291d
File content is #
# Hadoop/Hive/Pig settings used for settings
#
# Note: the system properties are checked first - that is the command-line takes precedence (useful for CI)
# Amazon EMR
# hive.port=10003
# hd.fs=s3n://work-emr/tmp
# hd.jt=localhost:20001
# hd.jt=10.80.205.79:9001
# Apache Whirr - EC2
# hd.fs=hdfs://xxx.amazonaws.com:8020
# hd.jt=xxx.amazonaws.com:8021
# Default - Vanilla Installs
#hd.fs=hdfs://${hadoop.host:localhost}:${hadoop.port:9000}
#
# Hadoop settings
#
## M&R
hadoop.fs=${hd.fs|hdfs://localhost:8020}
hadoop.jt=${hd.jt|local}
## Hive
hive.host=${hd.hive.host|localhost}
hive.port=${hd.hive.port|10000}
hive.url=jdbc:hive://${hive.host}:${hive.port}
## HBase
hbase.host=${hd.hbase.host|localhost}
hbase.port=${hd.hbase.port|2181}
## Pig Execution
## externalized since CDH3 VM Pig install has issues (SL4J CNFE)
pig.execution=${hd.pig.exec|LOCAL}
#
# Other settings
#
#path.cat=bin${file.separator}stream-bin${file.separator}cat
#path.wc=bin${file.separator}stream-bin${file.separator}wc
path.cat=cat
path.wc=wc
input.directory=logs
log.input=/logs/input/
log.output=/logs/output/
distcp.src=${hadoop.fs}/distcp/source.txt
distcp.dst=${hadoop.fs}/distcp/dst
cascade.sec=/test/cascading/loganalysis/sec
cascade.min=/test/cascading/loganalysis/min
drwx------ - trisberg hdfs 0 2013-09-25 17:42 /user/trisberg/script-dir
-rw-r--r-- 3 trisberg hdfs 1271 2013-09-25 17:42 /user/trisberg/script-dir/3741bb92-1e28-4169-be6e-4cd2134a291d
23:44:12,792 INFO Test worker fs.TrashPolicyDefault - Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
23:44:12,815 INFO Test worker job.SimpleStepHandler - Executing step: [ns2]
drwxrwxrwx - hdfs hdfs 0 2013-09-25 17:40 /
drwxrwxrwt - yarn hadoop 0 2013-09-25 16:21 /app-logs
drwxr-xr-x - hdfs hdfs 0 2013-08-27 12:51 /apps
drwxr-xr-x - trisberg hdfs 0 2013-09-25 17:38 /batch
drwxr-xr-x - trisberg hdfs 0 2013-09-25 17:38 /batch-param-test
drwxr-xr-x - trisberg hdfs 0 2013-09-25 17:41 /ide-test
drwxr-xr-x - mapred hdfs 0 2013-08-27 12:52 /mapred
drwxr-xr-x - hdfs hdfs 0 2013-08-27 12:52 /mr-history
drwxrwxrwx - trisberg hdfs 0 2013-09-25 17:40 /test
drwxrwxrwx - hdfs hdfs 0 2013-09-25 16:46 /tmp
drwxrwxrwx - hdfs hdfs 0 2013-09-25 17:39 /user
23:44:12,875 INFO Test worker support.SimpleJobLauncher - Job: [FlowJob: [name=mainJob]] completed with the following parameters: [{}] and the following status: [COMPLETED]