|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.springframework.data.hadoop.mapreduce.StreamJobFactoryBean
public class StreamJobFactoryBean
Factory bean focused on creating streaming jobs.
As opposed to JobFactoryBean
which is Java-specific, this factory is suitable for streaming scenarios (such as
invoking Ruby/Python scripts or command-line scripts).
Constructor Summary | |
---|---|
StreamJobFactoryBean()
|
Method Summary | |
---|---|
void |
afterPropertiesSet()
|
Job |
getObject()
|
Class<?> |
getObjectType()
|
boolean |
isSingleton()
|
void |
setArchives(Resource... archives)
Sets the archives to be unarchive to the map reduce cluster. |
void |
setBeanName(String name)
|
void |
setCmdEnv(Properties cmdEnv)
Sets the environment for the commands to be executed. |
void |
setCombiner(String combiner)
Sets the job combiner. |
void |
setConfiguration(Configuration configuration)
Sets the Hadoop configuration to use. |
void |
setFiles(Resource... files)
Sets the files to be copied to the map reduce cluster. |
void |
setInputFormat(String inputFormat)
Sets the job input format. |
void |
setInputPath(String... input)
Sets the job input paths. |
void |
setLibs(Resource... libJars)
Sets the jar files to include in the classpath. |
void |
setMapper(String mapper)
Sets the job mapper. |
void |
setNumberReducers(Integer numReduceTasks)
Sets the job number of reducer tasks. |
void |
setOutputFormat(String outputFormat)
Sets the job output format. |
void |
setOutputPath(String output)
Sets the job output paths. |
void |
setPartitioner(String partitioner)
Sets the job partitioner. |
void |
setProperties(Properties properties)
Sets the configuration properties to use. |
void |
setReducer(String reducer)
Sets the job reducer. |
void |
setUser(String user)
Sets the user impersonation (optional) for running this job. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public StreamJobFactoryBean()
Method Detail |
---|
public void setBeanName(String name)
setBeanName
in interface BeanNameAware
public Job getObject() throws Exception
getObject
in interface FactoryBean<Job>
Exception
public Class<?> getObjectType()
getObjectType
in interface FactoryBean<Job>
public boolean isSingleton()
isSingleton
in interface FactoryBean<Job>
public void afterPropertiesSet() throws Exception
afterPropertiesSet
in interface InitializingBean
Exception
public void setInputPath(String... input)
input
- The input to set.public void setOutputPath(String output)
output
- The output to set.public void setMapper(String mapper)
mapper
- The mapper to set.public void setReducer(String reducer)
reducer
- The reducer to set.public void setCombiner(String combiner)
combiner
- The combiner to set.public void setInputFormat(String inputFormat)
inputFormat
- The inputFormat to set.public void setOutputFormat(String outputFormat)
outputFormat
- The outputFormat to set.public void setPartitioner(String partitioner)
partitioner
- The partitioner to set.public void setConfiguration(Configuration configuration)
configuration
- The configuration to set.public void setCmdEnv(Properties cmdEnv)
cmdEnv
- The environment command/property to set.public void setNumberReducers(Integer numReduceTasks)
numReduceTasks
- The numReduceTasks to set.public void setProperties(Properties properties)
properties
- The properties to set.public void setLibs(Resource... libJars)
mydir/*.jar
), which the
Spring container will automatically resolve.
libJars
- The jar files to include in the classpath.public void setFiles(Resource... files)
mydir/*.txt
), which the
Spring container will automatically resolve.
files
- The files to copy.public void setArchives(Resource... archives)
mydir/*.zip
), which the
Spring container will automatically resolve.
archives
- The archives to unarchive on the compute machines.public void setUser(String user)
user
- user/group information
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |