|
Spring for Apache Hadoop | ||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.springframework.yarn.batch.partition.AbstractPartitioner org.springframework.yarn.batch.partition.SplitterPartitioner
public class SplitterPartitioner
Implementation of Partitioner
that locates multiple resources and
associates their file names with execution context keys.
Creates an ExecutionContext
per resource, and labels them as
{partition0, partition1, ..., partitionN}
where 'partition' part
comes from a AbstractPartitioner.getPartitionBaseIdentifier()
.
The grid size information passed to method Partitioner.partition(int)
is ignored.
Constructor Summary | |
---|---|
SplitterPartitioner()
|
Method Summary | |
---|---|
protected java.util.Map<java.lang.String,org.springframework.batch.item.ExecutionContext> |
createPartitions()
Creates the ExecutionContext s for partitions. |
void |
setInputPatterns(java.util.Set<java.lang.String> inputPatterns)
Sets the input patterns. |
void |
setInputPatterns(java.lang.String inputPatterns)
Sets the input patterns. |
void |
setSplitter(Splitter splitter)
Sets the splitter. |
Methods inherited from class org.springframework.yarn.batch.partition.AbstractPartitioner |
---|
createExecutionContext, createExecutionContext, getConfiguration, getKeyFileName, getKeySplitLength, getKeySplitLocations, getKeySplitStart, getPartitionBaseIdentifier, partition, setConfiguration, setKeyFileName, setKeySplitLength, setKeySplitLocations, setKeySplitStart, setPartitionBaseIdentifier |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public SplitterPartitioner()
Method Detail |
---|
protected java.util.Map<java.lang.String,org.springframework.batch.item.ExecutionContext> createPartitions()
AbstractPartitioner
ExecutionContext
s for partitions.
createPartitions
in class AbstractPartitioner
ExecutionContext
s for partitionspublic void setInputPatterns(java.lang.String inputPatterns)
inputPatterns
- the new input patternspublic void setInputPatterns(java.util.Set<java.lang.String> inputPatterns)
inputPatterns
- the new input patternspublic void setSplitter(Splitter splitter)
splitter
- the new splitter
|
Spring for Apache Hadoop | ||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |