Spring for Apache Hadoop

org.springframework.yarn.batch.partition
Class SplitterPartitioner

java.lang.Object
  extended by org.springframework.yarn.batch.partition.AbstractPartitioner
      extended by org.springframework.yarn.batch.partition.SplitterPartitioner
All Implemented Interfaces:
org.springframework.batch.core.partition.support.Partitioner

public class SplitterPartitioner
extends AbstractPartitioner

Implementation of Partitioner that locates multiple resources and associates their file names with execution context keys.

Creates an ExecutionContext per resource, and labels them as {partition0, partition1, ..., partitionN} where 'partition' part comes from a AbstractPartitioner.getPartitionBaseIdentifier().

The grid size information passed to method Partitioner.partition(int) is ignored.

Author:
Janne Valkealahti

Constructor Summary
SplitterPartitioner()
           
 
Method Summary
protected  java.util.Map<java.lang.String,org.springframework.batch.item.ExecutionContext> createPartitions()
          Creates the ExecutionContexts for partitions.
 void setInputPatterns(java.util.Set<java.lang.String> inputPatterns)
          Sets the input patterns.
 void setInputPatterns(java.lang.String inputPatterns)
          Sets the input patterns.
 void setSplitter(Splitter splitter)
          Sets the splitter.
 
Methods inherited from class org.springframework.yarn.batch.partition.AbstractPartitioner
createExecutionContext, createExecutionContext, getConfiguration, getKeyFileName, getKeySplitLength, getKeySplitLocations, getKeySplitStart, getPartitionBaseIdentifier, partition, setConfiguration, setKeyFileName, setKeySplitLength, setKeySplitLocations, setKeySplitStart, setPartitionBaseIdentifier
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

SplitterPartitioner

public SplitterPartitioner()
Method Detail

createPartitions

protected java.util.Map<java.lang.String,org.springframework.batch.item.ExecutionContext> createPartitions()
Description copied from class: AbstractPartitioner
Creates the ExecutionContexts for partitions.

Specified by:
createPartitions in class AbstractPartitioner
Returns:
the ExecutionContexts for partitions

setInputPatterns

public void setInputPatterns(java.lang.String inputPatterns)
Sets the input patterns.

Parameters:
inputPatterns - the new input patterns

setInputPatterns

public void setInputPatterns(java.util.Set<java.lang.String> inputPatterns)
Sets the input patterns.

Parameters:
inputPatterns - the new input patterns

setSplitter

public void setSplitter(Splitter splitter)
Sets the splitter.

Parameters:
splitter - the new splitter

Spring for Apache Hadoop