Spring for Apache Hadoop

org.springframework.data.hadoop.store.split
Class StaticBlockSplitter

java.lang.Object
  extended by org.springframework.data.hadoop.store.split.AbstractSplitter
      extended by org.springframework.data.hadoop.store.split.SlopBlockSplitter
          extended by org.springframework.data.hadoop.store.split.StaticBlockSplitter
All Implemented Interfaces:
Splitter

public class StaticBlockSplitter
extends SlopBlockSplitter

A StaticBlockSplitter is a Splitter handling splits as relative of block sizes allowing to furthern split blocks on a smaller chunks.

Having zero blocks means a split happens on a full block sizes, furthermore using a splits sizes higher than zero simply means how many times block is split. One simple means two splits for a block, two means three splits for a block, etc.

Author:
Janne Valkealahti

Field Summary
 
Fields inherited from class org.springframework.data.hadoop.store.split.SlopBlockSplitter
DEFAULT_SPLIT_SLOP
 
Constructor Summary
StaticBlockSplitter()
          Instantiates a new static block splitter.
StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration)
          Instantiates a new static block splitter.
StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration, int splits)
          Instantiates a new static block splitter.
 
Method Summary
protected  long computeSplitSize(long blockSize, long minSize, long maxSize)
          Compute split size.
 void setSplits(int splits)
          Sets the splits count.
 
Methods inherited from class org.springframework.data.hadoop.store.split.SlopBlockSplitter
getMaxSplitSize, getMinSplitSize, getSplits, setMaxSplitSize, setMinSplitSize, setSlop
 
Methods inherited from class org.springframework.data.hadoop.store.split.AbstractSplitter
buildSplit, getBlockIndex, getConfiguration, setConfiguration
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

StaticBlockSplitter

public StaticBlockSplitter()
Instantiates a new static block splitter.


StaticBlockSplitter

public StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration)
Instantiates a new static block splitter.

Parameters:
configuration - the configuration

StaticBlockSplitter

public StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration,
                           int splits)
Instantiates a new static block splitter.

Parameters:
configuration - the configuration
splits - the splits
Method Detail

computeSplitSize

protected long computeSplitSize(long blockSize,
                                long minSize,
                                long maxSize)
Description copied from class: AbstractSplitter
Compute split size. Default implementation takes minSize if it is bigger than minimum from a maxSize or blockSize.

Overrides:
computeSplitSize in class AbstractSplitter
Parameters:
blockSize - the block size
minSize - the min size
maxSize - the max size
Returns:
the long

setSplits

public void setSplits(int splits)
Sets the splits count.

Parameters:
splits - the new splits count

Spring for Apache Hadoop