org.springframework.data.hadoop.store.split

Class StaticBlockSplitter

java.lang.Object

org.springframework.data.hadoop.store.split.AbstractSplitter

org.springframework.data.hadoop.store.split.SlopBlockSplitter

org.springframework.data.hadoop.store.split.StaticBlockSplitter

All Implemented Interfaces:

Splitter

public class StaticBlockSplitter
extends SlopBlockSplitter

A StaticBlockSplitter is a Splitter handling splits as relative of block sizes allowing to furthern split blocks on a smaller chunks.

Having zero blocks means a split happens on a full block sizes, furthermore using a splits sizes higher than zero simply means how many times block is split. One simple means two splits for a block, two means three splits for a block, etc.

Author:

Janne Valkealahti

Field Summary

Fields inherited from class org.springframework.data.hadoop.store.split.SlopBlockSplitter

DEFAULT_SPLIT_SLOP

Constructor Summary

Constructors

Constructor and Description
StaticBlockSplitter() Instantiates a new static block splitter.
StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration) Instantiates a new static block splitter.
StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration, int splits) Instantiates a new static block splitter.

Method Summary

Methods

Modifier and Type	Method and Description
protected long	computeSplitSize(long blockSize, long minSize, long maxSize) Compute split size.
void	setSplits(int splits) Sets the splits count.

Methods inherited from class org.springframework.data.hadoop.store.split.SlopBlockSplitter

getMaxSplitSize, getMinSplitSize, getSplits, setMaxSplitSize, setMinSplitSize, setSlop

Methods inherited from class org.springframework.data.hadoop.store.split.AbstractSplitter

buildSplit, getBlockIndex, getConfiguration, setConfiguration

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StaticBlockSplitter

public StaticBlockSplitter()

Instantiates a new static block splitter.

StaticBlockSplitter

public StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration)

Instantiates a new static block splitter.

Parameters:

configuration - the configuration

StaticBlockSplitter

public StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration,
                   int splits)

Instantiates a new static block splitter.

Parameters:

configuration - the configuration

splits - the splits

Method Detail

computeSplitSize

protected long computeSplitSize(long blockSize,
                    long minSize,
                    long maxSize)

Description copied from class: AbstractSplitter

Compute split size. Default implementation takes minSize if it is bigger than minimum from a maxSize or blockSize.

Overrides:

computeSplitSize in class AbstractSplitter

Parameters:

blockSize - the block size

minSize - the min size

maxSize - the max size

Returns:

the long

setSplits

public void setSplits(int splits)

Sets the splits count.

Parameters:

splits - the new splits count