|
Spring for Apache Hadoop | ||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.springframework.data.hadoop.store.split.AbstractSplitter
org.springframework.data.hadoop.store.split.SlopBlockSplitter
org.springframework.data.hadoop.store.split.StaticBlockSplitter
public class StaticBlockSplitter
A StaticBlockSplitter
is a Splitter
handling
splits as relative of block sizes allowing to furthern split
blocks on a smaller chunks.
Having zero blocks means a split happens on a full block sizes, furthermore using a splits sizes higher than zero simply means how many times block is split. One simple means two splits for a block, two means three splits for a block, etc.
Field Summary |
---|
Fields inherited from class org.springframework.data.hadoop.store.split.SlopBlockSplitter |
---|
DEFAULT_SPLIT_SLOP |
Constructor Summary | |
---|---|
StaticBlockSplitter()
Instantiates a new static block splitter. |
|
StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration)
Instantiates a new static block splitter. |
|
StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration,
int splits)
Instantiates a new static block splitter. |
Method Summary | |
---|---|
protected long |
computeSplitSize(long blockSize,
long minSize,
long maxSize)
Compute split size. |
void |
setSplits(int splits)
Sets the splits count. |
Methods inherited from class org.springframework.data.hadoop.store.split.SlopBlockSplitter |
---|
getMaxSplitSize, getMinSplitSize, getSplits, setMaxSplitSize, setMinSplitSize, setSlop |
Methods inherited from class org.springframework.data.hadoop.store.split.AbstractSplitter |
---|
buildSplit, getBlockIndex, getConfiguration, setConfiguration |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public StaticBlockSplitter()
public StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration)
configuration
- the configurationpublic StaticBlockSplitter(org.apache.hadoop.conf.Configuration configuration, int splits)
configuration
- the configurationsplits
- the splitsMethod Detail |
---|
protected long computeSplitSize(long blockSize, long minSize, long maxSize)
AbstractSplitter
computeSplitSize
in class AbstractSplitter
blockSize
- the block sizeminSize
- the min sizemaxSize
- the max size
public void setSplits(int splits)
splits
- the new splits count
|
Spring for Apache Hadoop | ||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |