org.springframework.cloud.task.jdbchdfs.common

Class IncrementalColumnRangePartitioner

java.lang.Object

org.springframework.cloud.task.jdbchdfs.common.IncrementalColumnRangePartitioner

All Implemented Interfaces:

org.springframework.batch.core.partition.support.Partitioner, org.springframework.batch.core.StepExecutionListener, org.springframework.batch.core.StepListener, org.springframework.beans.factory.InitializingBean

public class IncrementalColumnRangePartitioner
extends Object
implements org.springframework.batch.core.partition.support.Partitioner, org.springframework.batch.core.StepExecutionListener, org.springframework.beans.factory.InitializingBean

Provides the ability to partition a job and append additional conditions to support incremental imports. Incremental imports are supported via the checkColumn attribute. The partitionMax value processed in the current run will be set as the minimum value for the next run.

Author:

Michael Minella, Glenn Renfro

Field Summary

Fields

Modifier and Type	Field and Description
static String	BATCH_INCREMENTAL_MAX_ID

Constructor Summary

Constructors

Constructor and Description
IncrementalColumnRangePartitioner()

Method Summary

Modifier and Type	Method and Description
void	afterPropertiesSet()
org.springframework.batch.core.ExitStatus	afterStep(org.springframework.batch.core.StepExecution stepExecution)
void	beforeStep(org.springframework.batch.core.StepExecution stepExecution)
Map<String,org.springframework.batch.item.ExecutionContext>	partition(int gridSize) Partition a database table assuming that the data in the column specified are uniformly distributed.
void	setCheckColumn(String checkColumn) The name of the check column to be used by the task.
void	setColumn(String column) The name of the column to partition.
void	setDataSource(DataSource dataSource) The data source for connecting to the database.
void	setJobExplorer(org.springframework.batch.core.explore.JobExplorer jobExplorer) The job explorer to be used by the task.
void	setOverrideValue(Long overrideValue) The override value to be used by the task.
void	setPartitions(int partitions) The number of partitions to create.
void	setTable(String table) The name of the SQL table the data are in.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

BATCH_INCREMENTAL_MAX_ID

public static final String BATCH_INCREMENTAL_MAX_ID

See Also:

Constant Field Values

Constructor Detail

IncrementalColumnRangePartitioner

public IncrementalColumnRangePartitioner()

Method Detail

setDataSource

public void setDataSource(DataSource dataSource)

The data source for connecting to the database.

Parameters:

dataSource - a DataSource

setTable

public void setTable(String table)

The name of the SQL table the data are in.

Parameters:

table - the name of the table

setColumn

public void setColumn(String column)

The name of the column to partition.

Parameters:

column - the column name.

setPartitions

public void setPartitions(int partitions)

The number of partitions to create.

Parameters:

partitions - the number of partitions.

setJobExplorer

public void setJobExplorer(org.springframework.batch.core.explore.JobExplorer jobExplorer)

The job explorer to be used by the task.

Parameters:

jobExplorer - the job explorer to use.

setCheckColumn

public void setCheckColumn(String checkColumn)

The name of the check column to be used by the task.

Parameters:

checkColumn - the check column name

setOverrideValue

public void setOverrideValue(Long overrideValue)

The override value to be used by the task.

Parameters:

overrideValue - the override value.

partition

public Map<String,org.springframework.batch.item.ExecutionContext> partition(int gridSize)

Partition a database table assuming that the data in the column specified are uniformly distributed. The execution context values will have keys minValue and maxValue specifying the range of values to consider in each partition.

Specified by:

partition in interface org.springframework.batch.core.partition.support.Partitioner

See Also:

Partitioner.partition(int)

beforeStep

public void beforeStep(org.springframework.batch.core.StepExecution stepExecution)

Specified by:

beforeStep in interface org.springframework.batch.core.StepExecutionListener

afterStep

public org.springframework.batch.core.ExitStatus afterStep(org.springframework.batch.core.StepExecution stepExecution)

Specified by:

afterStep in interface org.springframework.batch.core.StepExecutionListener

afterPropertiesSet

public void afterPropertiesSet()
                        throws Exception

Specified by:

afterPropertiesSet in interface org.springframework.beans.factory.InitializingBean

Throws:

Exception