|
Spring for Apache Hadoop | ||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.springframework.yarn.batch.partition.AbstractBatchPartitionHandler
public abstract class AbstractBatchPartitionHandler
Base implementation of Spring Batch PartitionHandler
handling
partitioning for Yarn containers.
Constructor Summary | |
---|---|
AbstractBatchPartitionHandler(AbstractBatchAppmaster batchAppmaster)
Instantiates a new batch partition handler. |
Method Summary | |
---|---|
protected java.util.Map<org.springframework.batch.core.StepExecution,ContainerRequestHint> |
createResourceRequestData(java.util.Set<org.springframework.batch.core.StepExecution> stepExecutions)
Subclass may override this method to assign a specific ContainerRequestHint to
a StepExecution . |
protected abstract java.util.Set<org.springframework.batch.core.StepExecution> |
createStepExecutionSplits(org.springframework.batch.core.partition.StepExecutionSplitter stepSplitter,
org.springframework.batch.core.StepExecution stepExecution)
|
ContainerResolver |
getContainerResolver()
Gets the container resolver. |
java.lang.String |
getStepName()
Gets the step name. |
java.util.Collection<org.springframework.batch.core.StepExecution> |
handle(org.springframework.batch.core.partition.StepExecutionSplitter stepSplitter,
org.springframework.batch.core.StepExecution stepExecution)
|
void |
setContainerResolver(ContainerResolver containerResolver)
Sets the container resolver. |
void |
setStepName(java.lang.String stepName)
Sets the step name. |
protected void |
waitCompleteState(org.springframework.batch.core.StepExecution masterStepExecution)
Uses CountDownLatch to wait completion status from
application master. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public AbstractBatchPartitionHandler(AbstractBatchAppmaster batchAppmaster)
batchAppmaster
- the batch appmasterMethod Detail |
---|
protected abstract java.util.Set<org.springframework.batch.core.StepExecution> createStepExecutionSplits(org.springframework.batch.core.partition.StepExecutionSplitter stepSplitter, org.springframework.batch.core.StepExecution stepExecution) throws java.lang.Exception
java.lang.Exception
protected java.util.Map<org.springframework.batch.core.StepExecution,ContainerRequestHint> createResourceRequestData(java.util.Set<org.springframework.batch.core.StepExecution> stepExecutions) throws java.lang.Exception
ContainerRequestHint
to
a StepExecution
. This would be needed in cases where step should be executed
in a specific host or rack considering data locality. Default implementation
returns an empty map.
stepExecutions
- Set of step executions
java.lang.Exception
- If error occurredpublic final java.util.Collection<org.springframework.batch.core.StepExecution> handle(org.springframework.batch.core.partition.StepExecutionSplitter stepSplitter, org.springframework.batch.core.StepExecution stepExecution) throws java.lang.Exception
handle
in interface org.springframework.batch.core.partition.PartitionHandler
java.lang.Exception
public java.lang.String getStepName()
public void setStepName(java.lang.String stepName)
stepName
- the new step namepublic ContainerResolver getContainerResolver()
public void setContainerResolver(ContainerResolver containerResolver)
containerResolver
- the new container resolverprotected void waitCompleteState(org.springframework.batch.core.StepExecution masterStepExecution)
CountDownLatch
to wait completion status from
application master. Status is considered to be complete if either
master itself or parent step execution sends complete status.
masterStepExecution
- the parent step execution
|
Spring for Apache Hadoop | ||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |