org.springframework.yarn.batch.am

Class BatchAppmaster

java.lang.Object

org.springframework.yarn.support.LifecycleObjectSupport

org.springframework.yarn.am.AbstractAppmaster

org.springframework.yarn.am.AbstractServicesAppmaster

org.springframework.yarn.am.AbstractEventingAppmaster

org.springframework.yarn.batch.am.AbstractBatchAppmaster

org.springframework.yarn.batch.am.BatchAppmaster

All Implemented Interfaces:

java.util.EventListener, org.springframework.beans.factory.Aware, org.springframework.beans.factory.BeanFactoryAware, org.springframework.beans.factory.InitializingBean, org.springframework.context.ApplicationListener<AbstractYarnEvent>, org.springframework.context.Lifecycle, org.springframework.context.Phased, org.springframework.context.SmartLifecycle, ContainerLauncherInterceptor, YarnAppmaster, BatchYarnAppmaster

public class BatchAppmaster
extends AbstractBatchAppmaster
implements YarnAppmaster

Implementation of application master which can be used to run Spring Batch jobs on Hadoop Yarn cluster.

Application master will act as a context running the Spring Batch job. Order to make some sense in terms of using cluster resources, job itself should be able to partition itself in a way that Yarn containers can be used to split the load.

Author:

Janne Valkealahti

Constructor Summary

Constructors

Constructor and Description
BatchAppmaster()

Method Summary

Methods

Modifier and Type	Method and Description
protected void	doStart() Subclasses may implement this method with the start behavior.
protected void	doStop() Subclasses may implement this method with the stop behavior.
void	onApplicationEvent(AbstractYarnEvent event)
void	submitApplication() Submit and run application.

Methods inherited from class org.springframework.yarn.batch.am.AbstractBatchAppmaster

addPartitionedStepExecutionStateListener, addStepSplits, getStepExecutions, getYarnJobLauncher, onContainerAllocated, onContainerCompleted, onContainerLaunched, onInit, preLaunch, setYarnJobLauncher

Methods inherited from class org.springframework.yarn.am.AbstractEventingAppmaster

getRegisteredContainers, onContainerLaunchRequestFailed, shutdownContainers

Methods inherited from class org.springframework.yarn.am.AbstractServicesAppmaster

getAllocator, getLauncher, getMonitor, setAllocator, setLauncher, setMonitor

Methods inherited from class org.springframework.yarn.am.AbstractAppmaster

addAppmasterStateListener, finishAppmaster, getApplicationAttemptId, getAppmasterClientService, getAppmasterService, getAppmasterTrackService, getCmTemplate, getCommands, getCommands, getConfiguration, getContainerAssign, getContainerShutdown, getEnvironment, getEnvironment, getParameters, getResourceLocalizer, getTemplate, notifyCompleted, registerAppmaster, setCommands, setCommands, setCommands, setCommands, setConfiguration, setContainerAssign, setEnvironment, setEnvironment, setFinalApplicationStatus, setParameters, setResourceLocalizer, setTemplate

Methods inherited from class org.springframework.yarn.support.LifecycleObjectSupport

afterPropertiesSet, getBeanFactory, getPhase, getTaskExecutor, getTaskScheduler, getYarnEventPublisher, isAutoStartup, isRunning, setAutoStartup, setBeanFactory, setPhase, setTaskExecutor, setTaskScheduler, setYarnEventPublisher, start, stop, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.springframework.yarn.am.YarnAppmaster

addAppmasterStateListener, setEnvironment, setParameters

Constructor Detail

BatchAppmaster

public BatchAppmaster()

Method Detail

submitApplication

public void submitApplication()

Description copied from interface: YarnAppmaster

Submit and run application.

Specified by:

submitApplication in interface YarnAppmaster

onApplicationEvent

public void onApplicationEvent(AbstractYarnEvent event)

Specified by:

onApplicationEvent in interface org.springframework.context.ApplicationListener<AbstractYarnEvent>

Overrides:

onApplicationEvent in class AbstractEventingAppmaster

doStart

protected void doStart()

Description copied from class: LifecycleObjectSupport

Subclasses may implement this method with the start behavior. This method will be invoked while holding the LifecycleObjectSupport.lifecycleLock.

Overrides:

doStart in class LifecycleObjectSupport

doStop

protected void doStop()

Description copied from class: LifecycleObjectSupport

Subclasses may implement this method with the stop behavior. This method will be invoked while holding the LifecycleObjectSupport.lifecycleLock.

Overrides:

doStop in class AbstractAppmaster