org.springframework.xd.module.spark.streaming

Class SparkStreamingDriverModule

java.lang.Object

org.springframework.xd.module.core.AbstractModule

org.springframework.xd.module.core.SimpleModule

org.springframework.xd.module.core.ResourceConfiguredModule

org.springframework.xd.module.spark.streaming.SparkStreamingDriverModule

All Implemented Interfaces:

org.springframework.context.Lifecycle, Module

public class SparkStreamingDriverModule
extends ResourceConfiguredModule

The driver that adapts an implementation of either Processor or org.springframework.xd.spark.streaming.scala.Processor to be executed as an XD module.

Author:

Ilayaperumal Gopinathan, Mark Fisher

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	MESSAGE_BUS_JARS_LOCATION

Constructor Summary

Constructors

Constructor and Description
SparkStreamingDriverModule(ModuleDescriptor descriptor, ModuleDeploymentProperties deploymentProperties, java.lang.ClassLoader classLoader, ModuleOptions moduleOptions) Create a SparkDriver

Method Summary

Methods

Modifier and Type	Method and Description
static java.util.Properties	getSparkModuleProperties(SparkStreamingSupport processor) Retrieve spark configuration properties from the Processor implementation.
boolean	shouldBind() Should the module require messagebus binding.
void	start()
void	stop()

Methods inherited from class org.springframework.xd.module.core.ResourceConfiguredModule

configureModuleApplicationContext, resourceBasedConfigurationFile

Methods inherited from class org.springframework.xd.module.core.SimpleModule

addListener, addProperties, addSource, destroy, getApplicationContext, getClassLoader, getComponent, getComponent, getProperties, initialize, isRunning, setParentContext

Methods inherited from class org.springframework.xd.module.core.AbstractModule

getDeploymentProperties, getDescriptor, getName, getType, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

MESSAGE_BUS_JARS_LOCATION

public static final java.lang.String MESSAGE_BUS_JARS_LOCATION

See Also:

Constant Field Values

Constructor Detail

SparkStreamingDriverModule

public SparkStreamingDriverModule(ModuleDescriptor descriptor,
                          ModuleDeploymentProperties deploymentProperties,
                          java.lang.ClassLoader classLoader,
                          ModuleOptions moduleOptions)

Create a SparkDriver

Parameters:

descriptor -

deploymentProperties -

classLoader -

moduleOptions -

Method Detail

start

public void start()

Specified by:

start in interface org.springframework.context.Lifecycle

Overrides:

start in class SimpleModule

getSparkModuleProperties

public static java.util.Properties getSparkModuleProperties(SparkStreamingSupport processor)

Retrieve spark configuration properties from the Processor implementation. This method uses SparkConfig annotation to derive the Properties returned from the annotated methods.

Parameters:

processor - the spark streaming processor

Returns:

the spark configuration properties (if defined) or empty properties

stop

public void stop()

Specified by:

stop in interface org.springframework.context.Lifecycle

Overrides:

stop in class SimpleModule

shouldBind

public boolean shouldBind()

Description copied from interface: Module

Should the module require messagebus binding.

Specified by:

shouldBind in interface Module

Overrides:

shouldBind in class AbstractModule