org.springframework.xd.dirt.spark

Class SparkStreamingContainerFilter

java.lang.Object

org.springframework.xd.dirt.spark.SparkStreamingContainerFilter

All Implemented Interfaces:

ContainerFilter

public class SparkStreamingContainerFilter
extends java.lang.Object
implements ContainerFilter

A ContainerFilter which filters out the containers that have a spark streaming module running. This is necessary as multiple spark contexts can not be created on the same JVM. See SPARK-2243.

Author:

Ilayaperumal Gopinathan

Constructor Summary

Constructors

Constructor and Description
SparkStreamingContainerFilter()

Method Summary

Methods

Modifier and Type	Method and Description
java.util.List<Container>	filterContainers(ModuleDescriptor moduleDescriptor, java.lang.Iterable<Container> availableContainers) Return the list of containers that can deploy this module.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkStreamingContainerFilter

public SparkStreamingContainerFilter()

Method Detail

filterContainers

public java.util.List<Container> filterContainers(ModuleDescriptor moduleDescriptor,
                                         java.lang.Iterable<Container> availableContainers)

Return the list of containers that can deploy this module. If the underlying module is a spark streaming module then make sure the list doesn't have a container that has a spark streaming module already deployed.

Specified by:

filterContainers in interface ContainerFilter

Parameters:

moduleDescriptor - the module descriptor

availableContainers - the matched containers

Returns:

the list of eligible containers for this module deployment.