org.springframework.xd.spark.streaming.java

Interface Processor<I extends org.apache.spark.streaming.api.java.JavaDStreamLike,O extends org.apache.spark.streaming.api.java.JavaDStreamLike>

All Superinterfaces:

java.io.Serializable, SparkStreamingSupport

All Known Implementing Classes:

FileLogger, WordCount

public interface Processor<I extends org.apache.spark.streaming.api.java.JavaDStreamLike,O extends org.apache.spark.streaming.api.java.JavaDStreamLike>
extends SparkStreamingSupport

Interface for the Java based modules using the Spark Streaming API to process messages from the Message Bus.

Since:

1.1

Author:

Mark Fisher

Field Summary

Fields inherited from interface org.springframework.xd.spark.streaming.SparkStreamingSupport

MODULE_EXECUTION_FRAMEWORK, SPARK_DEFAULT_MASTER_URL, SPARK_DEFAULT_STORAGE_LEVEL, SPARK_MASTER_URL_PROP, SPARK_STORAGE_LEVEL_MODULE_OPTION, SPARK_STORAGE_LEVEL_PROP, SPARK_STREAMING_BATCH_INTERVAL_MODULE_OPTION, SPARK_STREAMING_BATCH_INTERVAL_PROP, SPARK_STREAMING_DEFAULT_BATCH_INTERVAL

Method Summary

Methods

Modifier and Type	Method and Description
O	process(I input) Processes the input DStream and optionally returns an output DStream.

Method Detail

process

O process(I input)

Processes the input DStream and optionally returns an output DStream.

Parameters:

input - the input DStream

Returns:

output DStream (optional, may be null)