org.springframework.xd.spark.streaming.examples.java

Class WordCount

java.lang.Object

org.springframework.xd.spark.streaming.examples.java.WordCount

All Implemented Interfaces:

java.io.Serializable, Processor<org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>,org.apache.spark.streaming.api.java.JavaPairDStream<java.lang.String,java.lang.Integer>>, SparkStreamingSupport

public class WordCount
extends java.lang.Object
implements Processor<org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>,org.apache.spark.streaming.api.java.JavaPairDStream<java.lang.String,java.lang.Integer>>

Since:

1.1

Author:

Mark Fisher

See Also:

Serialized Form

Field Summary

Fields inherited from interface org.springframework.xd.spark.streaming.SparkStreamingSupport

MODULE_EXECUTION_FRAMEWORK, SPARK_DEFAULT_MASTER_URL, SPARK_DEFAULT_STORAGE_LEVEL, SPARK_MASTER_URL_PROP, SPARK_STORAGE_LEVEL_MODULE_OPTION, SPARK_STORAGE_LEVEL_PROP, SPARK_STREAMING_BATCH_INTERVAL_MODULE_OPTION, SPARK_STREAMING_BATCH_INTERVAL_PROP, SPARK_STREAMING_DEFAULT_BATCH_INTERVAL

Constructor Summary

Constructors

Constructor and Description
WordCount()

Method Summary

Methods

Modifier and Type	Method and Description
java.util.Properties	getSparkConfigProperties()
org.apache.spark.streaming.api.java.JavaPairDStream<java.lang.String,java.lang.Integer>	process(org.apache.spark.streaming.api.java.JavaDStream<java.lang.String> input) Processes the input DStream and optionally returns an output DStream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WordCount

public WordCount()

Method Detail

process

public org.apache.spark.streaming.api.java.JavaPairDStream<java.lang.String,java.lang.Integer> process(org.apache.spark.streaming.api.java.JavaDStream<java.lang.String> input)

Description copied from interface: Processor

Processes the input DStream and optionally returns an output DStream.

Specified by:

process in interface Processor<org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>,org.apache.spark.streaming.api.java.JavaPairDStream<java.lang.String,java.lang.Integer>>

Parameters:

input - the input DStream

Returns:

output DStream (optional, may be null)

getSparkConfigProperties

public java.util.Properties getSparkConfigProperties()