org.springframework.xd.spark.streaming.examples.java

Class FileLogger

java.lang.Object

org.springframework.xd.spark.streaming.examples.java.FileLogger

All Implemented Interfaces:

java.io.Serializable, Processor<org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>,org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>>, SparkStreamingSupport

public class FileLogger
extends java.lang.Object
implements Processor<org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>,org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>>

Since:

1.1

Author:

Mark Fisher, Ilayaperumal Gopinathan

See Also:

Serialized Form

Field Summary

Fields inherited from interface org.springframework.xd.spark.streaming.SparkStreamingSupport

MODULE_EXECUTION_FRAMEWORK, SPARK_DEFAULT_MASTER_URL, SPARK_DEFAULT_STORAGE_LEVEL, SPARK_MASTER_URL_PROP, SPARK_STORAGE_LEVEL_MODULE_OPTION, SPARK_STORAGE_LEVEL_PROP, SPARK_STREAMING_BATCH_INTERVAL_MODULE_OPTION, SPARK_STREAMING_BATCH_INTERVAL_PROP, SPARK_STREAMING_DEFAULT_BATCH_INTERVAL

Constructor Summary

Constructors

Constructor and Description
FileLogger()

Method Summary

Methods

Modifier and Type	Method and Description
java.util.Properties	getSparkConfigProperties()
org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>	process(org.apache.spark.streaming.api.java.JavaDStream<java.lang.String> input) Processes the input DStream and optionally returns an output DStream.
void	setPath(java.lang.String filePath)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileLogger

public FileLogger()

Method Detail

setPath

public void setPath(java.lang.String filePath)

getSparkConfigProperties

public java.util.Properties getSparkConfigProperties()

process

public org.apache.spark.streaming.api.java.JavaDStream<java.lang.String> process(org.apache.spark.streaming.api.java.JavaDStream<java.lang.String> input)

Description copied from interface: Processor

Processes the input DStream and optionally returns an output DStream.

Specified by:

process in interface Processor<org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>,org.apache.spark.streaming.api.java.JavaDStream<java.lang.String>>

Parameters:

input - the input DStream

Returns:

output DStream (optional, may be null)