Spring Cloud Data Flow Reference Guide

Sabby Anandan, Marius Bogoevici, Eric Bottard, Mark Fisher, Ilayaperumal Gopinathan, Gunnar Hillert, Mark Pollack, Patrick Peralta, Glenn Renfro, Thomas Risberg, Dave Syer, David Turanski, Janne Valkealahti

1.0.0.M2

Copies of this document may be made for your own use and for distribution to others, provided that you do not charge any fee for such copies and further provided that each copy contains this Copyright Notice, whether distributed in print or electronically.


Table of Contents

I. Preface
1. About the documentation
2. Getting help
II. Spring Cloud Data Flow Overview
3. Introducing Spring Cloud Data Flow
3.1. Features
4. Spring Cloud Data Flow Architecture
4.1. Components
III. Getting started
5. System Requirements
6. Building Spring Cloud Data Flow
7. Deploying Spring Cloud Data Flow
7.1. Deploying 'local'
7.2. Deploying on Cloud Foundry
7.2.1. Deploying Admin app on Cloud Foundry
7.2.2. Running Admin app locally
7.2.3. Running Spring Cloud Data Flow Shell locally
7.2.4. Spring Cloud Data Flow Admin app configuration settings for Cloud Foundry
7.3. Deploying on YARN
IV. Using Spring Cloud Stream Modules
8. Sources
8.1. FTP (ftp)
8.1.1. Options
8.2. HTTP (http)
8.3. Time (time)
8.4. Twitter Stream (twitterstream)
9. Processors
9.1. Filter (filter)
9.1.1. Filter with SpEL expression
9.2. groovy-filter
9.3. groovy-transform
9.4. Transform (transform)
9.4.1. Transform with SpEL expression
10. Sinks
10.1. Counter (counter)
10.2. Hadoop (HDFS) (hdfs)
10.2.1. Options
10.2.2. Partition Path Expression
Accessing Properties
Custom Methods
10.3. Log (log)
10.4. Redis (redis)
10.4.1. Options
11. Tasks
11.1. Timestamp (timestamp)
V. Appendices
A. Building
A.1. Documentation
A.2. Working with the code
A.2.1. Importing into eclipse with m2eclipse
A.2.2. Importing into eclipse without m2eclipse
B. Contributing
B.1. Sign the Contributor License Agreement
B.2. Code Conventions and Housekeeping