Spring Cloud Data Flow for Apache YARN
		Next

Spring Cloud Data Flow for Apache YARN

Sabby Anandan, Marius Bogoevici, Eric Bottard, Mark Fisher, Ilayaperumal Gopinathan, Gunnar Hillert, Mark Pollack, Patrick Peralta, Glenn Renfro, Thomas Risberg, Dave Syer, David Turanski, Janne Valkealahti

1.0.0.RC1

Copyright © 2013-2015 Pivotal Software, Inc.

Copies of this document may be made for your own use and for distribution to others, provided that you do not charge any fee for such copies and further provided that each copy contains this Copyright Notice, whether distributed in print or electronically.

Table of Contents

1. About the documentation
2. Getting help

II. Introduction

3. Introducing Spring Cloud Data Flow for Apache YARN project
4. Spring Cloud Data Flow
5. Spring Cloud Stream
6. Spring Cloud Task

III. Spring Cloud Data Flow Runtime

7. Deploying on YARN

7.1. Prerequisites
7.2. Download and Extract Distribution
7.3. Configure Settings
7.4. Start Server
7.5. Connect Shell
7.6. Register Applications
7.7. Create Stream
7.8. Create Task
7.9. Check YARN App Statuses

8. Deploying on AMBARI

8.1. Install Ambari Server
8.2. Deploy Data Flow

IV. Streams

9. Introduction

10. Stream DSL

11. Register a Stream App

11.1. Whitelisting application properties

12. Creating a Stream

13. Destroying a Stream

14. Deploying and Undeploying Streams

15. Other Source and Sink Application Types

16. Simple Stream Processing

17. Stateful Stream Processing

18. Tap a Stream

19. Using Labels in a Stream

20. Explicit Broker Destinations in a Stream

21. Directed Graphs in a Stream

21.1. Common application properties

22. Introducing Spring Cloud Task

23. The Lifecycle of a task

23.1. Registering a Task Application
23.2. Creating a Task
23.3. Launching a Task
23.4. Reviewing Task Executions
23.5. Destroying a Task

24. Task Repository

24.1. Configuring the Task Execution Repository

24.1.1. Local

24.2. Datasource

25. Subscribing to Task/Batch Events

VI. Dashboard

26. Introduction

28. Runtime

29. Streams

30. Create Stream

31.1.1. Create a Task Definition from a selected Task App
31.1.2. View Task App Details

31.2. Definitions

31.2.1. Launching Tasks

31.3. Executions

32.1. List job executions

32.1.1. Job execution details
32.1.2. Step execution details
32.1.3. Step Execution Progress

33. Analytics

VII. Appendices

A. Building

A.1. Documentation

A.2. Working with the code

A.2.1. Importing into eclipse with m2eclipse
A.2.2. Importing into eclipse without m2eclipse

B. Contributing

B.1. Sign the Contributor License Agreement
B.2. Code Conventions and Housekeeping

		Next
		Part I. Preface