The Admin server application is run as a standalone application. All modules used for streams and tasks will be deployed on the YARN cluster that is targeted by the Admin server. configured to be used.
Unzip the distribution ZIP file and change to the directory containing the deployment files.
localhostyou need to configure them in
hdfsremove it using:
$ hdfs dfs -rm -R /dataflow
Create a stream:
dataflow:>stream create --name "ticktock" --definition "time | hdfs --rollover=100" --deploy
dataflow:>stream list Stream Name Stream Definition Status ----------- -------------------------- -------- ticktock time | hdfs --rollover=100 deployed
After some time, destroy the stream:
dataflow:>stream destroy --name ticktock
The YARN application is pushed and started automatically during a stream deployment process. Once all streams are destroyed the YARN application will exit.