Sandboxes are a single VM images to ease testing and demos without going through a full multi-machine cluster setup. However these images have a natural restrictions of resources which are a cornerstone of YARN to be able to run applications on it. With same limitations and a carefull configuration it is possible to install Spring Cloud Data Flow on those sandboxes. In this section we try to provide some instructions how this can be accomplished.
Install plugin repository.
$ wget -nv http://repo.spring.io/yum-snapshot-local/scdf/1.2.1/scdf-snapshot-1.2.1.repo -O /etc/yum.repos.d/scdf-snapshot-1.2.1.repo
Install plugin.
$ ambari-server stop $ yum -y install scdf-plugin-hdp $ ambari-server start
Add needed services together spring Spring Cloud Data Flow. Tune server jvm options. Spring Cloud Data Flow → Configs → Advanced scdf-server-env → scdf-server-env template:
export JAVA_OPTS="-Xms512m -Xmx512m"
Tune jvm options for application masters and container. Spring Cloud Data Flow → Configs → Custom scdf-site:
spring.cloud.deployer.yarn.app.streamappmaster.javaOpts=-Xms512m -Xmx512m spring.cloud.deployer.yarn.app.streamcontainer.javaOpts=-Xms512m -Xmx512m spring.cloud.deployer.yarn.app.taskappmaster.javaOpts=-Xms512m -Xmx512m spring.cloud.deployer.yarn.app.taskcontainer.javaOpts=-Xms512m -Xmx512m