org.springframework.xd.integration.util

Class HadoopUtils

java.lang.Object

org.springframework.xd.integration.util.HadoopUtils

public class HadoopUtils
extends java.lang.Object

HDFS shell utilities required for testing hdfs

Author:

Glenn Renfro

Constructor Summary

Constructors

Constructor and Description
HadoopUtils(XdEnvironment xdEnvironment) Initializes the hadoop utils with the name node that was specified in the environment.

Method Summary

Methods

Modifier and Type	Method and Description
boolean	fileExists(java.lang.String uri) Verifies that the file exists.
void	fileRemove(java.lang.String uri) Recursively removes files in a directory or if only a file just that file.
java.lang.String	getFileContentsFromHdfs(java.lang.String path) Retrieves the file from the hdfs file system.
org.apache.hadoop.fs.FileStatus	getFileStatus(java.lang.String filePath) Retrieves the file status for the file path specified.
java.util.Collection<org.apache.hadoop.fs.FileStatus>	listDir(java.lang.String path) Retrieves a list of entries in the hdfs at the path specified.
boolean	waitForPath(int waitTime, java.lang.String path) Waits up to the timeout for the resource to be written to hdfs.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopUtils

public HadoopUtils(XdEnvironment xdEnvironment)

Initializes the hadoop utils with the name node that was specified in the environment.

Parameters:

xdEnvironment - the environment for the test.

Method Detail

listDir

public java.util.Collection<org.apache.hadoop.fs.FileStatus> listDir(java.lang.String path)

Retrieves a list of entries in the hdfs at the path specified.

Parameters:

path - the path

Returns:

collection of entries for the requested path

fileExists

public boolean fileExists(java.lang.String uri)

Verifies that the file exists.

Parameters:

uri - The uri of the file to verify.

Returns:

True if it exists else false.

fileRemove

public void fileRemove(java.lang.String uri)

Recursively removes files in a directory or if only a file just that file.

Parameters:

uri - Path to the file or directory.

getFileContentsFromHdfs

public java.lang.String getFileContentsFromHdfs(java.lang.String path)

Retrieves the file from the hdfs file system.

Parameters:

path - The URI to the file to be retrieved.

Returns:

The string contents of the file.

waitForPath

public boolean waitForPath(int waitTime,
                  java.lang.String path)

Waits up to the timeout for the resource to be written to hdfs.

Parameters:

waitTime - The number of millis to wait.

path - the path to the resource .

Returns:

false if the path was not present. True if it was present.

getFileStatus

public org.apache.hadoop.fs.FileStatus getFileStatus(java.lang.String filePath)

Retrieves the file status for the file path specified.

Parameters:

filePath - path/file name of the file to interrogate

Returns:

the FileStatus for the file.