org.springframework.xd.test.fixtures

Class HdfsMongoDbJob

java.lang.Object

org.springframework.xd.test.fixtures.AbstractModuleFixture<HdfsMongoDbJob>

org.springframework.xd.test.fixtures.HdfsMongoDbJob

public class HdfsMongoDbJob
extends AbstractModuleFixture<HdfsMongoDbJob>

A test fixture that represents the HdfsMongoDb Job

Author:

Glenn Renfro

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DEFAULT_COLLECTION_NAME
static java.lang.String	DEFAULT_DIRECTORY
static java.lang.String	DEFAULT_FILE_NAME
static java.lang.String	DEFAULT_ID_FIELD
static java.lang.String	DEFAULT_NAMES

Fields inherited from class org.springframework.xd.test.fixtures.AbstractModuleFixture

label

Constructor Summary

Constructors

Constructor and Description
HdfsMongoDbJob(java.lang.String dir, java.lang.String fileName, java.lang.String collectionName, java.lang.String names, java.lang.String idField, org.springframework.data.mongodb.MongoDbFactory mongoDbFactory) Construct a new HdfsMongoDbJob using the provided directory and file names.

Method Summary

Methods

Modifier and Type	Method and Description
HdfsMongoDbJob	collectionName(java.lang.String collectionName) Sets the name of the collection where the data will be written.
HdfsMongoDbJob	dir(java.lang.String dir) Sets the directory where the file will be read from the hdfs.
void	dropCollection(java.lang.String collectionName) The drops the collection.
HdfsMongoDbJob	fileName(java.lang.String fileName) Sets the fileName of the file to be read
java.util.Map<java.lang.String,java.lang.String>	getSingleObject(java.lang.String collectionName) Returns a single object from the collection.
HdfsMongoDbJob	host(java.lang.String host) Sets the host where the mongo server is running
HdfsMongoDbJob	idField(java.lang.String idField) Sets the idField for the data that will be inserted by this job
void	isReady() Checks to see if the default mongo port 2000 is available on the configured host waiting up to 2 seconds
HdfsMongoDbJob	names(java.lang.String names) Sets the column names that will be written to.
HdfsMongoDbJob	port(int port) Sets the port that the HdfsMongoDb Job will transmit mongo commands
java.lang.String	toDSL() Renders the default DSL for this fixture.
static HdfsMongoDbJob	withDefaults(org.springframework.data.mongodb.MongoDbFactory mongoDbFactory) Creates a HdfsMongoDb Instance using defaults.

Methods inherited from class org.springframework.xd.test.fixtures.AbstractModuleFixture

label, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

DEFAULT_DIRECTORY

public static final java.lang.String DEFAULT_DIRECTORY

See Also:

Constant Field Values

DEFAULT_FILE_NAME

public static final java.lang.String DEFAULT_FILE_NAME

See Also:

Constant Field Values

DEFAULT_COLLECTION_NAME

public static final java.lang.String DEFAULT_COLLECTION_NAME

See Also:

Constant Field Values

DEFAULT_NAMES

public static final java.lang.String DEFAULT_NAMES

See Also:

Constant Field Values

DEFAULT_ID_FIELD

public static final java.lang.String DEFAULT_ID_FIELD

See Also:

Constant Field Values

Constructor Detail

HdfsMongoDbJob

public HdfsMongoDbJob(java.lang.String dir,
              java.lang.String fileName,
              java.lang.String collectionName,
              java.lang.String names,
              java.lang.String idField,
              org.springframework.data.mongodb.MongoDbFactory mongoDbFactory)

Construct a new HdfsMongoDbJob using the provided directory and file names.

Parameters:

dir - the directory where the source file is located on hdfs

fileName - The file from which data will be pulled.

collectionName - the collection where the data will be written.

names - a comma delimited list of column names that are contained in the source file.

mongoDbFactory - The db factory for mongo

Method Detail

withDefaults

public static HdfsMongoDbJob withDefaults(org.springframework.data.mongodb.MongoDbFactory mongoDbFactory)

Creates a HdfsMongoDb Instance using defaults.

Parameters:

mongoDbFactory - The mongoDbFactory that will be used to connect to mongo.

Returns:

HdfsMongoDb Instance

toDSL

public java.lang.String toDSL()

Renders the default DSL for this fixture.

Specified by:

toDSL in class AbstractModuleFixture<HdfsMongoDbJob>

dir

public HdfsMongoDbJob dir(java.lang.String dir)

Sets the directory where the file will be read from the hdfs.

Parameters:

dir - the directory path.

Returns:

The current instance of the HdfsMongoDbJob

fileName

public HdfsMongoDbJob fileName(java.lang.String fileName)

Sets the fileName of the file to be read

Parameters:

fileName - the name of the file

Returns:

The current instance of the HdfsMongoDbJob

collectionName

public HdfsMongoDbJob collectionName(java.lang.String collectionName)

Sets the name of the collection where the data will be written.

Parameters:

collectionName - The name of the collection

Returns:

The current instance of the HdfsMongoDbJob

names

public HdfsMongoDbJob names(java.lang.String names)

Sets the column names that will be written to.

Parameters:

names - Comma delimited list of column names.

Returns:

The current instance of the HdfsMongoDbJob

idField

public HdfsMongoDbJob idField(java.lang.String idField)

Sets the idField for the data that will be inserted by this job

Parameters:

idField - The column that represents the id field;

Returns:

The current instance of HdfsMongoDbJob

host

public HdfsMongoDbJob host(java.lang.String host)

Sets the host where the mongo server is running

Parameters:

host - The mongo host server

Returns:

The current instance of HdfsMongoDbJob

port

public HdfsMongoDbJob port(int port)

Sets the port that the HdfsMongoDb Job will transmit mongo commands

Parameters:

port - The port mongodb is monitoring

Returns:

the current instance of HdfsMongoDbJob

isReady

public void isReady()

Checks to see if the default mongo port 2000 is available on the configured host waiting up to 2 seconds

Throws:

java.lang.IllegalStateException - if can not connect in the specified timeout.

dropCollection

public void dropCollection(java.lang.String collectionName)

The drops the collection.

Parameters:

collectionName - the name of the database to drop.

getSingleObject

public java.util.Map<java.lang.String,java.lang.String> getSingleObject(java.lang.String collectionName)

Returns a single object from the collection.

Parameters:

collectionName - the name of the collection to query

Returns:

A Map with the content of the result

Throws:

java.lang.IllegalStateException - if the number of objects in the collection is not one