org.springframework.data.hadoop.store.output

Class DelimitedTextFileWriter

java.lang.Object

org.springframework.data.hadoop.store.output.DelimitedTextFileWriter

All Implemented Interfaces:

java.io.Closeable, java.io.Flushable, java.lang.AutoCloseable, DataStoreWriter<java.util.List<java.lang.String>>, DataWriter<java.util.List<java.lang.String>>

public class DelimitedTextFileWriter
extends java.lang.Object
implements DataStoreWriter<java.util.List<java.lang.String>>

A DelimitedTextFileWriter is a DataStoreWriter implementation able to write Strings into raw hdfs files as delimited fields.

Author:

Janne Valkealahti

Field Summary

Fields

Modifier and Type	Field and Description
static byte[]	CSV CSV Mode
static byte[]	TAB TAB Mode

Constructor Summary

Constructors

Constructor and Description
DelimitedTextFileWriter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec) Instantiates a new delimited text file writer.
DelimitedTextFileWriter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec, byte[] fieldDelimiter) Instantiates a new delimited text file writer.
DelimitedTextFileWriter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec, byte[] fieldDelimiter, byte[] textDelimiter) Instantiates a new delimited text file writer.

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
void	flush()
void	write(java.util.List<java.lang.String> entity) Write an entity.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CSV

public static final byte[] CSV

CSV Mode

TAB

public static final byte[] TAB

TAB Mode

Constructor Detail

DelimitedTextFileWriter

public DelimitedTextFileWriter(org.apache.hadoop.conf.Configuration configuration,
                       org.apache.hadoop.fs.Path basePath,
                       CodecInfo codec)

Instantiates a new delimited text file writer.

Parameters:

configuration - the configuration

basePath - the base path

codec - the codec

DelimitedTextFileWriter

public DelimitedTextFileWriter(org.apache.hadoop.conf.Configuration configuration,
                       org.apache.hadoop.fs.Path basePath,
                       CodecInfo codec,
                       byte[] fieldDelimiter)

Instantiates a new delimited text file writer.

Parameters:

configuration - the configuration

basePath - the base path

codec - the codec

fieldDelimiter - the field delimiter

DelimitedTextFileWriter

public DelimitedTextFileWriter(org.apache.hadoop.conf.Configuration configuration,
                       org.apache.hadoop.fs.Path basePath,
                       CodecInfo codec,
                       byte[] fieldDelimiter,
                       byte[] textDelimiter)

Instantiates a new delimited text file writer.

Parameters:

configuration - the configuration

basePath - the base path

codec - the codec

fieldDelimiter - the field delimiter

textDelimiter - the text delimiter

Method Detail

write

public void write(java.util.List<java.lang.String> entity)
           throws java.io.IOException

Description copied from interface: DataWriter

Write an entity.

Specified by:

write in interface DataWriter<java.util.List<java.lang.String>>

Parameters:

entity - the entity to write

Throws:

java.io.IOException - if an I/O error occurs

flush

public void flush()
           throws java.io.IOException

Specified by:

flush in interface java.io.Flushable

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Throws:

java.io.IOException