org.springframework.data.hadoop.store.output

Class TextFileWriter

java.lang.Object

org.springframework.data.hadoop.store.support.LifecycleObjectSupport

org.springframework.data.hadoop.store.support.StoreObjectSupport

org.springframework.data.hadoop.store.support.OutputStoreObjectSupport

org.springframework.data.hadoop.store.output.AbstractDataStreamWriter

org.springframework.data.hadoop.store.output.TextFileWriter

All Implemented Interfaces:

java.io.Closeable, java.io.Flushable, java.lang.AutoCloseable, org.springframework.beans.factory.Aware, org.springframework.beans.factory.BeanFactoryAware, org.springframework.beans.factory.InitializingBean, org.springframework.context.Lifecycle, org.springframework.context.Phased, org.springframework.context.SmartLifecycle, DataStoreWriter<java.lang.String>, DataWriter<java.lang.String>

public class TextFileWriter
extends AbstractDataStreamWriter
implements DataStoreWriter<java.lang.String>

A TextFileWriter is a DataStoreWriter implementation able to write Strings into raw hdfs files.

Author:

Janne Valkealahti, Rodrigo Meneses

Field Summary

Fields inherited from class org.springframework.data.hadoop.store.output.AbstractDataStreamWriter

DEFAULT_MAX_OPEN_ATTEMPTS

Constructor Summary

Constructors

Constructor and Description
TextFileWriter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec) Instantiates a new text file writer.
TextFileWriter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec, byte[] delimiter) Instantiates a new text file writer.
TextFileWriter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec, byte[] delimiter, long idleTimeout) Instantiates a new text file writer.

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
void	flush()
protected void	flushTimeout() Handle flush timeout.
protected void	handleTimeout() Handle idle timeout.
void	write(java.lang.String entity) Write an entity.

Methods inherited from class org.springframework.data.hadoop.store.output.AbstractDataStreamWriter

getOutput, getPosition, setMaxOpenAttempts

Methods inherited from class org.springframework.data.hadoop.store.support.OutputStoreObjectSupport

findInitFiles, getOutputContext, getResolvedPath, initOutputContext, isAppendable, isFileWriteable, isOverwrite, isSyncable, onInit, renameFile, setAppendable, setFileNamingStrategy, setInWritingPrefix, setInWritingSuffix, setOverwrite, setRolloverStrategy, setSyncable, setWritePosition

Methods inherited from class org.springframework.data.hadoop.store.support.StoreObjectSupport

doStart, doStop, getCodec, getConfiguration, getPath, isCompressed, resetIdleTimeout, setCloseTimeout, setFlushTimeout, setIdleTimeout

Methods inherited from class org.springframework.data.hadoop.store.support.LifecycleObjectSupport

afterPropertiesSet, getBeanFactory, getPhase, getStoreEventPublisher, getTaskExecutor, getTaskScheduler, isAutoStartup, isRunning, setAutoStartup, setBeanFactory, setPhase, setStoreEventPublisher, setTaskExecutor, setTaskScheduler, start, stop, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TextFileWriter

public TextFileWriter(org.apache.hadoop.conf.Configuration configuration,
              org.apache.hadoop.fs.Path basePath,
              CodecInfo codec)

Instantiates a new text file writer.

Parameters:

configuration - the hadoop configuration

basePath - the hdfs path

codec - the compression codec info

TextFileWriter

public TextFileWriter(org.apache.hadoop.conf.Configuration configuration,
              org.apache.hadoop.fs.Path basePath,
              CodecInfo codec,
              byte[] delimiter)

Instantiates a new text file writer.

Parameters:

configuration - the hadoop configuration

basePath - the hdfs path

codec - the compression codec info

delimiter - the delimiter

TextFileWriter

public TextFileWriter(org.apache.hadoop.conf.Configuration configuration,
              org.apache.hadoop.fs.Path basePath,
              CodecInfo codec,
              byte[] delimiter,
              long idleTimeout)

Instantiates a new text file writer.

Parameters:

configuration - the hadoop configuration

basePath - the hdfs path

codec - the compression codec info

delimiter - the delimiter

idleTimeout - the idle timeout

Method Detail

flush

public void flush()
           throws java.io.IOException

Specified by:

flush in interface java.io.Flushable

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Throws:

java.io.IOException

write

public void write(java.lang.String entity)
           throws java.io.IOException

Description copied from interface: DataWriter

Write an entity.

Specified by:

write in interface DataWriter<java.lang.String>

Parameters:

entity - the entity to write

Throws:

java.io.IOException - if an I/O error occurs

handleTimeout

protected void handleTimeout()

Description copied from class: StoreObjectSupport

Handle idle timeout. This method should be overriden to be notified of idle timeouts. Default implementation doesn't do anything.

Overrides:

handleTimeout in class StoreObjectSupport

flushTimeout

protected void flushTimeout()

Description copied from class: StoreObjectSupport

Handle flush timeout. This method should be overriden to be notified of flush timeouts. Default implementation doesn't do anything.

Overrides:

flushTimeout in class StoreObjectSupport