Spring for Apache Hadoop

org.springframework.data.hadoop.store.output
Class TextFileWriter

java.lang.Object
  extended by org.springframework.data.hadoop.store.support.LifecycleObjectSupport
      extended by org.springframework.data.hadoop.store.support.StoreObjectSupport
          extended by org.springframework.data.hadoop.store.support.OutputStoreObjectSupport
              extended by org.springframework.data.hadoop.store.output.AbstractDataStreamWriter
                  extended by org.springframework.data.hadoop.store.output.TextFileWriter
All Implemented Interfaces:
java.io.Closeable, java.io.Flushable, org.springframework.beans.factory.Aware, org.springframework.beans.factory.BeanFactoryAware, org.springframework.beans.factory.InitializingBean, org.springframework.context.Lifecycle, org.springframework.context.Phased, org.springframework.context.SmartLifecycle, DataStoreWriter<java.lang.String>, DataWriter<java.lang.String>

public class TextFileWriter
extends AbstractDataStreamWriter
implements DataStoreWriter<java.lang.String>

A TextFileWriter is a DataStoreWriter implementation able to write Strings into raw hdfs files.

Author:
Janne Valkealahti

Constructor Summary
TextFileWriter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec)
          Instantiates a new text file writer.
TextFileWriter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec, byte[] delimiter)
          Instantiates a new text file writer.
 
Method Summary
 void close()
           
 void flush()
           
protected  void handleIdleTimeout()
          Handle idle timeout.
 void write(java.lang.String entity)
          Write an entity.
 
Methods inherited from class org.springframework.data.hadoop.store.output.AbstractDataStreamWriter
getOutput, getPosition
 
Methods inherited from class org.springframework.data.hadoop.store.support.OutputStoreObjectSupport
getOutputContext, getResolvedPath, onInit, renameFile, setFileNamingStrategy, setInWritingPrefix, setInWritingSuffix, setOverwrite, setRolloverStrategy, setWritePosition
 
Methods inherited from class org.springframework.data.hadoop.store.support.StoreObjectSupport
doStart, doStop, getCodec, getConfiguration, getPath, isCompressed, resetIdleTimeout, setIdleTimeout
 
Methods inherited from class org.springframework.data.hadoop.store.support.LifecycleObjectSupport
afterPropertiesSet, getBeanFactory, getPhase, getStoreEventPublisher, getTaskExecutor, getTaskScheduler, isAutoStartup, isRunning, setAutoStartup, setBeanFactory, setPhase, setStoreEventPublisher, setTaskExecutor, setTaskScheduler, start, stop, stop
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

TextFileWriter

public TextFileWriter(org.apache.hadoop.conf.Configuration configuration,
                      org.apache.hadoop.fs.Path basePath,
                      CodecInfo codec)
Instantiates a new text file writer.

Parameters:
configuration - the hadoop configuration
basePath - the hdfs path
codec - the compression codec info

TextFileWriter

public TextFileWriter(org.apache.hadoop.conf.Configuration configuration,
                      org.apache.hadoop.fs.Path basePath,
                      CodecInfo codec,
                      byte[] delimiter)
Instantiates a new text file writer.

Parameters:
configuration - the hadoop configuration
basePath - the hdfs path
codec - the compression codec info
delimiter - the delimiter
Method Detail

flush

public void flush()
           throws java.io.IOException
Specified by:
flush in interface java.io.Flushable
Throws:
java.io.IOException

close

public void close()
           throws java.io.IOException
Specified by:
close in interface java.io.Closeable
Throws:
java.io.IOException

write

public void write(java.lang.String entity)
           throws java.io.IOException
Description copied from interface: DataWriter
Write an entity.

Specified by:
write in interface DataWriter<java.lang.String>
Throws:
java.io.IOException - if an I/O error occurs

handleIdleTimeout

protected void handleIdleTimeout()
Description copied from class: StoreObjectSupport
Handle idle timeout. This method should be overriden to be notified of idle timeouts. Default implementation doesn't do anything.

Overrides:
handleIdleTimeout in class StoreObjectSupport

Spring for Apache Hadoop