org.springframework.data.hadoop.store.input

Class AbstractDataStreamReader

java.lang.Object

org.springframework.data.hadoop.store.support.LifecycleObjectSupport

org.springframework.data.hadoop.store.support.StoreObjectSupport

org.springframework.data.hadoop.store.support.InputStoreObjectSupport

org.springframework.data.hadoop.store.input.AbstractDataStreamReader

All Implemented Interfaces:

org.springframework.beans.factory.Aware, org.springframework.beans.factory.BeanFactoryAware, org.springframework.beans.factory.InitializingBean, org.springframework.context.Lifecycle, org.springframework.context.Phased, org.springframework.context.SmartLifecycle

Direct Known Subclasses:

TextFileReader

public class AbstractDataStreamReader
extends InputStoreObjectSupport

A AbstractDataStreamReader is a base implementation handling streams with a raw hdfs files.

Author:

Janne Valkealahti

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	AbstractDataStreamReader.ReaderHelper<T,V> Reader helper hiding complexity of working with input streams.

Constructor Summary

Constructors

Constructor and Description
AbstractDataStreamReader(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec) Instantiates a new abstract data stream reader.
AbstractDataStreamReader(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path basePath, CodecInfo codec, Split split) Instantiates a new abstract data stream reader.

Method Summary

Methods

Modifier and Type	Method and Description
protected StreamsHolder<java.io.InputStream>	getInput() Creates a holder wrapping input stream.

Methods inherited from class org.springframework.data.hadoop.store.support.InputStoreObjectSupport

getInputContext, getSplit

Methods inherited from class org.springframework.data.hadoop.store.support.StoreObjectSupport

doStart, doStop, flushTimeout, getCodec, getConfiguration, getPath, handleTimeout, isCompressed, onInit, resetIdleTimeout, setCloseTimeout, setFlushTimeout, setIdleTimeout

Methods inherited from class org.springframework.data.hadoop.store.support.LifecycleObjectSupport

afterPropertiesSet, getBeanFactory, getPhase, getStoreEventPublisher, getTaskExecutor, getTaskScheduler, isAutoStartup, isRunning, setAutoStartup, setBeanFactory, setPhase, setStoreEventPublisher, setTaskExecutor, setTaskScheduler, start, stop, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractDataStreamReader

public AbstractDataStreamReader(org.apache.hadoop.conf.Configuration configuration,
                        org.apache.hadoop.fs.Path basePath,
                        CodecInfo codec)

Instantiates a new abstract data stream reader.

Parameters:

configuration - the hadoop configuration

basePath - the hdfs path

codec - the compression codec info

AbstractDataStreamReader

public AbstractDataStreamReader(org.apache.hadoop.conf.Configuration configuration,
                        org.apache.hadoop.fs.Path basePath,
                        CodecInfo codec,
                        Split split)

Instantiates a new abstract data stream reader.

Parameters:

configuration - the configuration

basePath - the base path

codec - the compression codec info

split - the input split

Method Detail

getInput

protected StreamsHolder<java.io.InputStream> getInput()
                                               throws java.io.IOException

Creates a holder wrapping input stream.

Returns:

the holder for streams

Throws:

java.io.IOException - Signals that an I/O exception has occurred.