|
Spring for Apache Hadoop | ||||||||
PREV LETTER NEXT LETTER | FRAMES NO FRAMES |
List
of LocalResourcesSelector.Entry
s.
SequenceFile
writer.ContainerAllocator
used for this class.
AnnotationIntrospector
for both serialization and
deserialization.
AppmasterMindScOperations
for this implementation.
MapperFeature.AUTO_DETECT_FIELDS
option.
MapperFeature.AUTO_DETECT_SETTERS
/
MapperFeature.AUTO_DETECT_GETTERS
option.
AnnotationBuilder
to be used.
ClientRmOperations
implementation for
accessing resource manager.
StandaloneHadoopCluster
StandaloneYarnCluster
Configuration
.
Configuration
.
ConversionService
.
DatasetRepositoryFactory
to use for this template.
DateFormat
.
DatasetDefinition
to use for this template.
IOException
raised to a Spring DataAccessException,
compatible with the org.springframework.dao
exception hierarchy.
SerializationFeature.FAIL_ON_EMPTY_BEANS
option.
StepExecutionSplitter
in the
AbstractPartitionHandler.handle(StepExecutionSplitter, StepExecution)
method, instructing
it how many StepExecution
instances are required, ideally.
HadoopCluster
HiveClient
factory.
System.getenv()
will
be included to environment settings.
SerializationFeature.INDENT_OUTPUT
option.
JobParametersConverter
.
ExecutionContext
.
ExecutionContext
.
ExecutionContext
.
ExecutionContext
.
ExecutionContext
.
ContainerLauncher
used for this class.
ContainerMonitor
used for this class.
Ordered
.
ExecutionContext
.
PigContext
to use.
PigServer
factory.
ExecutionContext
.
AnnotationConfigurer
.
SHDP_HD_FS
.
SHDP_HD_RM
.
SHDP_HD_SCHEDULER
.
SimpleDateFormat
.
TaskExecutor
.
TaskExecutor
.
TaskScheduler
.
TaskScheduler
.
AppmasterRmOperations
template.
Trigger
used to trigger polling tasks.
LocalResourceType
for entry.
Resource.setVirtualCores(int)
.
LocalResourceVisibility
for entry.
YarnClient
.
YarnCluster
ContainerRunner
.ExitCodeMapper
that can be configured through a
map from batch exit codes (String) to integer results.Path
s.SimplerFileSystem
instance.
RolloverStrategy
using a size limiting a rollover operation.SlopBlockSplitter
is a Splitter
which
roughly splitting at least on block boundaries allowing
last block to be combined with previous if its size is
too small.SmartResourceLocalizer
provides additional functionality on
top of ResourceLocalizer
order to handle more fine grained
handling of resource localizing.SpringApplication
.
Split
.Split
s based on a
Path
representing a hdfs resource.Partitioner
that locates multiple resources and
associates their file names with execution context keys.PartitionHandler
which does
partitioning based on number of input files from HDFS.SpringApplicationTemplate.execute(SpringApplicationCallback, String...)
to be able to wrap a possible exception.SpringApplicationTemplate
is meant to safely run SpringApplication
from a SpringApplicationBuilder
with a callback action SpringApplicationCallback
to do operations against an ApplicationContext
and then optionally return an value
back to a caller.ConfigurationProperties
for spring.hadoop.BeanPostProcessor
implementation that processes method-level
annotations such as @OnYarnContainerStart
.YarnAppmaster
.ConfigurationProperties
for
spring.yarn.appmaster.ConfigurationProperties
for
spring.yarn.batch.SpringApplication
class which
can be used as a main class if only requirement from an application
is to pass arguments into SpringApplication.run(Object, String...)
YarnClient
.ConfigurationProperties
for
spring.yarn.client.AnnotationBuilder
for SpringYarnConfigs
.SpringYarnConfigBuilder
to create SpringYarnConfigs
holding all relevant configurations for Spring Yarn.ImportSelector
choosing appropriate Configuration
based on EnableYarn
annotation.AnnotationBuilder
.SpringYarnConfigurer
instance.YarnContainer
.ConfigurationProperties
for
spring.yarn.container.ConfigurationProperties
used in
SpringYarnClientProperties
, SpringYarnAppmasterProperties
and
SpringYarnProperties
to resolve supported environment variables.ConfigurationProperties
for spring.yarn.StaticBlockSplitter
is a Splitter
handling
splits as relative of block sizes allowing to furthern split
blocks on a smaller chunks.FileNamingStrategy
which simply uses a static file name.StaticLengthSplitter
is a Splitter
using
a static length to split a resource into an equal sized.PartitionHandler
which does
partitioning based on static grid size.StepExecution
.ApplicationDescriptor
.
YarnClient
instance.
YarnClient
instance.
|
Spring for Apache Hadoop | ||||||||
PREV LETTER NEXT LETTER | FRAMES NO FRAMES |