Interface LineTokenizer

All Known Implementing Classes:

AbstractLineTokenizer, DelimitedLineTokenizer, FixedLengthTokenizer, PatternMatchingCompositeLineTokenizer, RegexLineTokenizer

public interface LineTokenizer

Interface that is used by framework to split string obtained typically from a file into tokens.

Author:

tomas.slanina, Mahmoud Ben Hassine

Method Summary

Modifier and Type	Method	Description
FieldSet	tokenize(String line)	Yields the tokens resulting from the splitting of the supplied line.

Method Details

tokenize

FieldSet tokenize(String line)

Yields the tokens resulting from the splitting of the supplied line.

Parameters:

line - the line to be tokenized

Returns:

the resulting tokens