Interface LineTokenizer
- All Known Implementing Classes:
AbstractLineTokenizer
,DelimitedLineTokenizer
,FixedLengthTokenizer
,PatternMatchingCompositeLineTokenizer
,RegexLineTokenizer
public interface LineTokenizer
Interface that is used by framework to split string obtained typically from a file into
tokens.
- Author:
- tomas.slanina, Mahmoud Ben Hassine
-
Method Summary
-
Method Details
-
tokenize
Yields the tokens resulting from the splitting of the suppliedline
.- Parameters:
line
- the line to be tokenized (can benull
)- Returns:
- the resulting tokens
-