Interface LineTokenizer
- All Known Implementing Classes:
 AbstractLineTokenizer,DelimitedLineTokenizer,FixedLengthTokenizer,PatternMatchingCompositeLineTokenizer,RegexLineTokenizer
public interface LineTokenizer
Interface that is used by framework to split string obtained typically from a file into
 tokens.
- Author:
 - tomas.slanina, Mahmoud Ben Hassine
 
- 
Method Summary
 
- 
Method Details
- 
tokenize
Yields the tokens resulting from the splitting of the suppliedline.- Parameters:
 line- the line to be tokenized (can benull)- Returns:
 - the resulting tokens
 
 
 -