public class SingleTokenTokenizer
extends org.apache.lucene.analysis.WhitespaceTokenizer
Constructor and Description |
---|
SingleTokenTokenizer(org.apache.lucene.util.AttributeSource source,
Reader in) |
SingleTokenTokenizer(Reader in) |
Modifier and Type | Method and Description |
---|---|
protected boolean |
isTokenChar(char c) |
end, incrementToken, next, next, normalize, reset
getOnlyUseNewAPI, reset, setOnlyUseNewAPI
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString