|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use TokenContextGenerator | |
---|---|
opennlp.tools.tokenize | Contains classes related to finding token or words in a string. |
opennlp.tools.tokenize.lang |
Uses of TokenContextGenerator in opennlp.tools.tokenize |
---|
Classes in opennlp.tools.tokenize that implement TokenContextGenerator | |
---|---|
class |
DefaultTokenContextGenerator
Generate events for maxent decisions for tokenization. |
Methods in opennlp.tools.tokenize that return TokenContextGenerator | |
---|---|
TokenContextGenerator |
TokenizerFactory.getContextGenerator()
Gets the context generator |
Constructors in opennlp.tools.tokenize with parameters of type TokenContextGenerator | |
---|---|
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
boolean skipAlphaNumerics,
Pattern alphaNumeric,
TokenContextGenerator cg)
Initializes the current instance. |
|
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
boolean skipAlphaNumerics,
TokenContextGenerator cg)
Initializes the current instance. |
Uses of TokenContextGenerator in opennlp.tools.tokenize.lang |
---|
Methods in opennlp.tools.tokenize.lang that return TokenContextGenerator | |
---|---|
TokenContextGenerator |
Factory.createTokenContextGenerator(String languageCode,
Set<String> abbreviations)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |