|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use TokenizerModel | |
---|---|
opennlp.tools.cmdline.tokenizer | |
opennlp.tools.tokenize | Contains classes related to finding token or words in a string. |
Uses of TokenizerModel in opennlp.tools.cmdline.tokenizer |
---|
Methods in opennlp.tools.cmdline.tokenizer that return TokenizerModel | |
---|---|
protected TokenizerModel |
TokenizerModelLoader.loadModel(InputStream modelIn)
|
Uses of TokenizerModel in opennlp.tools.tokenize |
---|
Methods in opennlp.tools.tokenize that return TokenizerModel | |
---|---|
static TokenizerModel |
TokenizerME.train(ObjectStream<TokenSample> samples,
TokenizerFactory factory,
TrainingParameters mlParams)
Trains a model for the TokenizerME . |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
boolean useAlphaNumericOptimization)
Deprecated. Use #train(String, ObjectStream, TokenizerFactory, TrainingParameters)
and pass in a TokenizerFactory |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
boolean useAlphaNumericOptimization,
int cutoff,
int iterations)
Deprecated. Use #train(String, ObjectStream, TokenizerFactory, TrainingParameters)
and pass in a TokenizerFactory |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
boolean useAlphaNumericOptimization,
TrainingParameters mlParams)
Deprecated. Use #train(String, ObjectStream, TokenizerFactory, TrainingParameters)
and pass in a TokenizerFactory |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
Dictionary abbreviations,
boolean useAlphaNumericOptimization,
TrainingParameters mlParams)
Deprecated. Use #train(String, ObjectStream, TokenizerFactory, TrainingParameters)
and pass in a TokenizerFactory |
Constructors in opennlp.tools.tokenize with parameters of type TokenizerModel | |
---|---|
TokenizerME(TokenizerModel model)
|
|
TokenizerME(TokenizerModel model,
Factory factory)
Deprecated. use TokenizerFactory to extend the Tokenizer
functionality |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |