Uses of Class
opennlp.tools.tokenize.TokenizerModel
-
Packages that use TokenizerModel Package Description opennlp.tools.cmdline.tokenizer opennlp.tools.formats.brat Experimental package related to the corpus format used by the "brat rapid annotation tool" (brat).opennlp.tools.tokenize Contains classes related to finding token or words in a string. -
-
Uses of TokenizerModel in opennlp.tools.cmdline.tokenizer
Methods in opennlp.tools.cmdline.tokenizer that return TokenizerModel Modifier and Type Method Description protected TokenizerModel
TokenizerModelLoader. loadModel(InputStream modelIn)
-
Uses of TokenizerModel in opennlp.tools.formats.brat
Constructors in opennlp.tools.formats.brat with parameters of type TokenizerModel Constructor Description BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples)
Creates a newBratNameSampleStream
.BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples, Set<String> nameTypes)
Creates a newBratNameSampleStream
. -
Uses of TokenizerModel in opennlp.tools.tokenize
Methods in opennlp.tools.tokenize that return TokenizerModel Modifier and Type Method Description static TokenizerModel
TokenizerME. train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams)
Trains a model for theTokenizerME
.Constructors in opennlp.tools.tokenize with parameters of type TokenizerModel Constructor Description TokenizerME(TokenizerModel model)
Instantiates aTokenizerME
with an existingTokenizerModel
.TokenizerME(TokenizerModel model, Factory factory)
Deprecated.useTokenizerFactory
to extend the Tokenizer functionality
-