opennlp.tools.tokenize
Class TokenizerModel
java.lang.Object
opennlp.tools.util.model.BaseModel
opennlp.tools.tokenize.TokenizerModel
public final class TokenizerModel
- extends BaseModel
The TokenizerModel
is the model used
by a learnable Tokenizer
.
- See Also:
TokenizerME
Constructor Summary |
TokenizerModel(java.io.InputStream in)
Initializes the current instance. |
TokenizerModel(java.lang.String language,
AbstractModel tokenizerMaxentModel,
boolean useAlphaNumericOptimization)
Initializes the current instance. |
TokenizerModel(java.lang.String language,
AbstractModel tokenizerMaxentModel,
boolean useAlphaNumericOptimization,
java.util.Map<java.lang.String,java.lang.String> manifestInfoEntries)
Initializes the current instance. |
Methods inherited from class java.lang.Object |
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
TokenizerModel
public TokenizerModel(java.lang.String language,
AbstractModel tokenizerMaxentModel,
boolean useAlphaNumericOptimization,
java.util.Map<java.lang.String,java.lang.String> manifestInfoEntries)
- Initializes the current instance.
- Parameters:
tokenizerMaxentModel
- useAlphaNumericOptimization
-
TokenizerModel
public TokenizerModel(java.lang.String language,
AbstractModel tokenizerMaxentModel,
boolean useAlphaNumericOptimization)
- Initializes the current instance.
- Parameters:
tokenizerMaxentModel
- useAlphaNumericOptimization
-
TokenizerModel
public TokenizerModel(java.io.InputStream in)
throws java.io.IOException,
InvalidFormatException
- Initializes the current instance.
- Parameters:
in
-
- Throws:
java.io.IOException
InvalidFormatException
getMaxentModel
public AbstractModel getMaxentModel()
useAlphaNumericOptimization
public boolean useAlphaNumericOptimization()
main
public static void main(java.lang.String[] args)
throws java.io.IOException
- Throws:
java.io.IOException
Copyright © 2011 The Apache Software Foundation. All Rights Reserved.