|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectopennlp.tools.tokenize.DictionaryDetokenizer
public class DictionaryDetokenizer
A rule based detokenizer. Simple rules which indicate in which direction a token should be
moved are looked up in a DetokenizationDictionary
object.
Detokenizer
,
DetokenizationDictionary
Nested Class Summary |
---|
Nested classes/interfaces inherited from interface opennlp.tools.tokenize.Detokenizer |
---|
Detokenizer.DetokenizationOperation |
Constructor Summary | |
---|---|
DictionaryDetokenizer(DetokenizationDictionary dict)
|
Method Summary | |
---|---|
Detokenizer.DetokenizationOperation[] |
detokenize(java.lang.String[] tokens)
Detokenize the input tokens. |
Methods inherited from class java.lang.Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DictionaryDetokenizer(DetokenizationDictionary dict)
Method Detail |
---|
public Detokenizer.DetokenizationOperation[] detokenize(java.lang.String[] tokens)
Detokenizer
detokenize
in interface Detokenizer
tokens
- the tokens to detokenize.
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |