opennlp.tools.tokenize
Class DefaultTokenContextGenerator

java.lang.Object
  extended by opennlp.tools.tokenize.DefaultTokenContextGenerator
All Implemented Interfaces:
TokenContextGenerator

public class DefaultTokenContextGenerator
extends java.lang.Object
implements TokenContextGenerator

Generate events for maxent decisions for tokenization.


Constructor Summary
DefaultTokenContextGenerator()
           
 
Method Summary
 java.lang.String[] getContext(java.lang.String sentence, int index)
          Returns an array of features for the specified sentence string at the specified index.
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

DefaultTokenContextGenerator

public DefaultTokenContextGenerator()
Method Detail

getContext

public java.lang.String[] getContext(java.lang.String sentence,
                                     int index)
Description copied from interface: TokenContextGenerator
Returns an array of features for the specified sentence string at the specified index.

Specified by:
getContext in interface TokenContextGenerator
Parameters:
sentence - The string for a sentence.
index - The index to consider splitting as a token.
Returns:
an array of features for the specified sentence string at the specified index.


Copyright © 2011 The Apache Software Foundation. All Rights Reserved.