Fast, general-purpose grammar-based tokenizers.

This Java package additionally contains {@code StandardAnalyzer}, {@code StandardTokenizer}, and {@code StandardFilter}, which are not visible here, because they moved to Lucene Core. The factories for those components (e.g., used in Solr) are still part of this module.