|
|||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||||
java.lang.Objectorg.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.TokenFilter
org.apache.lucene.analysis.standard.StandardFilter
Normalizes tokens extracted with StandardTokenizer.
| Field Summary |
| Fields inherited from class org.apache.lucene.analysis.TokenFilter |
input |
| Fields inherited from interface org.apache.lucene.analysis.standard.StandardTokenizerConstants |
ACRONYM, ALPHA, ALPHANUM, APOSTROPHE, CJK, COMPANY, DEFAULT, DIGIT, EMAIL, EOF, HAS_DIGIT, HOST, LETTER, NOISE, NUM, P, tokenImage |
| Constructor Summary | |
StandardFilter(TokenStream in)
Construct filtering in. |
|
| Method Summary | |
Token |
next()
Returns the next token in the stream, or null at EOS. |
| Methods inherited from class org.apache.lucene.analysis.TokenFilter |
close |
| Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
public StandardFilter(TokenStream in)
| Method Detail |
public final Token next()
throws java.io.IOException
Removes 's from the end of words.
Removes dots from acronyms.
next in class TokenStreamjava.io.IOException
|
|||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||||