如何使用Lucene分析器來標記字符串？

Question

有沒有一種簡單的方法可以使用Lucene的Analyzer的任何子類來解析/標記String？

喜歡的東西：

String to_be_parsed = "car window seven"; 
Analyzer analyzer = new StandardAnalyzer(...); 
List<String> tokenized_string = analyzer.analyze(to_be_parsed); 

Answer 1

據我所知，你必須自己寫循環。像這樣的東西（直接從我的源代碼樹中取得）：

public final class LuceneUtils { 

    public static List<String> parseKeywords(Analyzer analyzer, String field, String keywords) { 

     List<String> result = new ArrayList<String>(); 
     TokenStream stream = analyzer.tokenStream(field, new StringReader(keywords)); 

     try { 
      while(stream.incrementToken()) { 
       result.add(stream.getAttribute(TermAttribute.class).term()); 
      } 
     } 
     catch(IOException e) { 
      // not thrown b/c we're using a string reader... 
     } 

     return result; 
    } 
} 

Answer 2

根據上面的答案，它稍作修改以適用於Lucene 4.0。

public final class LuceneUtil { 

    private LuceneUtil() {} 

    public static List<String> tokenizeString(Analyzer analyzer, String string) { 
    List<String> result = new ArrayList<String>(); 
    try { 
     TokenStream stream = analyzer.tokenStream(null, new StringReader(string)); 
     stream.reset(); 
     while (stream.incrementToken()) { 
     result.add(stream.getAttribute(CharTermAttribute.class).toString()); 
     } 
    } catch (IOException e) { 
     // not thrown b/c we're using a string reader... 
     throw new RuntimeException(e); 
    } 
    return result; 
    } 

}