Lucene++ - a full-featured, c++ search engine
API Documentation
Go to the documentation of this file.
7 #ifndef KEYWORDTOKENIZER_H
8 #define KEYWORDTOKENIZER_H
27 static const int32_t DEFAULT_BUFFER_SIZE;
35 void init(int32_t bufferSize);
38 virtual bool incrementToken();
#define LUCENE_CLASS(Name)
Definition: LuceneObject.h:24
boost::shared_ptr< Reader > ReaderPtr
Definition: LuceneTypes.h:547
int32_t finalOffset
Definition: KeywordTokenizer.h:30
bool done
Definition: KeywordTokenizer.h:29
TermAttributePtr termAtt
Definition: KeywordTokenizer.h:31
Definition: AbstractAllTermDocs.h:12
boost::shared_ptr< OffsetAttribute > OffsetAttributePtr
Definition: LuceneTypes.h:40
boost::shared_ptr< AttributeSource > AttributeSourcePtr
Definition: LuceneTypes.h:520
Emits the entire input as a single token.
Definition: KeywordTokenizer.h:15
A Tokenizer is a TokenStream whose input is a Reader.
Definition: Tokenizer.h:20
boost::shared_ptr< TermAttribute > TermAttributePtr
Definition: LuceneTypes.h:58
OffsetAttributePtr offsetAtt
Definition: KeywordTokenizer.h:32
boost::shared_ptr< AttributeFactory > AttributeFactoryPtr
Definition: LuceneTypes.h:519
clucene.sourceforge.net