Rowles.LeanLucene.Analysis.Analysers
Classes
Analyser
Composable analyser that runs a tokeniser followed by a chain of filters.
AnalyserFactory
Factory for creating language-specific analysers.
LanguageAnalyser
Configurable analyser that chains a tokeniser, lowercase normalisation, stop-word removal, and optional stemming. Used by AnalyserFactory for language-specific analysis pipelines.
StandardAnalyser
Default analyser combining tokenisation, lowercase normalisation, and stop-word removal into a single pipeline. Uses original input offsets for lowercasing to avoid double string allocation. The returned token list is reused across calls — callers must not hold references to it beyond the current invocation.
Thread-safety: This class maintains instance-level buffers (_tokensBuf, _lowerBuf, _internCache) for performance. Each instance should be used by a single thread, or callers should create separate instances per thread (as IndexWriter does in AddDocumentsConcurrent).
StemmedAnalyser
Extends StandardAnalyser with Porter stemming for improved recall. Pipeline: tokenise → lowercase → stop-word removal → Porter stem.
Interfaces
IAnalyser
Analyses input text into a list of tokens for indexing or querying.