LanguageAnalyser

Namespace

Rowles.LeanLucene.Analysis.Analysers

Assembly

Rowles.LeanLucene.dll

Configurable analyser that chains a tokeniser, lowercase normalisation, stop-word removal, and optional stemming. Used by AnalyserFactory for language-specific analysis pipelines.

public sealed class LanguageAnalyser : IAnalyser

LanguageAnalyser

Implements

IAnalyser

Remarks

Instances are safe to share across threads provided the supplied ITokeniser and IStemmer are also thread-safe. Per-call scratch buffers are rented from System.Buffers.ArrayPool`1 and returned before the method exits.

Constructors

LanguageAnalyser(ITokeniser, IEnumerable<string>?, IStemmer?)

Initialises a new LanguageAnalyser with the specified tokeniser, stop words, and optional stemmer.

Methods

Analyse(ReadOnlySpan<char>)

Analyses the input text and returns a list of tokens.