| StringTokenizerBuilder Class |
String tokenizer builder which builds a tokenizer with token detectors
Inheritance HierarchyNamespace: FlexRule.DSL.Tokenizer
Assembly: FlexRule.Core.Library (in FlexRule.Core.Library.dll) Version: 0.0.0.0 (0.0.0.0)
SyntaxC#
public class StringTokenizerBuilder
The StringTokenizerBuilder type exposes the following members.
Constructors| Name | Description | |
|---|---|---|
 | StringTokenizerBuilder |
Constructs tokenizer builder using the data to be tokenized
|
Methods| Name | Description | |
|---|---|---|
| AddTokenDetector(ITokenDetector) |
Adds detector to tokenizer
|
| AddTokenDetector(String, ITokenDetector) |
Adds detector to tokenizer
|
| BuildTokenizer |
Build tokenizer
|
 | CreateSplitter |
Creates a tokenizer for as a string splitter based on a keyword
|
Fields| Name | Description | |
|---|---|---|
 | DefaultSymbolsString |
Default symbols excluding space (32)
|
| Eof |
End of file character
|
Extension Methods| Name | Description | |
|---|---|---|
 | IsMonadParameterReference | (Defined by MonadParameterReferenceExtension.) |
See Also