| StringTokenizerBuilder Class |
String tokenizer builder which builds a tokenizer with token detectors
Inheritance HierarchyNamespace: FlexRule.DSL.Tokenizer
Assembly: FlexRule.Core.Library (in FlexRule.Core.Library.dll) Version: 0.0.0.0 (0.0.0.0)
SyntaxC#
public class StringTokenizerBuilder
The StringTokenizerBuilder type exposes the following members.
Constructors| Name | Description | |
|---|---|---|
 | StringTokenizerBuilder |
Constructs tokenizer builder using the data to be tokenized
|
Methods| Name | Description | |
|---|---|---|
| AddTokenDetector(ITokenDetector) |
Adds detector to tokenizer
|
| AddTokenDetector(String, ITokenDetector) |
Adds detector to tokenizer
|
| BuildTokenizer |
Build tokenizer
|
 | CreateSplitter |
Creates a tokenizer for as a string splitter based on a keyword
|
| Equals | (Inherited from Object.) |
 | Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) |
| GetHashCode | Serves as a hash function for a particular type. (Inherited from Object.) |
| GetType | Gets the Type of the current instance. (Inherited from Object.) |
| MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) |
| ToString | Returns a string that represents the current object. (Inherited from Object.) |
Fields| Name | Description | |
|---|---|---|
 | DefaultSymbolsString |
Default symbols excluding space (32)
|
| Eof |
End of file character
|
See Also