Sealed class: RT.KitchenSink.Lex.LexTokenizer

Assembly: RT.Util.Core, Version=1.0.0.9999, Culture=neutral, PublicKeyToken=null
Namespace: RT.KitchenSink.Lex
Show inherited types...
Inherits from:
- RT.KitchenSink.Collections.LazyList<RT.KitchenSink.Lex.Token>
  - object
Show implemented interfaces...
Implements:
- System.Collections.Generic.ICollection<RT.KitchenSink.Lex.Token>
- System.IDisposable
- System.Collections.IEnumerable
- System.Collections.Generic.IEnumerable<RT.KitchenSink.Lex.Token>
- System.Collections.Generic.IList<RT.KitchenSink.Lex.Token>

This type is not documented.

Constructors

LexTokenizer(LexReader reader, IEnumerable<Token.Parser> tokenParsers, ICollection<Type> ignoreTokens, Type stopToken, bool swallowWhitespace)

This member is not documented.

Instance methods

bool	Contains(Token item) Inherited from LazyList<Token> Implements: ICollection<T>.Contains(T)	Determines whether an element is in the list.
void	CopyTo(Token[] array, int arrayIndex) Inherited from LazyList<Token> Implements: ICollection<T>.CopyTo(T[], int)	Copies all elements to the specified array starting at the specified index.
void	Dispose() Inherited from LazyList<Token> Implements: IDisposable.Dispose()	Disposes of the enumerable's enumerator, if one is held at the moment.
IEnumerator<Token>	GetEnumerator() Inherited from LazyList<Token> Implements: IEnumerable<T>.GetEnumerator()	Returns an enumerator for the collection. Warning: This enumerates the underlying collection completely before returning.
bool	IndexInRange(int index) Inherited from LazyList<Token>	Checks whether the specified index is a valid index, i.e. not out-of-range.
int	IndexOf(Token item) Inherited from LazyList<Token> Implements: IList<T>.IndexOf(T)	Returns the index of the specified item, or -1 if the item is not found. (see also remarks)