Overview | Package | Class | Tree | Deprecated | Index | Help
PREV CLASS NEXT CLASS | FRAMES NO FRAMES
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD

## com.singularsys.jep.configurableparser
Class Tokenizer

    java.lang.Object
      com.singularsys.jep.configurableparser.Tokenizer

    public class Tokenizer

extends java.lang.Object

Breaks the input into a set of tokens.

Constructor Summary
`Tokenizer(java.io.BufferedReader br, java.util.List<TokenMatcher> matchers)` Construct a tokenizer for a given input.

Method Summary
`java.util.List<Token>` | `scan()`
`static java.lang.String` | `toString(java.util.List<Token> toks)`

Methods inherited from class java.lang.Object
`clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

Constructor Detail

### Tokenizer

    public Tokenizer(java.io.BufferedReader br,
                     java.util.List<TokenMatcher> matchers)

  Construct a tokenizer for a given input.

  Parameters:
    `br` - the input to read from.
    `matchers` - a set of TokenMatchers to match the given input.

Method Detail

### scan

    public java.util.List<Token> scan()
                               throws ParseException

  Throws:
    `ParseException`

### toString

    public static java.lang.String toString(java.util.List<Token> toks)

Overview | Package | Class | Tree | Deprecated | Index | Help
PREV CLASS NEXT CLASS | FRAMES NO FRAMES
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD

Copyright © 2007 Singular Systems http://www.singularsys.com/jep