All Implemented Interfaces:

Tokenizer

public class AnyTokenizer
extends Object
implements Tokenizer 

Author:

jheintz

• Field Summary

  Fields

  Modifier and Type	Field and Description
  static String	TOKENS

• Constructor Summary

  Constructors

  Constructor and Description
  AnyTokenizer ()

• Method Summary

  Methods

  Modifier and Type	Method and Description
  void	tokenize (SourceCode sourceCode, Tokens tokenEntries)

  • Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

• Field Detail

  • TOKENS

    public static final String TOKENS

    See Also:

    Constant Field Values

• Constructor Detail

  • AnyTokenizer

    public AnyTokenizer()

• Method Detail

  • tokenize

    public void tokenize(SourceCode sourceCode,
     Tokens tokenEntries)

    Specified by:

    tokenize in interface Tokenizer