net.sourceforge.pmd.cpd
Class AbstractTokenizer
java.lang.Object
extended by net.sourceforge.pmd.cpd.AbstractTokenizer
- All Implemented Interfaces:
- Tokenizer
- Direct Known Subclasses:
- EcmascriptTokenizer, FortranTokenizer, RubyTokenizer
public abstract class AbstractTokenizer
- extends java.lang.Object
- implements Tokenizer
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
stringToken
protected java.util.List<java.lang.String> stringToken
ignorableCharacter
protected java.util.List<java.lang.String> ignorableCharacter
ignorableStmt
protected java.util.List<java.lang.String> ignorableStmt
ONE_LINE_COMMENT_CHAR
protected char ONE_LINE_COMMENT_CHAR
spanMultipleLinesString
protected boolean spanMultipleLinesString
AbstractTokenizer
public AbstractTokenizer()
tokenize
public void tokenize(SourceCode tokens,
Tokens tokenEntries)
- Specified by:
tokenize
in interface Tokenizer
-
Copyright © 2002-2011 InfoEther. All Rights Reserved.