antlr
Class CppCodeGenerator
java.lang.Object
|
+--antlr.CodeGenerator
|
+--antlr.CppCodeGenerator
- public class CppCodeGenerator
- extends CodeGenerator
Untamed: Generate MyParser.cpp, MyParser.hpp, MyLexer.cpp, MyLexer.hpp and MyParserTokenTypes.hpp
Field Summary
analyzer, behavior, bitsetsUsed, bitsetTestThreshold, charFormatter, currentOutput, DEBUG_CODE_GENERATOR, DEFAULT_BITSET_TEST_THRESHOLD, DEFAULT_MAKE_SWITCH_THRESHOLD, grammar, makeSwitchThreshold, tabs, TokenTypesFileExt, TokenTypesFileSuffix, tool
Constructor Summary
CppCodeGenerator()
Enabled: Create a C++ code-generator using the given Grammar.
Method Summary
protected void
_print(String s)
Output a String to the currentOutput stream.
protected void
_printAction(String s)
Print an action without leading tabs, attempting to
preserve the current indentation level for multi-line actions
Ignored if string is null.
protected void
_println(String s)
Output a String followed by newline, to the currentOutput stream.
protected int
addSemPred(String predicate)
Adds a semantic predicate string to the sem pred vector
These strings will be used to build an array of sem pred names
when building a debugging parser.
void
gen()
Enabled: Generate the parser, lexer, treeparser, and token types in C++
void
gen(ActionElement action)
Enabled: Generate code for the given grammar element.
protected void
genBitsets(Vector bitsetList,
int maxVocabulary,
String prefix,
boolean dumpSets)
Generate all the bitsets to be used in the parser or lexer
Generate the raw bitset data like "long _tokenSet1_data[] = {...};"
and the BitSet object declarations like "BitSet _tokenSet1 = new BitSet(_tokenSet1_data);"
Note that most languages do not support object initialization inside a
class definition, so other code-generators may have to separate the
bitset declarations from the initializations (e.g., put the initializations
in the generated constructor instead).
private void
genBlockFinish(CppBlockFinishingInfo howToFinish,
String noViableAction)
Generate the finish of a block, using a combination of the info
returned from genCommonBlock() and the action to perform when
no alts were taken
protected void
genCases(BitSet p)
Generate a series of case statements that implement a BitSet test.
protected void
genHeader(String fileName)
Generate a header that is common to all C++ files
void
genLineNo(int line)
Enabled: Generate a #line or // line depending on options
void
genLineNo(Token t)
Enabled: Generate a #line or // line depending on options
void
genLineNo2()
Enabled: Generate a #line or // line depending on options
protected void
genSemPredMap(String prefix)
Write an array of Strings which are the semantic predicate
expressions.
void
genTokenStrings(String prefix)
Enabled: Generate a static array containing the names of the tokens,
indexed by the token type values.
private String
getValueString(int value)
getValueString: get a string representation of a token or char value
void
printAction(Token t)
Enabled: Print an action stored in a token surrounded by #line stuff
protected void
println(String s)
Output tab indent followed by a String followed by newline,
to the currentOutput stream.
String
processStringForASTConstructor(String str)
Enabled: Process a string for an simple expression for use in xx/action.g
it is used to cast simple tokens/references to the right type for
the generated language.
elementsAreRange, extractIdOfAction, extractIdOfAction, extractTypeOfAction, extractTypeOfAction, genTokenInterchange, getBitsetName, lexerRuleName, markBitsetForGen, print, printAction, printTabs, removeAssignmentFromDeclaration, reverseLexerRuleName, setAnalyzer, setBehavior, setGrammar, setTool
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
Field Detail
syntacticPredLevel
protected int syntacticPredLevel
genAST
protected boolean genAST
saveText
protected boolean saveText
genHashLines
protected boolean genHashLines
outputLine
protected int outputLine
outputFile
protected String outputFile
usingCustomAST
boolean usingCustomAST
labeledElementType
String labeledElementType
labeledElementASTType
String labeledElementASTType
labeledElementASTInit
String labeledElementASTInit
labeledElementInit
String labeledElementInit
commonExtraArgs
String commonExtraArgs
commonExtraParams
String commonExtraParams
commonLocalVars
String commonLocalVars
lt1Value
String lt1Value
exceptionThrown
String exceptionThrown
throwNoViable
String throwNoViable
currentRule
RuleBlock currentRule
currentASTResult
String currentASTResult
treeVariableMap
Hashtable treeVariableMap
astVarNumber
int astVarNumber
NONUNIQUE
protected static final String NONUNIQUE
caseSizeThreshold
public static final int caseSizeThreshold
- Enabled:
semPreds
private Vector semPreds
namespaceStd
private static String namespaceStd
namespaceAntlr
private static String namespaceAntlr
nameSpace
private static NameSpace nameSpace
preIncludeCpp
private static final String preIncludeCpp
preIncludeHpp
private static final String preIncludeHpp
postIncludeCpp
private static final String postIncludeCpp
postIncludeHpp
private static final String postIncludeHpp
Constructor Detail
CppCodeGenerator
public CppCodeGenerator()
- Enabled: Create a C++ code-generator using the given Grammar.
The caller must still call setTool, setBehavior, and setAnalyzer
before generating code.
Method Detail
addSemPred
protected int addSemPred(String predicate)
- Adds a semantic predicate string to the sem pred vector
These strings will be used to build an array of sem pred names
when building a debugging parser. This method should only be
called when the debug option is specified
-
exitIfError
public void exitIfError()
- Enabled:
-
countLines
protected int countLines(String s)
-
_print
protected void _print(String s)
- Output a String to the currentOutput stream.
Ignored if string is null.
- Overrides:
_print in class CodeGenerator
- Parameters:
s - The string to output
_printAction
protected void _printAction(String s)
- Print an action without leading tabs, attempting to
preserve the current indentation level for multi-line actions
Ignored if string is null.
- Overrides:
_printAction in class CodeGenerator
- Parameters:
s - The action string to output
printAction
public void printAction(Token t)
- Enabled: Print an action stored in a token surrounded by #line stuff
-
printHeaderAction
public void printHeaderAction(String name)
- Enabled: Print a header action by #line stuff
- Parameters:
name - The name of the header part
_println
protected void _println(String s)
- Output a String followed by newline, to the currentOutput stream.
Ignored if string is null.
- Overrides:
_println in class CodeGenerator
- Parameters:
s - The string to output
println
protected void println(String s)
- Output tab indent followed by a String followed by newline,
to the currentOutput stream. Ignored if string is null.
- Overrides:
println in class CodeGenerator
- Parameters:
s - The string to output
genLineNo
public void genLineNo(int line)
- Enabled: Generate a #line or // line depending on options
-
genLineNo
public void genLineNo(GrammarElement el)
- Enabled: Generate a #line or // line depending on options
-
genLineNo
public void genLineNo(Token t)
- Enabled: Generate a #line or // line depending on options
-
genLineNo2
public void genLineNo2()
- Enabled: Generate a #line or // line depending on options
-
gen
public void gen()
- Enabled: Generate the parser, lexer, treeparser, and token types in C++
- Specified by:
gen in class CodeGenerator
-
gen
public void gen(ActionElement action)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
action - The {...} action to generate
gen
public void gen(AlternativeBlock blk)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
blk - The "x|y|z|..." block to generate
gen
public void gen(BlockEndElement end)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
end - The block-end element to generate. Block-end
elements are synthesized by the grammar parser to represent
the end of a block.
gen
public void gen(CharLiteralElement atom)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
atom - The character literal reference to generate
gen
public void gen(CharRangeElement r)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
r - The character-range reference to generate
gen
public void gen(LexerGrammar g)
throws IOException
- Enabled: Generate the lexer C++ files
- Specified by:
gen in class CodeGenerator
IOException
gen
public void gen(OneOrMoreBlock blk)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
blk - The (...)+ block to generate
gen
public void gen(ParserGrammar g)
throws IOException
- Enabled: Generate the parser C++ file
- Specified by:
gen in class CodeGenerator
IOException
gen
public void gen(RuleRefElement rr)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
rr - The rule-reference to generate
gen
public void gen(StringLiteralElement atom)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
atom - The string-literal reference to generate
gen
public void gen(TokenRangeElement r)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
r - The token-range reference to generate
gen
public void gen(TokenRefElement atom)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
atom - The token-reference to generate
gen
public void gen(TreeElement t)
- Enabled:
- Specified by:
gen in class CodeGenerator
-
gen
public void gen(TreeWalkerGrammar g)
throws IOException
- Enabled: Generate the tree-parser C++ files
- Specified by:
gen in class CodeGenerator
IOException
gen
public void gen(WildcardElement wc)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
wc - The wildcard element to generate
gen
public void gen(ZeroOrMoreBlock blk)
- Enabled: Generate code for the given grammar element.
- Specified by:
gen in class CodeGenerator
- Parameters:
blk - The (...)* block to generate
genAlt
protected void genAlt(Alternative alt,
AlternativeBlock blk)
- Generate an alternative.
- Parameters:
alt - The alternative to generateblk - The block to which the alternative belongs
genBitsets
protected void genBitsets(Vector bitsetList,
int maxVocabulary,
String prefix,
boolean dumpSets)
- Generate all the bitsets to be used in the parser or lexer
Generate the raw bitset data like "long _tokenSet1_data[] = {...};"
and the BitSet object declarations like "BitSet _tokenSet1 = new BitSet(_tokenSet1_data);"
Note that most languages do not support object initialization inside a
class definition, so other code-generators may have to separate the
bitset declarations from the initializations (e.g., put the initializations
in the generated constructor instead).
- Parameters:
bitsetList - The list of bitsets to generate.maxVocabulary - Ensure that each generated bitset can contain at least this value.dumpSets - Dump out the token definitions of the contents of the bitset
only for grammars/parsers.
genBitsetsHeader
protected void genBitsetsHeader(Vector bitsetList,
int maxVocabulary)
-
genBlockFinish
private void genBlockFinish(CppBlockFinishingInfo howToFinish,
String noViableAction)
- Generate the finish of a block, using a combination of the info
returned from genCommonBlock() and the action to perform when
no alts were taken
- Parameters:
howToFinish - The return of genCommonBlock()noViableAction - What to generate when no alt is taken
genBlockPreamble
protected void genBlockPreamble(AlternativeBlock blk)
- Generate the header for a block, which may be a RuleBlock or a
plain AlternativeBLock. This generates any variable declarations,
init-actions, and syntactic-predicate-testing variables.
-
genBody
public void genBody(LexerGrammar g)
throws IOException
- Enabled:
IOException
genBody
public void genBody(ParserGrammar g)
throws IOException
- Enabled:
IOException
genBody
public void genBody(TreeWalkerGrammar g)
throws IOException
- Enabled:
IOException
genCases
protected void genCases(BitSet p)
- Generate a series of case statements that implement a BitSet test.
- Parameters:
p - The Bitset for which cases are to be generated
genCommonBlock
public CppBlockFinishingInfo genCommonBlock(AlternativeBlock blk,
boolean noTestForSingle)
- Enabled: Generate common code for a block of alternatives; return a postscript
that needs to be generated at the end of the block. Other routines
may append else-clauses and such for error checking before the postfix
is generated.
If the grammar is a lexer, then generate alternatives in an order where
alternatives requiring deeper lookahead are generated first, and
EOF in the lookahead set reduces the depth of the lookahead.
- Parameters:
blk - The block to generatenoTestForSingle - If true, then it does not generate a test for a single alternative.
suitableForCaseExpression
private static boolean suitableForCaseExpression(Alternative a)
-
genElementAST
private void genElementAST(AlternativeElement el)
- Generate code to link an element reference into the AST
-
genErrorCatchForElement
private void genErrorCatchForElement(AlternativeElement el)
- Close the try block and generate catch phrases
if the element has a labeled handler in the rule
-
genErrorHandler
private void genErrorHandler(ExceptionSpec ex)
- Generate the catch phrases for a user-specified error handler
-
genErrorTryForElement
private void genErrorTryForElement(AlternativeElement el)
- Generate a try { opening if the element has a labeled handler in the rule
-
genHeader
protected void genHeader(String fileName)
- Generate a header that is common to all C++ files
-
genInclude
public void genInclude(LexerGrammar g)
throws IOException
- Enabled:
IOException
genInclude
public void genInclude(ParserGrammar g)
throws IOException
- Enabled:
IOException
genInclude
public void genInclude(TreeWalkerGrammar g)
throws IOException
- Enabled:
IOException
genLiteralsTest
private void genLiteralsTest()
-
genLiteralsTestForPartialToken
private void genLiteralsTestForPartialToken()
-
genMatch
protected void genMatch(BitSet b)
-
genMatch
protected void genMatch(GrammarAtom atom)
-
genMatchUsingAtomText
protected void genMatchUsingAtomText(GrammarAtom atom)
-
genMatchUsingAtomTokenType
protected void genMatchUsingAtomTokenType(GrammarAtom atom)
-
genNextToken
public void genNextToken()
- Enabled: Generate the nextToken() rule.
nextToken() is a synthetic lexer rule that is the implicit OR of all
user-defined lexer rules.
-
genRule
public void genRule(RuleSymbol s,
boolean startSymbol,
int ruleNum,
String prefix)
- Enabled: Gen a named rule block.
ASTs are generated for each element of an alternative unless
the rule or the alternative have a '!' modifier.
If an alternative defeats the default tree construction, it
must set _AST to the root of the returned AST.
Each alternative that does automatic tree construction, builds
up root and child list pointers in an ASTPair structure.
A rule finishes by setting the returnAST variable from the
ASTPair.
- Parameters:
startSymbol - true if the rule is a start symbol (i.e., not referenced elsewhere)
genRuleHeader
public void genRuleHeader(RuleSymbol s,
boolean startSymbol)
- Enabled:
-
GenRuleInvocation
private void GenRuleInvocation(RuleRefElement rr)
-
genSemPred
protected void genSemPred(String pred,
int line)
-
genSemPredMap
protected void genSemPredMap(String prefix)
- Write an array of Strings which are the semantic predicate
expressions. The debugger will reference them by number only
-
genSynPred
protected void genSynPred(SynPredBlock blk,
String lookaheadExpr)
-
genTokenStrings
public void genTokenStrings(String prefix)
- Enabled: Generate a static array containing the names of the tokens,
indexed by the token type values. This static array is used
to format error messages so that the token identifers or literal
strings are displayed instead of the token numbers.
If a lexical rule has a paraphrase, use it rather than the
token label.
-
genTokenTypes
protected void genTokenTypes(TokenManager tm)
throws IOException
- Generate the token types C++ file
IOException
processStringForASTConstructor
public String processStringForASTConstructor(String str)
- Enabled: Process a string for an simple expression for use in xx/action.g
it is used to cast simple tokens/references to the right type for
the generated language. Basically called for every element in
the vector to getASTCreateString(vector V)
- Overrides:
processStringForASTConstructor in class CodeGenerator
- Parameters:
str - A String.
getASTCreateString
public String getASTCreateString(Vector v)
- Enabled: Get a string for an expression to generate creation of an AST subtree.
- Specified by:
getASTCreateString in class CodeGenerator
- Parameters:
v - A Vector of String, where each element is an expression in the target language yielding an AST node.
getASTCreateString
public String getASTCreateString(GrammarAtom atom,
String str)
- Enabled: Get a string for an expression to generate creating of an AST node
- Specified by:
getASTCreateString in class CodeGenerator
- Parameters:
str - The arguments to the AST constructor
getASTCreateString
public String getASTCreateString(String str)
- Enabled: Get a string for an expression to generate creating of an AST node
- Parameters:
str - The arguments to the AST constructor
getLookaheadTestExpression
protected String getLookaheadTestExpression(Lookahead[] look,
int k)
-
getLookaheadTestExpression
protected String getLookaheadTestExpression(Alternative alt,
int maxDepth)
- Generate a lookahead test expression for an alternate. This
will be a series of tests joined by '&&' and enclosed by '()',
the number of such tests being determined by the depth of the lookahead.
-
getLookaheadTestTerm
protected String getLookaheadTestTerm(int k,
BitSet p)
- Generate a depth==1 lookahead test expression given the BitSet.
This may be one of:
1) a series of 'x==X||' tests
2) a range test using>= && <= where possible, 3) a bitset membership test for complex comparisons
- Parameters:
k - The lookahead levelp - The lookahead set for level k
getRangeExpression
public String getRangeExpression(int k,
int[] elems)
- Enabled: Return an expression for testing a contiguous renage of elements
- Parameters:
k - The lookahead levelelems - The elements representing the set, usually from BitSet.toArray().
- Returns:
- String containing test expression.
getValueString
private String getValueString(int value)
- getValueString: get a string representation of a token or char value
- Parameters:
value - The token or char value
lookaheadIsEmpty
protected boolean lookaheadIsEmpty(Alternative alt,
int maxDepth)
- Is the lookahead for this alt empty?
-
lookaheadString
private String lookaheadString(int k)
-
mangleLiteral
private String mangleLiteral(String s)
- Mangle a string literal into a meaningful token name. This is
only possible for literals that are all characters. The resulting
mangled literal name is literalsPrefix with the text of the literal
appended.
- Returns:
- A string representing the mangled literal, or null if not possible.
mapTreeId
public String mapTreeId(String idParam,
ActionTransInfo transInfo)
- Enabled: Map an identifier to it's corresponding tree-node variable.
This is context-sensitive, depending on the rule and alternative
being generated
- Specified by:
mapTreeId in class CodeGenerator
- Parameters:
idParam - The identifier name to map
- Returns:
- The mapped id (which may be the same as the input), or null if the mapping is invalid due to duplicates
mapTreeVariable
private void mapTreeVariable(AlternativeElement e,
String name)
- Given an element and the name of an associated AST variable,
create a mapping between the element "name" and the variable name.
-
processActionForTreeSpecifiers
protected String processActionForTreeSpecifiers(String actionStr,
int line,
RuleBlock currentRule,
ActionTransInfo tInfo)
- Lexically process tree-specifiers in the action.
This will replace #id and #(...) with the appropriate
function calls and/or variables.
- Overrides:
processActionForTreeSpecifiers in class CodeGenerator
-
fixNameSpaceOption
private String fixNameSpaceOption(String ns)
-
setupGrammarParameters
private void setupGrammarParameters(Grammar g)
-
textOrChar
private String textOrChar(String text)
-