PostgreSQL style Parser splitted from CockroachDB
See: Complex SQL format example
I tried to import github.com/cockroachdb/cockroach/pkg/sql/parser, but the dependencies is too complex to make it work.
To make things easy, I did these things:
- Copy all the
pkg/sql/parser,pkg/sql/lexand simplify the dependencies - Simplify the Makefile to just generate the goyacc stuff
- Add the goyacc generated files in parser and lex to make
go getwork easily, see the.gitignorefiles - Trim the
etcddependency, see thego.mod - Rename all test file except some
pkg/sql/parsertests - Add all necessary imports to vendor
- Remove the
panicof meeting unregistried functions, see the WrapFunction - Other nasty things make the parser just work that I forgot :p
- Pure golang implementation
- Almost full support of PostgreSQL (
cockroachdbstyle PostgreSQL) - For SQL lineage analysis see go-sql-lineage
The code is derived from CockroachDB v20.1.11 which supports most of the major features of SQL:2011. See:
package main import ( "log" "github.com/auxten/postgresql-parser/pkg/sql/parser" "github.com/auxten/postgresql-parser/pkg/walk" ) func main() { sql := `select marr from (select marr_stat_cd AS marr, label AS l from root_loan_mock_v4 order by root_loan_mock_v4.age desc, l desc limit 5) as v4 LIMIT 1;` w := &walk.AstWalker{ Fn: func(ctx interface{}, node interface{}) (stop bool) { log.Printf("node type %T", node) return false }, } stmts, err := parser.Parse(sql) if err != nil { return } _, _ = w.Walk(stmts, nil) return }
This project contains code that is automatically generated using goyacc.
goyacc reads the SQL expressions (sql.y) and generates a parser which could be used to tokenize a given input.
You could update the generated code using the generate target inside the project's Makefile.
$ make generate
- 2021年02月16日
github.com/auxten/postgresql-parser/pkg/sql/parserUnit tests works now! - 2021年03月08日 Add walker package.
- 2022年08月03日 Remove vendored dependencies by @mostafa in #19
- Fix more unit tests
- Make built-in function parsing work