Utility for moving data from local to snowflake tables and vice versa
Clone/Download this repo.
git clone https://github.com/ajkdrag/Snowflake-Data-Porter
Go to the root dir and add it to PYTHONPATH
cd Snowflake-Data-Porter export PYTHONPATH=$(pwd)
Place your Snowflake creds in snowflake_conn.cfg.yaml and configurations in data_porter.cfg.yaml
src/ ├── configs │ ├── data_porter.cfg.yaml │ ├── globals.cfg.yaml │ └── snowflake_conn.cfg.yaml
Create a temporary working dir and run the launcher script.
mkdir src/tmp python src/launcher.py --config src/configs/data_porter.cfg.yaml --wrk-dir tmp
This runs all the supported operations defined in data_porter.cfg.yaml
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.