A production-ready system for collecting and managing ETF data from Tushare Pro API.
- Fetch ETF basic information and share size data
- Full and incremental data updates
- Supabase PostgreSQL storage with SSL
- Rate limiting and retry logic
- Streamlit dashboard for monitoring
- Docker containerization
- Automated updates via GitHub Actions
- Clone repository
- Copy
.env.exampleto.envand configure - Install dependencies:
pip install -r requirements.txt - Initialize database:
python src/init_db.py - Run collector:
python src/main.py - Launch dashboard:
streamlit run app.py
See .env.example for required configuration.
Deploy to Streamlit Cloud with GitHub Actions for automated data updates.