End-To-End Data Engineering Project. Made to learn some common data engineering practices.
python firebase etl terraform gcp svelte soccer data-engineering football data-pipeline cloud-run-functions
-
Updated
Dec 26, 2025 - Python
#
cloud-run-functions
Here are 12 public repositories matching this topic...
Sort: Most stars
Sort options
A reusable solution to kill billing on any projects associated with a given budget and budget alert. If your budget is exceeded, the resulting budget alert will cause all projects associated with that alert to be detached from the billing account. This immediately prevents all paid resources in the project from being consumed.
-
Updated
Nov 7, 2025 - Python
Build a data pipeline on Google Cloud using an event-driven architecture, leveraging GCS, Cloud Run functions, and BigQuery. Explore both VM and Composer options for Airflow management, and utilize Logging & Monitoring for pipeline health. Discover how SQL-based BigQuery ML can be used for initial ML implementation in specific scenarios.
bigquery airflow composer google-cloud-platform cloud-functions bigqueryml data-engineering-project cloud-run-functions
-
Updated
Aug 25, 2024 - Python
Serverless loader: copy remote files directly into Google Cloud Storage by a fully automated workflow using Terraform and Cloud Run Functions.
-
Updated
Sep 21, 2025 - Shell
A fully automated ETL pipeline that fetches and stores real-time traffic and weather data in BigQuery, with a live Looker dashboard for visualization.
python bigquery sql dashboard etl google-cloud data-visualization google-cloud-functions google-cloud-pubsub openweather-api google-cloud-scheduler google-cloud-secrets-manager tomtom-api looker-studio cloud-run-functions
-
Updated
Oct 1, 2024 - Python
PySpark-based ETL pipeline leveraging Dataproc, Cloud Storage, Cloud Run Functions and BigQuery, to automate Spotify "New Releases" data processing and visualization in Looker Studio.
python bigquery spark spotify-api google-cloud-storage google-cloud cloud-storage pyspark dataproc cloud-scheduler google-cloud-run google-cloud-scheduler secret-manager cloud-run-functions
-
Updated
Jan 10, 2025 - Python
This repo hosts a data-engineering pipeline that utilizes google cloud-storage, google pub/sub, google cloud function, airflow, ngrok, open-ai to facilitate a trigger based ELT pipeline. It also manages some vectorized data and geometric data following standard data retrieval and storage practices.
-
Updated
Oct 31, 2025 - Python
Cloud Run functionsとActiveReports for .NETでつくる帳票生成API
csharp google-cloud dotnet-core google-cloud-functions webapi activereports activereports18 cloud-run-functions
-
Updated
Apr 7, 2025 - C#
Los Mirlos Storytelling, a magical serverless backend built with Google Cloud Functions and powered by Gemini (Google's LLM)
python google cloud ai serverless storytelling chatbot google-cloud-storage gcp google-cloud gcs gemini serverless-functions chatbots google-cloud-platform gemini-api cloud-run cloud-run-functions
-
Updated
Jun 25, 2025 - Python
Develop and bundle your Cloud Run functions with ease
-
Updated
Dec 29, 2025 - TypeScript
Official LINE account for notifying garbage collection days
-
Updated
Nov 17, 2025 - Go
Serverless ETL pipeline on GCP using Cloud Run, Pub/Sub, BigQuery & Looker for real-time NYC Taxi ML insights.
bigquery data-engineering google-cloud-pubsub etl-pipeline serveless cloud-run bigquery-ml looker-studio cloud-run-functions
-
Updated
Jun 14, 2025 - Python
Improve this page
Add a description, image, and links to the cloud-run-functions topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the cloud-run-functions topic, visit your repo's landing page and select "manage topics."