🦆 Batch data pipeline with Airflow, DuckDB, Delta Lake, Trino, MinIO, and Metabase. Full observability and data quality.
-
Updated
Nov 5, 2025 - Python
🦆 Batch data pipeline with Airflow, DuckDB, Delta Lake, Trino, MinIO, and Metabase. Full observability and data quality.
A Smart Traffic Management System for Ho Chi Minh City, Vietnam leveraging batch and real-time data processing, intuitive dashboards, and monitoring tools to optimize traffic flow, enhance safety, and support sustainable urban mobility through advanced analytics and user-friendly applications.
End-to-end data pipeline combining batch and real-time streaming to process seismic data using Kafka, Spark, Airflow, and Delta Lake.
Add a description, image, and links to the promotheus topic page so that developers can more easily learn about it.
To associate your repository with the promotheus topic, visit your repo's landing page and select "manage topics."