European broadcast & streaming group
2024–2026 · 25 months
Customer analytics on one platform, and a way to onboard new data teams without a project each time.
- Built customer-analytics pipelines on Airflow, Google Cloud, Dataproc and BigQuery
- Architected a central Databricks platform for fast onboarding of data sources and product teams
- Streaming ingestion with Spark Structured Streaming and Kafka
- A Unity Catalog permissions model for engineering teams and service principals, expressed in Terraform, plus reusable CI/CD template components for standardised deployment
- Databricks
- Unity Catalog
- PySpark
- Kafka
- Airflow
- GCP
- Terraform