Senior Data Engineer
Core
Own end-to-end data pipelines from ingestion to semantic-layer marts, ensuring data quality, freshness, and performance for business dashboards.
Role type
Senior Data Engineer (Platform & Migration)
Builds
End-to-end data pipelines, Bronze/Silver marts, semantic-layer definitions, and the underlying Azure/AKS infrastructure.
Domain
Cybersecurity / Data Engineering / Cloud Infrastructure
Required skills
Python, SQL, Apache Airflow, Kubernetes, Terraform, dbt, Delta Lake/Iceberg, Azure, CI/CD, Observability, API Integration
Preferred skills
Azure Database for PostgreSQL (Citus), Cost Engineering, Platform Migration, Streaming (CDC), Semantic Layer Tools
Technologies
Apache Airflow, Azure, AKS, dbt, Delta Lake, Terraform, Helm, Kustomize, Zenlytic, Superset
Responsibilities
Onboard sources end-to-end with authentication, pagination, and incremental watermarks; Own orchestration with DAGs triggered on data arrival and idempotent re-runs; Build marts and semantic-layer definitions for business metrics; Maintain lakehouse health via compaction, Z-ordering, and schema evolution; Optimize pipeline performance and warehouse capacity costs; Run the platform infrastructure (AKS, Terraform, CI/CD); Review pull requests and maintain runbooks; Collaborate with Analytics Engineers on business definitions.
Seniority
Senior, hands-on IC
