Senior Data Platform Engineer
Core
Manage, optimize, and evolve the cloud-native data platform estate (Azure, Databricks, Unity Catalog) to ensure security, reliability, scalability, and cost-efficiency while delivering robust data pipelines and lakehouse solutions.
Role type
Senior Data Platform Engineer
Builds
Enterprise data lakehouse solutions, secure data pipelines, and platform infrastructure on Microsoft Azure and Databricks
Domain
Cloud Data Engineering / Data Platform Engineering
Required skills
Databricks (Spark, PySpark, Delta Lake), Unity Catalog, Microsoft Azure (Data Lake Storage, Data Factory), Python, SQL, Infrastructure as Code (Terraform), CI/CD, Data Governance (Collibra), Data Security (Immuta), Observability, Capacity Management
Preferred skills
dbt, Apache Airflow, Azure Synapse Analytics, Kubernetes, FinOps practices
Technologies
Azure, Databricks, Unity Catalog, Collibra, Immuta, Terraform, Azure DevOps, GitHub Actions, Azure Data Factory, Delta Lake, Spark, PySpark
Responsibilities
Manage platform estate across Azure and Databricks; Optimize performance, workloads, storage, and compute; Administer platform configuration and access controls; Design and maintain lakehouse solutions; Develop ingestion and ETL/ELT pipelines; Implement observability and incident management; Automate deployment via IaC and CI/CD; Provide technical leadership and coaching.
Seniority
Senior, hands-on IC
