Data Engineer
Core
Design and deliver production-grade data solutions on the Databricks Lakehouse platform for large government and enterprise clients.
Role type
Senior Data Engineer (Databricks Lakehouse)
Builds
Batch and streaming pipelines, data models, and cloud-native integrations on the Databricks platform
Domain
Government and Defence sector, Data Engineering
Deliverable
production ML models | product features
Required skills
Databricks (Delta Lake, DLT, Unity Catalog, Workflows), Python, SQL, PySpark, ETL/ELT pipeline design, Cloud platforms (Azure/AWS/GCP), Git/CI-CD
Preferred skills
AI/BI features, agent-based workflows, DataOps practices, Databricks certification
Technologies
Databricks, Delta Lake, Delta Live Tables, Unity Catalog, PySpark, Azure, AWS, GCP
Responsibilities
Design and build batch and streaming pipelines; Apply data modelling best practices; Integrate with cloud-native services; Manage data quality and lifecycle; Collaborate with architects on complex client engagements
Seniority
Senior, hands-on IC
