Data Engineer JD
Core
Design, build, and operate large-scale data platforms and cloud-based data solutions.
Role type
Senior Data Engineer
Builds
Cloud-native data platforms, batch and streaming data pipelines
Domain
Cloud data engineering (Microsoft Azure)
Deliverable
production ML models | infrastructure
Required skills
SQL, data modelling, Python, Apache Spark, Azure Databricks, Azure Data Lake Storage, Azure Event Hubs, Delta Lake, Terraform, CI/CD pipelines, cloud security, observability
Preferred skills
Rust, Kubernetes, data visualization, data governance, metadata management
Technologies
Microsoft Azure, Azure Databricks, Azure Data Lake Storage, Azure Event Hubs, Apache Spark, Delta Lake, Terraform, Azure DevOps, Rust, Google Cloud Platform, Kubernetes
Responsibilities
Design and build large-scale data platforms; develop and maintain batch and streaming data pipelines; monitor, troubleshoot, and resolve production incidents; implement infrastructure as code and CI/CD pipelines
Seniority
Senior, hands-on IC