Data Engineer
Core
Building and maintaining a modern Azure-based data platform infrastructure, ensuring production stability, and enabling data engineers and analysts to operate effectively.
Role type
Data Platform Engineer
Builds
Reliable data pipelines, ETL/ELT workflows, and medallion architecture (bronze, silver, gold) on Azure
Domain
Cloud Data Engineering (Azure)
Deliverable
production ML models | product features | infrastructure
Required skills
Azure Data Factory, Databricks, Azure Data Lake Gen2, Delta Lake, PySpark, Spark SQL, Python, T-SQL, CI/CD, Git, RBAC, observability, capacity planning
Technologies
Azure Data Factory, Databricks, Unity Catalog, Azure Data Lake Storage Gen2, Delta Lake, PySpark, Spark SQL, Python, T-SQL, Git
Responsibilities
Set up and maintain Azure Data Factory, Databricks workspaces, and Azure Data Lake Storage Gen2 environments; Implement and manage CI/CD pipelines for data platform assets; Troubleshoot pipeline failures, data discrepancies, and performance bottlenecks; Design, build, and maintain data pipelines and ETL/ELT workflows; Monitor data platform SLAs and optimize performance for large datasets
Seniority
Mid-level, hands-on IC
