Data Engineer Expert
Core
Design and implement scalable data pipelines to support client digital transformation and migration to cloud-native architectures.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Scalable data platforms, ETL/ELT pipelines, and cloud-native data architectures.
Domain
Cloud Data Engineering, Azure, Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Databricks, Microsoft Fabric, Azure Data Services (ADF, SQL Server, ADLS2), Spark, Python, SQL, Medallion architecture, Lakehouse, Delta, Git, DevOps, CI/CD, SQL, NoSQL, Cloud storage (S3, GCS)
Preferred skills
Azure Synapse, Azure Functions, Key Vault, Event Hub, Azure Container Services, Multi-cloud (AWS, GCP), Data orchestration, Real-time processing, Serverless architectures, BI tools integration (Power BI, Tableau, Looker), Spark optimization, FinOps, Observability
Technologies
Azure, Databricks, Microsoft Fabric, Spark, Python, SQL, Git, Azure Synapse, Azure Functions, Key Vault, Event Hub, Kafka, Stream Analytics, Power BI, Tableau, Looker, AWS, GCP
Responsibilities
Design and implement scalable data pipelines; Develop ETL/ELT processes on distributed environments; Collaborate with advanced analytics or AI teams to support model production; Optimize pipeline performance and apply observability practices; Integrate with BI and analytics tools for efficient data consumption.
Seniority
Senior, hands-on IC