Azure Data Platform Engineer - 19038
Core
Design and build scalable batch and streaming data pipelines on Azure to process structured and unstructured service contract data, ensuring data quality and production reliability.
Role type
Senior Azure Data Platform Engineer
Builds
Scalable data pipelines, data models, and system integrations connecting AI models to enterprise systems
Domain
Cloud Data Engineering (Azure)
Deliverable
production ML models | product features
Required skills
Azure Data Factory, Azure Databricks, Python, PySpark, Azure Blob Storage, Delta Lake, CI/CD pipelines, event-driven architectures, data modeling, API integration
Preferred skills
Kafka, Azure Service Bus, performance tuning, AI model integration
Technologies
Azure Data Factory, Azure Databricks, Azure Blob Storage, Python, PySpark, Delta Lake, Azure DevOps, Kafka, Azure Service Bus
Responsibilities
Build scalable data pipelines using Azure Data Factory; Develop data solutions with Azure Databricks; Transform large datasets using Python and PySpark; Design and optimize data models in Databricks; Build and maintain CI/CD pipelines using Azure DevOps; Troubleshoot and optimize production data pipelines
Seniority
Senior, hands-on IC