Senior Associate Data Engineering (Azure/Databricks) Hybrid
Core
Lead and deliver technical solutions for large-scale digital transformation projects, building and optimizing batch and streaming data pipelines across modern cloud data platforms and distributed processing frameworks.
Role type
Senior Associate Data Engineer (Azure/Databricks)
Builds
End-to-end data solutions, data processing, data transformation, and data platform modernization initiatives for clients.
Domain
Digital transformation, Cloud Data Engineering, AI Engineering
Deliverable
production ML models
Required skills
Azure Cloud Services (ADLS, Functions, AKS, Databricks), Python, Scala, Apache Spark, PySpark, SQL, NoSQL (DynamoDB, Cosmos DB), Apache Airflow, Data Modeling, MLOps, Vector Databases, Agent Architectures
Preferred skills
Databricks Lakehouse patterns, AI Engineering patterns (RAG, context engineering), Agentic platforms, Snowflake zero-copy architecture, Retail/Financial services domain knowledge
Technologies
Azure, Databricks, Delta Lake, Apache Spark, PySpark, Azure Data Factory, Apache Airflow, SQL Server, Oracle, MySQL, DynamoDB, Cosmos DB, Vertex AI, Azure AI services
Responsibilities
Lead, design, develop and deliver large-scale data systems; Build and optimize batch and streaming data pipelines; Support AI-enabled engineering use cases by designing data foundations and retrieval patterns; Automate data platform operations and manage post-production systems; Mentor junior team members.
Seniority
Senior, hands-on IC