Databricks + Agentic AI - Senior Associate
Core
Design and develop data solutions using Databricks and Agentic AI to support data processing, integration, and transformation for client analytics and reporting needs.
Role type
Senior Associate Data Engineer (Databricks + Agentic AI)
Builds
Data pipelines, transformation workflows, and modern data infrastructure for client analytics
Domain
Data Engineering / Cloud Analytics
Deliverable
production ML models
Required skills
Databricks, Apache Airflow, Azure Data Factory, data modeling, data validation, query optimization, workflow orchestration, client requirement translation, mentoring
Preferred skills
Agentic AI concepts, complex data interpretation, anticipating client needs, navigating ambiguous project settings
Responsibilities
Designing and building Databricks-based data pipelines and transformation workflows; Developing data integration, data modeling, and data validation routines; Applying agentic AI concepts to improve automation and workflow orchestration; Troubleshooting data quality, performance, and query optimization issues; Using Apache Airflow and Azure Data Factory to manage scheduled data movement; Supporting data architecture decisions; Interpreting data and technical findings to inform recommendations; Mentoring junior team members; Building client relationships
Seniority
Senior Associate, hands-on IC with mentorship responsibilities