Data & AI Engineer
Core
Design, build, and optimize scalable ETL/ELT pipelines and Lakehouse architectures using Databricks, Apache Spark, and Delta Lake to support production AI workloads.
Role type
Senior IC Data & AI Engineer (Databricks Specialist)
Builds
Cloud-agnostic Lakehouse solutions, production-ready AI models, and automated data pipelines for enterprise clients.
Domain
Big Data, Machine Learning Operations, Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, Apache Spark, Delta Lake, MLflow, Terraform, Databricks CLI, CI/CD pipelines, Infrastructure-as-Code
Preferred skills
Databricks Certified Data Engineer, Databricks ML Professional certification, Agile/DevOps consulting experience
Technologies
Databricks, Apache Spark, Delta Lake, MLflow, Terraform, AWS, Azure, GCP, Unity Catalog
Responsibilities
Design and optimize scalable ETL/ELT pipelines across multi-cloud environments; Fine-tune Spark jobs for performance and cost-efficiency; Implement CI/CD pipelines and IaC for automated deployments; Enforce data governance and compliance standards within Unity Catalog; Collaborate with client leaders to translate data requirements into business outcomes.
Seniority
Senior, hands-on IC