AI Data Engineer
Core
Design, build, and maintain scalable data pipelines and architectures to power AI, machine learning, and Generative AI applications.
Role type
Senior IC AI Data Engineer
Builds
Robust data pipelines, AI-ready datasets, feature stores, and data platforms for LLM and analytics initiatives
Domain
Data Engineering + Generative AI / Large Language Models
Deliverable
production ML models
Required skills
Python, SQL, Spark, distributed computing, data migration, ETL/ELT, metadata management, data governance, CI/CD, infrastructure-as-code
Preferred skills
Scala, Java, knowledge graphs, vector search, Data-as-a-Service (DaaS)
Technologies
Python, Spark, SQL, Git, CI/CD, cloud platforms
Responsibilities
Design and develop scalable data ingestion, transformation, and enrichment pipelines; Migrate legacy data platforms to modern, governed architectures; Refactor and optimize ETL/ELT pipelines and data models; Develop data processing solutions for LLM-based applications and RAG; Implement automated data quality checks and monitoring; Collaborate with ML engineers to provide feature stores and training datasets; Contribute to AI platform engineering and model-serving infrastructure
Seniority
Senior, hands-on IC
