Senior Data Engineer
Core
Design, build, and maintain scalable data pipelines and lakehouse structures to support analytics, BI, machine learning, and Generative AI applications.
Role type
Senior Data Engineer (Generative AI focus)
Builds
Production-ready data solutions, curated knowledge datasets, and data pipelines for GenAI use cases (RAG, AI services, agent workflows)
Domain
Enterprise data lake/lakehouse, Generative AI, Big Data
Deliverable
production ML models | product features
Required skills
Python, SQL, Apache Spark, Databricks (Delta Lake, Unity Catalog, Jobs & Workflows), data governance, CI/CD, incident resolution
Preferred skills
Experience supporting AI/ML/GenAI workloads, experience in regulated environments
Technologies
Databricks, Delta Lake, Unity Catalog, Python, PySpark, SQL, Apache Spark
Responsibilities
Design and maintain scalable data pipelines and lakehouse structures; Enable data consumption for GenAI use cases such as RAG and agent workflows; Build data pipelines for Generative AI applications including metadata and lineage management; Implement automated testing and CI/CD practices for data engineering workloads; Support operational stability, incident resolution, and root cause analysis; Collaborate with AI Engineers and Product Owners to align engineering deliverables to AI and GenAI use cases
Seniority
Senior, hands-on IC