Senior Data Engineer Gen Ai
Core
Design and develop production-grade data pipelines and end-to-end solutions leveraging GenAI tools to enhance engineering productivity.
Role type
Senior GenAI Data Engineer
Builds
Production-grade data pipelines, complex data workflows (batch and streaming), and robust data quality/governance frameworks.
Domain
Data Engineering, Generative AI
Deliverable
production ML models | product features | infrastructure
Required skills
End-to-end pipeline development (batch and streaming), Data modeling (dimensional, Data Vault, OBT), ETL/ELT design patterns, SQL (Advanced), Python (Advanced), Apache Spark, AI-assisted coding tools (Copilot, Claude, Gemini), Data quality frameworks, Unit testing, CI/CD for data workflows
Preferred skills
Google Cloud Platform services (BigQuery, Dataflow, Cloud Composer, Pub/Sub, Dataproc, Vertex AI), Finance or sales data domains, Databricks, Delta Lake, Apache Iceberg, GCP Professional Data Engineer certification
Technologies
Apache Spark, BigQuery, Dataflow, Cloud Composer, Pub/Sub, Dataproc, Vertex AI, Databricks, Delta Lake, Apache Iceberg, GitHub Copilot, Claude, Gemini
Responsibilities
Architect and develop end-to-end data pipelines from ingestion to consumption, Lead solutioning and integration for complex data workflows, Use AI-assisted coding tools to accelerate code development and debugging, Implement robust data quality, testing, lineage, and governance frameworks, Drive best practices across pipeline performance and scalability, Mentor junior engineers
Seniority
Senior, hands-on IC