Senior Data Engineer
Core
Design, build, and optimize modern cloud-based data platforms (AWS/Databricks or Azure/Fabric) to power analytics, AI, and GenAI systems.
Role type
Senior Data Engineer (Cloud & AI Data Platforms)
Builds
Scalable batch, streaming, and near-real-time data pipelines; production-grade datasets for ML and GenAI applications.
Domain
Cloud Data Engineering & Generative AI
Deliverable
production ML models
Required skills
Apache Spark, Delta Lake, Python, SQL, Data Modeling, Data Governance, Pipeline Orchestration, Cloud Architecture (AWS or Azure)
Preferred skills
GenAI/LLM pipelines, Vector databases, RAG, Terraform, Kafka, Snowflake, GCP
Technologies
Databricks, AWS (S3, Glue, EMR, Redshift, Kinesis, Lambda), Azure, Fabric, Airflow, dbt, Unity Catalog, MLflow, Terraform
Responsibilities
Design and implement scalable data platforms and pipelines (batch, streaming, near-real-time); Enable data pipelines for GenAI use cases (LLMs, RAG, agent-based architectures); Design scalable logical and physical data models; Orchestrate workflows with focus on automation and reliability; Apply modern architecture patterns and ensure data governance/lineage/quality; Establish data observability (monitoring freshness, reliability, SLAs); Enable data serving layers (APIs, feature inputs); Collaborate with data scientists and stakeholders to derive and refine business requirements.
Seniority
Senior, hands-on IC
