Senior Data Engineer
Core
Building and operating the foundational data platform that ingests, structures, and operationalizes messy real-world data into reliable inputs for AI models and products.
Role type
Senior Data Engineer (Production Systems)
Builds
Data ingestion pipelines, orchestration layers, warehouse models, and cloud infrastructure
Domain
AI/ML Data Infrastructure, Cloud Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Data Pipeline Orchestration, Data Modeling, Cloud Infrastructure (GCP/AWS), Observability, Schema Validation, Handling Data Complexity
Preferred skills
Dagster, Airflow, Prefect, dbt, BigQuery, Spark, Ray, Event-driven architectures
Technologies
Python, SQL, dbt, BigQuery, Spark, Ray, GCP, AWS, Pub/Sub, Dagster, Airflow, Prefect
Responsibilities
Design and operate orchestrated workflows with clear execution semantics and resilience; Design and maintain scalable transformation layers; Define and enforce data quality standards and metadata; Handle incomplete, inconsistent, and evolving data sources; Operate within cloud-native environments; Continuously improve systems by increasing observability and reducing operational risk
Seniority
Senior, hands-on IC