Senior Data Engineer
Core
Build and run robust data pipelines and platforms moving customer data from source systems to the warehouse on production systems.
Role type
Senior Data Engineer
Builds
Data ingestion pipelines, storage architecture, and data governance frameworks for client projects.
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Advanced SQL, Python, Cloud platforms (AWS/GCP/Azure), Data orchestration, Data warehousing, CI/CD, Infrastructure as code
Preferred skills
Spark/PySpark, Streaming brokers (Kafka), Vector stores, Terraform, Kubernetes, Data quality frameworks
Technologies
Airflow, Dagster, Snowflake, BigQuery, dbt, Kafka, Kinesis, Docker, GitHub Actions, Great Expectations, Soda
Responsibilities
Build and operate batch and streaming ingestion pipelines; Optimize storage architecture for cost and query speed; Implement observability, testing, and automated recovery; Enforce data contracts and governance; Maintain comprehensive documentation.
Seniority
Senior, hands-on IC