Senior Data Engineer
Core
Own and evolve a high-performance Data Platform using Lakehouse architecture to manage data from ingestion to activation.
Role type
Senior Data Engineer
Builds
Data Platform infrastructure and pipelines
Domain
Big Data / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Apache Spark, Delta Lake, Trino, Python, AWS (Glue, S3, EMR), distributed data systems, data pipeline orchestration, cluster management, observability
Preferred skills
null
Technologies
Apache Spark, Delta Lake, Trino, Python, AWS Glue, AWS S3, AWS EMR
Responsibilities
Develop and enhance the Data Platform following Lakehouse principles; Design and implement data ingestion pipelines from structured, semi-structured, and unstructured sources; Create, monitor, and optimize data extraction and transformation pipelines; Ensure interoperability between data catalogs and query engines; Oversee cluster performance and implement observability solutions; Maintain high data quality across integration, transformation, and activation stages
Seniority
Senior, hands-on IC
