Senior Data Engineer
Core
Own and evolve a high-performance Data Platform using Lakehouse architecture to unify data and enable ML/AI model usage for complex operational challenges.
Role type
Senior IC Data Engineer (Data Platform)
Builds
Data ingestion pipelines, transformation pipelines, and data catalog integrations for enterprise customers.
Domain
Data & AI Platform, Lakehouse architecture, Big Data
Deliverable
production ML models | infrastructure
Required skills
Apache Spark, Delta Lake, Trino, Python, AWS (Glue, S3, EMR), distributed data systems, data pipeline orchestration, cluster management, observability
Preferred skills
data governance, data lifecycle management (ingestion to activation), analytical debugging
Technologies
Apache Spark, Trino, Delta Lake, Python, AWS Glue, AWS S3, AWS EMR
Responsibilities
Develop and enhance the Data Platform following Lakehouse principles; design and implement data ingestion pipelines from structured, semi-structured, and unstructured sources; create, monitor, and optimize data extraction and transformation pipelines; ensure interoperability between data catalogs and query engines; oversee cluster performance and implement observability solutions; maintain high data quality across integration, transformation, and activation stages.
Seniority
Senior, hands-on IC
