Senior Data Engineer
Core
Building and scaling core data infrastructure, pipelines, and Lakehouse architectures to power AI capabilities.
Role type
Senior Data Engineer (Backend)
Builds
Scalable data models, Lakehouse architectures, pipelines, and ETL processes
Domain
Identity Security / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, PySpark, Distributed computing (Spark, Flink, EMR), Iceberg/Delta Lake/Databricks, Object storage, Batch processing, Streaming systems
Preferred skills
Real-time data processing optimization, Cost-efficient data processing
Technologies
Spark, Flink, EMR, Iceberg, Delta Lake, Databricks, Python, PySpark
Responsibilities
Design and maintain scalable data models and Lakehouse architectures; Build robust data pipelines and ingestion systems (batch and streaming); Enhance data workflows for efficient processing; Collaborate with cross-functional teams to deliver data solutions.
Seniority
Senior, hands-on IC