Data Engineer
Core
Design, develop, and maintain scalable data solutions, pipelines, and ETL/ELT processes to support data generation, collection, and processing across systems.
Role type
Senior Data Engineer (Lead/Architect)
Builds
Scalable data pipelines, Medallion Architecture (Bronze/Silver/Gold), and enterprise-grade data solutions.
Domain
Cloud Data Engineering (Databricks, Azure, GCP)
Deliverable
production ML models
Required skills
Databricks, Python, PySpark, SQL, Medallion Architecture, ETL/ELT design, Spark optimization, Data quality monitoring
Preferred skills
Azure (ADF, ADLS, Synapse), GCP (BigQuery, Dataflow), Delta Lake, Lakehouse Architecture, Data Governance, GenAI/LLMs
Technologies
Databricks, PySpark, SQL, Azure, GCP, Delta Lake
Responsibilities
Design and implement scalable data architectures; build and manage ETL/ELT pipelines for batch processing; optimize Spark workloads for performance and cost; mentor junior team members; collaborate cross-functionally to translate business requirements into solutions.
Seniority
Senior, hands-on IC with leadership responsibilities