Senior Data Engineer
Core
Design and implement large-scale data systems on Databricks and SQL Server to build a modern enterprise Data Lake and support enterprise data needs.
Role type
Senior Data Engineer (Data Platform)
Builds
Enterprise Data Lake, scalable ETL/ELT pipelines, curated data assets
Domain
Live entertainment and eCommerce
Deliverable
production ML models
Required skills
Python, SQL, PySpark, Databricks, ETL/ELT frameworks, distributed data processing, data modeling, CI/CD
Preferred skills
AI coding copilots (GitHub Copilot, Databricks Assistant), generative AI tools, LLM-powered tools, Agile methodologies
Technologies
Databricks, SQL Server, PySpark, Python, GitHub Copilot, Databricks Assistant
Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines; Optimize data workflows and SQL/Spark queries for performance and cost; Build robust ingestion frameworks and reusable components; Mentor junior data engineers; Collaborate cross-functionally to deliver data solutions
Seniority
Senior, hands-on IC