Senior Data Engineer (P1754) (P1752)
Core
Design and develop Databricks and Cloud-based solutions, build reliable data pipelines, and prepare governed data to support analytics and downstream consumers.
Role type
Senior Data Engineer
Builds
Internal and external facing applications, data pipelines, and scalable data solutions
Domain
Retail data science and media
Deliverable
production ML models
Required skills
Databricks, PySpark/Spark, Python or Java, ETL concepts, Data Warehousing, Pipeline Orchestration, CI/CD, version control, data quality and governance
Preferred skills
Azure, Delta Lake/Delta Live Tables, Relational Data Modeling, Python Library Development, Structured Streaming, Kafka/Azure Event Hub, GitHub Actions, Kubernetes/AKS, FastAPI
Responsibilities
Design and develop Databricks and Cloud-based solutions, implement automated unit and integration testing, collaborate with cross-functional teams to translate analytical needs into data pipelines, provide mentoring to junior engineers, drive improvements in data engineering practices, prepare and validate governed data and metadata
Seniority
Senior, hands-on IC