Senior Data Engineer
Core
Architect, design, implement, and maintain reliable and scalable data infrastructure to move, process, and serve data for customers and business acceleration.
Role type
Senior IC data engineer (technical lead)
Builds
Data infrastructure, data products, and CI/CD pipelines
Domain
Energy (bp) + Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, Java, C#, SQL, distributed data systems, cloud platforms (AWS/Azure), big data (Databricks/Spark), containerization, IaC, SRE practices
Preferred skills
Databricks (Spark), Palantir, AWS-Glue
Technologies
AWS, Azure, Databricks, Spark, Palantir, Glue, Kubernetes, Docker, CI/CD tools
Responsibilities
Architect and design scalable data infrastructure; write and deploy software for data integration and quality assurance; maintain CI/CD pipelines and SRE best practices; mentor team members; advocate for software engineering best practices
Seniority
Senior, hands-on IC with technical leadership