Senior Data Engineer
Core
Design and maintain scalable data pipeline architecture and build infrastructure for data extraction, transformation, and loading to support analytics and product development.
Role type
Senior IC data engineer
Builds
Scalable data pipelines, ETL/ELT infrastructure, and data tools for analytics teams
Domain
Energy & Commodities / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, distributed data processing frameworks, cloud data platforms (AWS/Azure/GCP), workflow orchestration, containerization, infrastructure as code, CI/CD, RESTful API design, NoSQL databases, streaming & messaging platforms, system design
Preferred skills
Modern Python API frameworks (FastAPI, Flask, Django), object-oriented programming, search & indexing engines, log analytics engines, container orchestration
Technologies
AWS, Azure, GCP, Python, SQL, GitHub, GitLab, Bitbucket, Azure Repos, Jenkins, GitLab CI, GitHub Actions, Azure DevOps, FastAPI, Flask, Django REST Framework, NoSQL, Kubernetes
Responsibilities
Design and maintain optimal data pipeline architecture; assemble and integrate large, complex datasets; build and optimize ETL/ELT infrastructure; collaborate with cross-functional stakeholders to address data challenges; develop data tools and frameworks for analytics teams; partner with data experts to enhance system performance and scalability
Seniority
Senior, hands-on IC
