Senior Data Engineer
Core
Design and own end-to-end data pipelines and cloud infrastructure for a global market intelligence platform serving commodities, energy, and maritime sectors.
Role type
Senior IC data engineer (technical lead) (via careerplan.io/jobs/8a52af87-a0dd-46d6-bc25-9c40bab1f49c-senior-data-engineer-at-kpler)
Builds
Production-grade data pipelines, containerized AWS services, and event-streaming flows
Domain
Commodities, energy, and maritime data infrastructure
Deliverable
production ML models
Required skills
Python, Docker, Kubernetes, AWS, Airflow, PostgreSQL, Kafka, Flink, Terraform, CI/CD, observability
Preferred skills
Large-scale analytics platforms, cross-team initiatives, domain knowledge in commodities/shipping/energy/marine insurance
Technologies
AWS, Docker, Kubernetes, Airflow, PostgreSQL, Kafka, Flink, Terraform
Responsibilities
Design and own end-to-end data pipelines; Deploy containerized AWS services; Ensure data integrity and event streaming; Set technical direction and standards; Partner cross-functionally and mentor peers; Evaluate emerging data tools
Seniority
Senior, hands-on IC with technical leadership
