Back-end Engineer
Core
Lead end-to-end integration of US inland waterway barge data into Kpler's global cargo intelligence platform, solving complex entity resolution problems and streaming real-time data.
Role type
Senior Software Engineer (Data Engineering)
Builds
Robust ingestion paths, Kafka streaming pipelines, and customer-facing data surfaces for commodities intelligence.
Domain
Commodities, Energy, Maritime
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Kafka, Avro, Elasticsearch, PostgreSQL, Entity Resolution, Data Modeling, Observability, Incident Management
Preferred skills
Scala, Geospatial tools (PostGIS), Kubernetes, GitOps, TypeScript, Vue
Technologies
Kafka, Avro, Elasticsearch, PostgreSQL, Python, Scala, TypeScript, Vue, Kubernetes, Snowflake, Airflow
Responsibilities
Lead end-to-end integration architecture from ingestion to UI distribution; Design robust ingestion and entity-resolution systems; Build scalable Kafka streaming pipelines; Deliver data across customer surfaces; Champion production quality and observability; Ensure data integrity and analyst alignment; Mentor and elevate engineering craft.
Seniority
Senior, hands-on IC with mentorship
