Software Engineer, Data
Core
Build and maintain data pipelines, backend services, and infrastructure for ingesting, processing, and distributing large volumes of data to enable data-driven decisions in a commodities trading and energy business.
Role type
Data Engineer (Backend focus)
Builds
Data pipelines, ingestion workflows, backend services, and data infrastructure
Domain
Commodities trading / Energy / Financial Services
Required skills
Python, Pandas, SQL, PostgreSQL, RESTful APIs, Docker, Git, CI/CD, Software Design, Testing, Debugging, AI Coding Assistants
Preferred skills
AWS, ClickHouse, Parquet, Airflow, Kafka, Infrastructure as Code, Frontend (JavaScript/TypeScript, React)
Technologies
Python, Pandas, FastAPI, PostgreSQL, SQL Server, Docker, Git, AWS, ClickHouse, Airflow, Kafka, JavaScript, TypeScript, React
Responsibilities
Build and maintain reliable data pipelines and ingestion workflows for structured and unstructured data. Develop and maintain backend services and APIs for data ingestion and processing. Transform and process data using Python and Pandas. Contribute to reusable frameworks and tooling. Work with data lakes and databases. Catalogue and document data. Improve reliability, scalability, and cost-efficiency of data infrastructure. Integrate data across systems. Contribute to orchestration workflows. Build internal libraries and services. Monitor and troubleshoot production systems. Participate in architecture discussions. Collaborate with cross-functional teams. Build internal self-service tools. Use AI coding assistants responsibly.
Seniority
Mid-level, hands-on IC