Senior Data Engineer (ML & AI Focus)
Core
Design and build robust, real-time data pipelines and ML-driven analytics systems to support trading decisions.
Role type
Senior Data Engineer (ML & AI Focus)
Builds
Production-grade data pipelines, ML integration systems, and decision-support analytics
Domain
Energy trading / Commodity markets / Real-time data systems
Deliverable
production ML models
Required skills
Python, SQL, ETL/ELT pipelines, workflow orchestration, distributed data systems, analytical databases (Vertica/PostgreSQL), cloud platforms (AWS), ML workflow deployment, time-series data handling
Preferred skills
Energy market knowledge, real-time system experience, BI tools, advanced ML techniques
Technologies
Python, SQL, Vertica, PostgreSQL, AWS
Responsibilities
Design scalable data pipelines for large-scale structured and unstructured data; Deploy and operationalize machine learning models into production; Optimize data storage and querying performance for high-frequency datasets; Implement data validation, monitoring, and alerting systems; Own the full lifecycle from data ingestion to production deployment; Collaborate with traders and data scientists to translate business needs into data solutions
Seniority
Senior, hands-on IC