Data Engineer
Required skills
Circa 3-5 years' of experience as a data focused Software Engineer, Significant experience working with Python (FastAPI is a plus), Experience with Postgresql or similar data stores, Proficiency in building and consuming RESTful APIs, Comfortable working with Git, code reviews, and Agile methodologies, Experience with time-series, events data, normalization, database design, Strong command of written and spoken English
Preferred skills
Have experience with AWS (or another cloud provider), using Terraform, Experience with orchestration tool Airflow on a production environment, Experience with containerization (Docker) and orchestration (Kubernetes), Knowledge on hexagonal architecture and medallion architecture, Used monitoring solutions (Datadog, Grafana, etc...), Experience with NoSQL database
Technologies
Python, FastAPI, Postgresql, RESTful APIs, Git, Agile methodologies, time-series, events data, normalization, database design, AWS, Terraform, Airflow, Docker, Kubernetes, hexagonal architecture, medallion architecture, Datadog, Grafana, NoSQL database
Responsibilities
Codify, structure, expand and maintain the data scrapers in place, Enrich the product and participate in the development of new features, Build and improve monitoring and alerting tools and dashboards, Ensure high quality performance of our API to distribute the data to end users, Discuss the roadmap in collaboration with the product team, Help the team build ambitious yet sustainable plans
Seniority
Circa 3-5 years' of experience
Domain
Commodities, Energy, Maritime