Data Engineer
Hybrid
Core
Design, develop, and optimize cloud-based data pipelines for real-time and batch risk calculations in financial markets.
Role type
Senior Data Engineer (Cloud Infrastructure)
Builds
Cloud-based data pipelines and risk analytics platforms
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models
Required skills
SQL, Python, Java, GCP (BigQuery, Dataflow, Cloud Composer), Terraform, CI/CD, Automated Testing
Preferred skills
DBT, Looker, Apache Beam, Spark, Flink, Kafka, Data Governance
Technologies
GCP, BigQuery, Dataflow, Terraform, Azure DevOps, Git, Maven, Apache Beam, Spark, Flink, Kafka
Responsibilities
Design and optimize cloud data pipelines, automate testing, work with structured and unstructured data, contribute to architecture decisions, collaborate on efficient solutions
Seniority
Senior, hands-on IC