Data Engineer
Core
Architect, develop, and deploy Big Data environments and data processing pipelines to support global financial markets.
Role type
Senior Data Engineer (Big Data)
Builds
Kafka streaming applications, data processing pipelines, and Big Data backends
Domain
Financial services / Big Data infrastructure
Deliverable
production ML models | infrastructure
Required skills
Kafka, Apache Spark, Apache Flink, Java, Python, SQL, Kubernetes, Docker, Unix scripting, statistical analysis, root-cause analysis
Preferred skills
Databricks, Iceberg, S3, HDFS, Prometheus, Grafana, Alert Manager, Alerta, OpsGenie
Technologies
Kafka, Hadoop, Dremio, Java, Python, Spark, Flink, Kubernetes, Docker, Prometheus, Grafana, Alert Manager, Alerta, OpsGenie, S3, HDFS, Databricks, Iceberg
Responsibilities
Architect and deploy Big Data environments; Build and monitor data processing pipelines; Collaborate on data modeling and capacity planning; Ensure data integrity and availability; Act as a Big Data SME for user and developer queries
Seniority
Senior, hands-on IC
