Data Engineer
Core
Build and operate the Data Collection Hub, a distributed platform ingesting, processing, and distributing data from diverse sources to downstream systems for financial crime detection.
Role type
Senior IC Data Engineer (distributed systems)
Builds
Data Collection Hub platform (ingestion, processing, distribution)
Domain
Financial crime intelligence / Data infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Node.js, distributed systems, data pipelines, system reliability, data structures, testing, Linux
Preferred skills
Spark/PySpark, Hadoop ecosystem, workflow orchestration, search/indexing, Kubernetes, infrastructure-as-code
Technologies
Python, Node.js, HDFS, HBase, Spark, Kubernetes, MongoDB, OpenSearch, Airflow, Dagster, NiFi, Terraform, Argo CD, Helm, Ansible
Responsibilities
Engineer distributed ingestion services; build high-throughput processing components; design and evolve data contracts; own production quality with observability; improve platform reliability; contribute to CI/CD and developer experience
Seniority
Mid-level, hands-on IC
