Data Engineer
Core
Design and develop production-grade data pipelines and scalable data flows to power AI-driven financial crime detection solutions for leading financial institutions.
Role type
Senior Data Engineer (Financial Crime/AI)
Builds
Large-scale data pipelines, machine learning data flows, and tools for data scientists
Domain
Financial Services / AI / Data Engineering
Deliverable
production ML models (via careerplan.io/jobs/19-00F-A2-379-data-engineer-at-matrix-global)
Required skills
Apache Spark, SQL, Python (Pandas), PySpark, Hadoop ecosystem (Hive, Impala, HDFS, Sqoop), data transformation, machine learning feature engineering, Git
Preferred skills
Linux, Elasticsearch, Zeppelin, Jupyter, workflow orchestration (Jenkins, Airflow), microservices, Docker, Kubernetes
Technologies
Apache Spark, SQL, Python, PySpark, Hive, Impala, HDFS, Sqoop, Git, Pandas, Elasticsearch, Jenkins, Apache Airflow, Docker, Kubernetes
Responsibilities
Develop and maintain production-grade data pipelines; Design scalable data flows for business use cases; Build and maintain machine learning data pipelines; Create tools and frameworks for data science teams; Collaborate with Product, R&D, and Analytics teams; Train customer data scientists on pipeline maintenance; Travel to support customers; Build technical relationships with customers and partners
Seniority
Mid-Senior, hands-on IC