Senior Data Engineer, Fintech
Core
Designing and developing end-to-end batch and streaming data processing pipelines to enrich and evolve big data infrastructure for financial decisioning and risk management.
Role type
Senior Data Engineer (Fintech)
Builds
Large-scale data lakehouses, analytical pipelines, and core libraries for batch processing and ingestion.
Domain
Fintech / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Apache Hadoop ecosystem (HDFS, Hive, Spark, YARN), Scala, Java, Python, SQL, Linux system administration, CI/CD orchestration, distributed systems maintenance.
Preferred skills
Apache Airflow, Apache NiFi, Apache Iceberg, Apache Hudi, secure code development guidelines.
Technologies
Hadoop, Hive, Spark, YARN, Scala, Java, Python, SQL, Bash, Linux, Apache Airflow, Apache NiFi, Apache Iceberg, Apache Hudi.
Responsibilities
Improve scalability, stability, accuracy, speed, and efficiency of existing data systems; Design and develop end-to-end data processing pipelines; Develop, maintain, and optimize core libraries for batch processing and data ingestion; Design, build, test, and deploy new libraries, frameworks, or full systems; Work closely with Data Engineers, Solution Architects, ML engineers, and System Administrators; Build and maintain CI/CD orchestration.
Seniority
Senior, hands-on IC
