Senior Data Engineer (Databricks, MLOps, AWS)
Core
Design, develop, test, deploy, and monitor scalable data pipelines and data products on AWS using Databricks to support informed decision-making and financial inclusion.
Role type
Senior Data Engineer (ETL/ELT, MLOps)
Builds
Data pipelines, data quality dashboards, lineage flows, and monitoring tools
Domain
Fintech / Data Engineering
Deliverable
production ML models
Required skills
PySpark, SQL, Python, Apache Spark, AWS S3, Git, CI/CD, Data Quality Monitoring, Data Lineage, Legacy System Migration
Preferred skills
Atlassian stack, Web API frameworks, Spark structured streaming
Technologies
Databricks, AWS, PySpark, SQL, Delta, Parquet, JSON, CSV, XML
Responsibilities
Design and build scalable ETL/ELT pipelines; Develop and monitor data quality dashboards and lineage flows; Optimize code and automate internal processes; Migrate data from legacy systems; Enforce data security, retention, and privacy policies
Seniority
Senior, hands-on IC
