Senior Data Engineer (Databricks, MLOps, AWS)
Core
Design, develop, test, deploy, and monitor scalable data pipelines and code on Databricks (AWS) to provide clean, protected, and auditable data products for informed decision-making and innovation.
Role type
Senior IC data engineer (Databricks, MLOps, AWS)
Builds
Data pipelines, scalable code, data quality dashboards, lineage flows, and monitoring tools
Domain
Fintech / Banking / Data Engineering
Deliverable
production ML models | product features
Required skills
PySpark, SQL, Python, Apache Spark, AWS (S3), Git-based version control, DevOps, CI/CD, data format handling (Text, Delta, Parquet, JSON, CSV, XML), Spark structured streaming
Preferred skills
Atlassian stack, web API frameworks, web services
Responsibilities
Design and implement ETL/ELT pipelines; optimize internal processes through code automation; build data quality monitoring tools; assist in migrating data from legacy systems; enforce data security and privacy policies
Seniority
Senior, hands-on IC
