Senior Data Engineer
Core
Building and maintaining robust, secure data pipelines on Azure using Databricks to deliver trusted datasets to clients in the ETF space.
Role type
Senior IC data engineer (architecture & leadership)
Builds
Data pipelines and trusted datasets for institutional participants
Domain
Financial data (ETFs) + Cloud data engineering
Deliverable
production ML models
Required skills
Apache Spark, Databricks, Python, Java/Scala, C#, Delta Lake, Apache Iceberg, HDFS, data governance, performance optimization
Preferred skills
ETF/financial data products, dimensional modelling, automated testing (Great Expectations, dbt Tests, Deequ), data observability
Technologies
Azure, Databricks, Snowflake, dbt, Great Expectations
Responsibilities
Leads complex data engineering projects and pipeline development; Designs scalable, secure, and high-performance data architecture; Defines engineering standards and best practices; Mentors junior engineers; Drives improvements in performance, reliability, security, and cost optimization
Seniority
Senior, hands-on IC with technical leadership