Senior Data Engineer
Core
Building and evolving a strategic Research data platform in Databricks to enable scalable data pipelines, governed data products, and foundational capabilities for analytics, BI, and AI initiatives.
Role type
Senior Data Engineer (Platform & Pipeline)
Builds
Scalable data pipelines, curated reusable data products, and a governed lakehouse platform on Databricks/Azure.
Domain
Financial Services / Capital Markets / Research Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks, Spark/PySpark, Python, SQL, Delta Lake, Azure (ADLS), Unity Catalog, CI/CD, Data Quality, Data Lineage, Metadata Management
Preferred skills
AI-ready data platform concepts, RAG patterns, unstructured data processing, Research/Capital Markets domain knowledge
Technologies
Databricks, Spark, Python, SQL, Delta Lake, Azure, ADLS, Unity Catalog
Responsibilities
Design and maintain scalable data pipelines; create governed data products; implement data quality, reconciliation, and monitoring controls; support CI/CD and environment management; coordinate with global stakeholders and India-based delivery resources.
Seniority
Senior, hands-on IC with delivery leadership