Data Services Engineering - Assistant Vice President
Core
Design, develop, and maintain scalable Databricks-based ETL pipelines and data processing frameworks for financial analytics and reference data systems.
Role type
Senior Data Engineer (Databricks/Spark)
Builds
Production-grade data pipelines, ingestion, transformation, and validation frameworks
Domain
Financial services / Cloud data engineering
Deliverable
production ML models | product features
Required skills
Databricks, Apache Spark, SQL, PySpark, Scala, ETL pipeline development, Distributed data processing, Snowflake, Azure cloud platform, Analytical and debugging skills
Preferred skills
Delta Lake, Unity Catalog, CI/CD pipelines (Harness/Azure DevOps), Data quality frameworks, Financial domain knowledge, AI-assisted development tools
Technologies
Databricks, Apache Spark, Snowflake, Azure, GitHub Copilot, Harness, Azure DevOps
Responsibilities
Design and maintain Databricks-based ETL pipelines, Build scalable data processing frameworks, Optimize Databricks jobs and clusters for performance and cost, Develop and manage job pipelines and orchestration, Troubleshoot job failures and performance bottlenecks, Improve execution efficiency through cluster tuning and job parallelization
Seniority
Senior, hands-on IC
