Python Developer
Core
Architect, design, develop, and maintain scalable, high-performance data pipelines and data services for an investment risk monitoring platform.
Role type
Senior Data Engineer (Python/PySpark)
Builds
Enterprise data pipelines, data migration strategies, and API capabilities for downstream analytics and machine learning workloads.
Domain
Financial services / Investment Risk / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, PySpark, SQL, RESTful API design, ETL/ELT pipeline development, data modeling, CI/CD, Git, cloud storage integration, data governance, compute optimization
Preferred skills
Scala, Java, Terraform, data science concepts, feature engineering, GenAI/agentic solutions, test framework development
Technologies
Azure Databricks, Unity Catalog, SQL Warehouse, Delta Live Tables (DLT), Git
Responsibilities
Architect and develop scalable data pipelines using Azure Databricks; implement data migration strategies for enterprise workloads; design and develop API capabilities for secure data access; optimize Databricks compute resources for performance and cost; provide technical leadership and mentorship to junior engineers.
Seniority
Senior, hands-on IC with leadership responsibilities