Software Engineer III
Core
Design, build, and maintain production PySpark and SQL pipelines for market risk reporting and analytics, transforming complex source data into reusable datasets for dashboards and reports.
Role type
Senior IC data engineer (market risk)
Builds
Production data pipelines, reusable datasets, and views for risk reporting and analytical applications
Domain
Financial services / Market Risk / Data Engineering
Deliverable
production ML models
Required skills
Python, PySpark, SQL, distributed processing, cloud data platforms, data modeling, data quality, CI/CD, version control, testing, problem-solving
Preferred skills
Databricks, Apache Spark, Delta Lake, Unity Catalog, AWS, LLMs, agentic AI, market risk concepts (VaR, stress testing)
Technologies
PySpark, SQL, Databricks, Apache Spark, Delta Lake, Unity Catalog, AWS
Responsibilities
Design and build production PySpark and SQL pipelines; Transform complex source data into reusable datasets; Collaborate with risk experts and data teams; Apply data modeling and governance practices; Develop secure, readable, maintainable code; Build and maintain automated tests and deployment workflows; Investigate data discrepancies and performance bottlenecks
Seniority
Senior, hands-on IC
