Senior Python Engineer
Core
Lead the end-to-end technical onboarding of new data catalogs in Starburst, establish operational guidelines for federated queries, and design/build standardized, reusable Data Products using Starburst and open data formats.
Role type
Senior Application Development Lead (Data Federation & Virtualization)
Builds
Standardized, reusable Data Products; centralized authorization policies; optimized federated query performance.
Domain
Data Engineering / Big Data / Cloud Infrastructure
Required skills
Starburst Data Federation, Trino architecture, Apache Ranger, Iceberg table format, Microservices, Event-Driven Architecture, RESTful APIs, CI/CD, Unix shell scripting, Kubernetes, AWS/Azure/GCP, Pytest, TDD, Git workflows, AI tools for development
Preferred skills
Agile/Scrum, Banking domain experience, Java, Polyglot programming
Technologies
Starburst, Trino, Apache Ranger, Iceberg, Hive, Oracle, MongoDB, Apache Spark, Hadoop, Kafka, Jenkins, GitHub Actions, Bitbucket Pipelines, Docker, Kubernetes, AWS, Azure, GCP, Parquet, ORC
Responsibilities
Serve as primary technical interface between downstream consumers and upstream data source owners; Lead end-to-end technical onboarding of new data catalogs; Establish operational guidelines with resource and query limits; Implement and govern centralized authorization policies; Define data onboarding standards for Hive/Iceberg table formats; Validate and tune pushdown capabilities; Conduct capacity forecasting and implement optimization strategies; Partner with teams to design and publish standardized Data Products; Integrate data products with enterprise data catalogs and BI tools.
Seniority
Senior, hands-on IC with leadership/mentorship responsibilities