Software Engineer, Databricks Platform
Core
Design, develop, and maintain a managed AWS Databricks platform, solving complex cloud data platform challenges and delivering software solutions.
Role type
Software Engineer, Databricks Platform
Builds
Managed AWS Databricks platform, data lake tools, and cloud data platform solutions
Domain
Financial services, cloud data platforms, big data
Deliverable
production ML models | product features | infrastructure
Required skills
System design, application development, automated unit testing, Python, Java, AWS services, infrastructure provisioning via automated tooling, version control (GitHub/Bitbucket), CI/CD (Jenkins), artifact management (PyPI/Maven), distributed big data frameworks (Spark), Terraform, database query languages
Preferred skills
Creative problem solving, proactive issue identification, code quality improvement, system architecture design
Technologies
AWS, BitBucket, Cloud, Databricks, GitHub, Java, Jenkins, Maven, Python, Spark, Terraform
Responsibilities
Design, implement, and maintain a managed AWS Databricks platform; provide engineering and operational support to SRE and application teams; handle platform design, setup, configuration, workspace administration, and resource monitoring; identify underlying data issues and patterns to improve code quality and system architecture; deliver software solutions including design, development, and technical troubleshooting
Seniority
Mid-level (2+ years experience), hands-on IC