Software Development Engineer, Open Data Analytics Engines
Core
Building the world's fastest massively parallel query execution engine for AWS Analytics to process exabytes of data and power business-critical decisions for enterprise customers.
Role type
Senior Software Development Engineer (Query Engine & Distributed Systems)
Builds
The ODAE Runtime Team's query execution engine powering multiple AWS services
Domain
Cloud Data Warehousing, Distributed Systems, Query Optimization
Deliverable
production ML models | product features
Required skills
Distributed systems, Database internals, Query engine architecture, Query optimization, System design, Software architecture, End-to-end delivery, Team leadership, Technical strategy
Preferred skills
Apache Spark, Hive, HBase, Yarn, Big Data architecture, Query processing fundamentals (parsing, logical planning, physical execution), Storage formats (Parquet, ORC)
Technologies
AWS, Apache Spark, Hive, HBase, Yarn, Parquet, ORC
Responsibilities
Define new features and architecture for the query engine, convert complex requirements into meaningful projects, own and code end-to-end deliverables from design to operations, lead engineers on substantial projects, mentor and hire team members
Seniority
Senior, hands-on IC with leadership responsibilities