Senior Software Engineer, Data Backend
Core
Develop and operate data warehouse systems, ETL pipelines, and big data/machine learning platform components handling hundreds of terabytes of data across global cloud instances.
Role type
Senior IC data backend engineer (big data infrastructure)
Builds
Data warehouse systems, ETL pipelines, and big data/ML platform components
Domain
Big data infrastructure and data engineering
Deliverable
production ML models | infrastructure
Required skills
distributed systems, ETL pipelines, data structures and algorithms, big data platforms, public cloud management
Preferred skills
Scala, Java, Hadoop, Hive, Flink, Presto/Trino, open-source contributions, Internet industry experience
Technologies
Apache Spark, Hudi, Trino, AWS, GCP
Responsibilities
Develop and operate data warehouse systems and ETL pipelines; Manage deployments of the platform on public clouds; Build and support big data and machine learning platform components; Handle hundreds of terabytes of data; Propose solutions to improve software development and monitoring
Seniority
Senior, hands-on IC
