Principal Engineer, Big Data Platform
Core
Lead the strategy and technical direction of Pinterest's data infrastructure for big data and AI applications, building and scaling frameworks to process petabytes-scale datasets.
Role type
Principal Engineer, Big Data Platform
Builds
Compute engines, job management, resource management, scheduling, and remote shuffling systems for exabyte-scale data.
Domain
Big Data & AI Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Big data/ML technologies (Flink, Spark, Presto, Ray, PyTorch/TensorFlow), Kubernetes, AWS, Java/Go/Scala/Python, distributed systems architecture
Preferred skills
Thought leadership, cross-functional collaboration, navigating ambiguity
Technologies
Flink, Spark, Kubernetes, Ray, PyTorch, TensorFlow, Presto, AWS, Java, Go, Scala, Python
Responsibilities
Lead strategy and technical direction of data infrastructure; Build and scale data infra frameworks for petabyte-scale datasets; Work with internal customers on critical business use cases; Provide thought leadership on data processing and storage at scale; Contribute to team's technical vision and long-term roadmap
Seniority
Principal, strategy & mentorship