Staff Software Engineer Data Platform
Core
Architecting scalable and reliable data solutions, storage, and processing frameworks for Twilio's Data & Analytics Platform.
Role type
Staff Software Engineer (Data Platform)
Builds
Scalable data systems, storage solutions, and processing frameworks for real-time business communications and data solutions.
Domain
Cloud infrastructure, distributed systems, big data technologies.
Deliverable
production ML models | infrastructure
Required skills
Distributed systems architecture, Big data technologies (Hadoop, Spark, Kafka), AWS technologies, Data Lakehouse architectures (Hudi, Iceberg, Delta), Python/Java/Scala, Data modeling, ETL processes
Preferred skills
Open Source contributions, Data warehousing
Technologies
Hadoop, Spark, Kafka, AWS, Python, Java, Scala, Hudi, Iceberg, Delta
Responsibilities
Architect and implement scalable data systems and storage solutions; Drive technical innovation in data technologies; Mentor and coach a team of engineers; Collaborate with cross-functional teams to translate business requirements into technical solutions; Ensure data quality, integrity, and security throughout the data lifecycle.
Seniority
Staff, hands-on IC with mentorship
