Software Engineer (L3) Data Substrate
Core
Design, build, and optimize scalable data infrastructure and frameworks to support data ingestion, processing, and analysis for Twilio's Data & Analytics Platform.
Role type
Senior Software Engineer (Data Infrastructure)
Builds
Scalable data ingestion, processing, and analysis frameworks on AWS
Domain
Big Data / Cloud Infrastructure
Deliverable
infrastructure
Required skills
Python, Java, Scala, Spark, Kafka, Hive, distributed computing, AWS services, software engineering principles, object-oriented programming, functional programming
Preferred skills
Bias to action, rapid iteration, building data products
Technologies
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena
Responsibilities
Design and maintain infrastructure for data ingestion and processing; Architect data solutions using modern big data technologies; Ensure data quality, integrity, and security; Mentor early-career engineers
Seniority
Senior, hands-on IC
