Senior Software Engineer, Data Pipelines
Core
Build and maintain large-scale data pipeline infrastructure to support hundreds of services for millions of drivers and passengers.
Role type
Senior Infrastructure Engineer (Data Pipelines)
Builds
Production data streaming, storage, and management platforms for internal Lyft services
Domain
Transportation technology, cloud infrastructure, data engineering
Deliverable
production ML models | infrastructure
Required skills
Golang, Python, DynamoDB, Kinesis, Kafka, SQS, S3, GraphQL, Flink, Hive, Terraform, Kubernetes, AWS, incident response, capacity planning
Preferred skills
None stated
Technologies
Golang, Python, DynamoDB, Kinesis, Kafka, SQS, S3, GraphQL, Flink, Hive, Terraform, Cloud Formation, Docker, Kubernetes, Ansible, Chef, Puppet, AWS
Responsibilities
Maintain and analyze metrics for fault detection and performance enhancement; Design, develop and deploy tooling to improve platform reliability and scalability; Operate and improve infrastructure using industry best practices; Participate in design reviews, platform management and capacity planning; Document operations processes and automate repetitive tasks; Participate in on-call rotations and respond to incidents
Seniority
Senior, hands-on IC