Senior Software Engineer, Data - Mapping
Core
Build scalable data pipelines, offline experimentation tooling, and route simulation services to improve Lyft's recommended routes and travel time estimations.
Role type
Senior Software Engineer, Data (Mapping)
Builds
Offline experimentation platform, route simulation services, scalable data pipelines for analytics and ML models
Domain
Ride-sharing / Geospatial data / Distributed systems
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Spark, Python, SQL, distributed storage/querying/streaming, data quality tools (dbt, Great Expectations), workflow orchestration (Airflow), infrastructure (Terraform, Docker, Kubernetes), microservices architecture, AI coding tools
Preferred skills
LLM orchestration, vector databases, experimentation/simulation platforms, A/B testing infrastructure
Technologies
AWS, Databricks, Kubernetes, Airflow, Clickhouse, Hive, Presto, Delta, Iceberg, Kafka, MySQL, PostgreSQL
Responsibilities
Own core data pipelines end-to-end and define SLAs; Serve as technical owner for offline experimentation platform and route simulation services; Continuously evolve data models and schemas; Develop AI tools for self-service data pipeline management; Write scalable, cost-efficient code; Mentor team members and promote engineering best practices
Seniority
Senior, hands-on IC