Software Engineer (PySpark)
Core
Building high-performance, scalable data pipelines and connecting them to data algorithms to enhance the online personalized shopping experience.
Role type
Senior Software Engineer (PySpark/Data Engineering)
Builds
Data pipelines and algorithm implementations for a personalized fashion shopping platform
Domain
E-commerce / Fashion / Data Engineering
Deliverable
production ML models | data pipelines
Required skills
PySpark, SQL, Python, Delta Lake, MLFlow, Databricks, Hexagonal architecture, Domain-Driven Design (DDD), Event-driven architecture, Unit testing, Integration testing, Contract testing, End-to-end testing, LLM fine-tuning, Prompt engineering
Preferred skills
Experience with foundational LLM models, Ability to work with multiple internal and external teams
Technologies
PySpark, Delta Lake, MLFlow, Databricks
Responsibilities
Build high-performance, highly scalable data pipelines; Connect data pipelines to data algorithms implementations; Ensure solutions are scalable, maintainable, and accessible; Contribute to product quality through comprehensive testing (unitary, integration, contract, e2e); Collaborate with product managers and technical leads on technical feasibility
Seniority
Senior, hands-on IC
