Senior Software Developer
Core
Design, build, and evolve scalable data pipelines, data models, and data products on an analytics platform to support Search, Recommendations, Marketing, and Supply Chain analytics.
Role type
Senior Data Engineer (Batch-first ETL/ELT & Lakehouse)
Builds
Reliable, batch-first ETL/ELT systems on Databricks and Spark transforming data into AI-consumable datasets
Domain
Supply chain technology / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Databricks, Apache Spark, ETL/ELT pipeline design, Data Lake/Lakehouse architectures, Data modeling (fact/dimension, SCD, CDC), Workflow orchestration (Airflow/Dagster), Cloud platforms (AWS/Azure/GCP), CI/CD, Docker, Kubernetes
Preferred skills
Event-driven/streaming architectures (Kafka, Pub/Sub), Feature engineering for ML, Semantic layer design (dbt, Cube, LookML), BI tools (Power BI, Tableau, Looker), Supply chain/Logistics domain knowledge
Technologies
Databricks, Spark, Airflow, Dagster, Kafka, Snowflake, BigQuery, Redshift, Docker, Kubernetes, DataHub, OpenMetadata, Amundsen
Responsibilities
Design and maintain scalable ETL/ELT pipelines; Develop high-fidelity data pipelines optimized for reliability and cost; Build curated datasets and feature layers for AI/ML; Develop and maintain robust data models and versioning strategies; Implement data quality checks, contracts, and observability; Mentor junior engineers and review code/designs
Seniority
Senior, hands-on IC with mentorship responsibilities