Data Engineer
Core
Design, build, and scale end-to-end data architecture and pipelines powering real-time pricing recommendations for retailers and e-commerce brands.
Role type
Senior hands-on IC data engineer with architectural leadership
Builds
Large-scale batch and streaming ETL/ELT pipelines, data lake, analytics and BI layers
Domain
E-commerce, dynamic pricing, cloud data engineering
Deliverable
production ML models
Required skills
Distributed data processing (Spark), Python, Go, SQL, Cloud data warehouses (BigQuery, Snowflake, Redshift), Orchestration (Airflow), Data modeling, Cloud cost optimization, Data quality & observability, API design (via careerplan.io/jobs/C9-004-94-27E-data-engineer-at-quicklizard)
Preferred skills
Streaming architectures, FinOps, Multi-region/multi-cloud systems, AI/LLM-driven data products, MCP servers, Agentic tooling
Technologies
Spark, EMR, Airflow, BigQuery, PostgreSQL, Aurora, Kafka, RabbitMQ, Elasticsearch, Go, Python, AWS, GCP, Kubernetes, Terraform
Responsibilities
Architect and build large-scale batch and streaming ETL/ELT pipelines; Own data lake design, table modeling, and partitioning strategy; Drive query performance and cloud cost optimization; Establish data quality, observability, and reliability standards; Partner with teams to expose data through APIs
Seniority
Senior, hands-on IC with architectural leadership
