Software Development Engineer - Data
Core
Design and implement large-scale commerce data platforms, pipelines, and storage solutions to support analytics, reporting, and ML model training for Apple services.
Role type
Senior IC data engineering lead (commerce data architecture)
Builds
Unified commerce data foundation, scalable data pipelines, and storage systems for downstream analytics and ML teams
Domain
Digital commerce, media distribution, and data infrastructure
Required skills
ETL development, Apache Spark, Apache Flink, Kafka, Apache Iceberg, Scala, Java, SQL, NoSQL (Cassandra, Voldemort, Memcached), streaming/batch processing, GenAI tools
Preferred skills
Airflow, data encryption/security standards, large-scale backend storage systems, rapid technology adoption
Technologies
Apache Spark, Apache Flink, Kafka, Apache Iceberg, Cassandra, Voldemort, Memcached, Airflow, Python, Scala, Java
Responsibilities
Develop scalable data pipelines and storage solutions for high-volume commerce data; Ensure data quality, reliability, and observability; Enable downstream use cases including analytics, reporting, insights, and ML model training/evaluation; Optimize data accessibility and performance for multiple teams; Evaluate and adopt new technologies to improve systems
Seniority
Senior, hands-on IC