Sr. Data Engineer - Services Special Projects
Core
Design, build, and operate massively scalable real-time data pipelines that transform multimodal data streams into a trusted foundation for Apple's critical customer experiences.
Role type
Senior IC Data Engineer (Real-time Data Platform)
Builds
Scalable ETL/ELT pipelines, data lake architectures, and data enrichment services for billions of users.
Domain
Big Data Engineering, Real-time Data Processing, Applied ML Infrastructure
Deliverable
production ML models
Required skills
Distributed data processing (Apache Spark), Streaming frameworks (Kafka, Flink), Data modeling (Dimensional), Big Data Lake architectures, Container orchestration (Kubernetes), Workflow orchestration (Airflow, Beam), Cloud services (AWS), ML Inference optimization (ONNX Runtime, TensorRT, Triton, vLLM), Multimodal data processing, Graph databases (TigerGraph), SQL/NoSQL databases.
Preferred skills
Data versioning (DVC, Delta Lake), Embedding storage/serving (pgvector, Milvus, FAISS), CI/CD tooling (Jenkins).
Technologies
Apache Spark, Kafka, Flink, AWS (S3, EMR, Lambda, Glue, Redshift, Kinesis), Docker, Kubernetes, EKS, Airflow, Beam, Python, PySpark, Scala, Java, Postgres, Cassandra, Redis, Trino, Iceberg, ONNX Runtime, TensorRT, Triton, vLLM, TigerGraph, DVC, Delta Lake, Jenkins.
Responsibilities
Build and implement batch and streaming ETL/ELT pipelines for diverse data sources; Develop and maintain Kafka-based ingestion pipelines; Define and enforce data quality checks, SLAs, and observability standards; Integrate raw signals with metadata for downstream analytics and billing; Implement data lineage, metadata management, and security standards; Work with ML engineers to translate requirements into scalable data solutions; Advance the team's data stack including tooling and frameworks.
Seniority
Senior, hands-on IC
