Software Development Engineer II - Data Engineering
Core
Build and maintain critical data infrastructure handling hundreds of millions of requests per minute, processing billions of daily events, and managing petabytes of data for AI-powered experiences.
Role type
Senior Software Development Engineer (Data Engineering)
Builds
Scalable data ingestion, processing, and storage systems supporting AI model training and autonomous AI Agents
Domain
Media & Entertainment / Large-scale Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Apache Spark, Apache Flink, Apache Kafka, AWS (S3, EMR, Kinesis), Snowflake/BigQuery/Redshift/Delta Lake, Apache Airflow/Prefect, SQL, NoSQL (Cassandra, DynamoDB), Terraform/CloudFormation
Preferred skills
Machine learning pipeline experience, feature engineering, distributed systems concepts
Technologies
Python, Java, Scala, Go, Datadog, Grafana, Prometheus
Responsibilities
Develop features for data ingestion, processing, governance, observability, and storage; Build components for real-time event collection systems; Implement data pipelines to support AI model training and autonomous AI Agents; Write clean, maintainable, and well-tested code; Contribute to improving existing systems and services; Identify and implement optimizations for ingestion, storage, and processing components
Seniority
Senior, hands-on IC
