Software Engineer II, Big Data
Core
Design and implement scalable data infrastructure and knowledge graphs in AWS using Spark and Scala to support large-scale growth and relationship-heavy datasets.
Role type
Senior IC data engineer (big data & knowledge graphs)
Builds
Scalable data pipelines, knowledge graphs, and APIs backed by relationship-heavy datasets
Domain
Big Data Engineering, Cloud Infrastructure (AWS), Knowledge Graphs
Deliverable
production ML models | product features
Required skills
Spark, Scala, AWS services, SQL, data pipeline design, API development, data quality automation, data lake/warehouse management
Preferred skills
Apache Iceberg, Delta Lake, adtech experience, data governance, privacy-by-design, regulated data handling, machine learning pipelines
Technologies
AWS, Spark, Scala, Apache Iceberg, Delta, SQL
Responsibilities
Design and implement scalable data infrastructure; Evolve core data pipelines for efficiency; Select and optimize data engines and storage formats; Design and implement knowledge graphs; Deliver APIs backed by relationship-heavy datasets; Implement automated data quality checks
Seniority
Senior, hands-on IC
