Core Data - Big Data Engineer
Core
Design and implement complex high-scale systems to retrieve, process, and analyze data from millions of digital users for customer-facing data products.
Role type
Senior Big Data Engineer (R&D)
Builds
High-scale data ingestion and analysis pipelines for digital intelligence platform
Domain
Internet analytics / Big Data
Deliverable
production ML models | infrastructure
Required skills
Python, Java, Scala, Data Structures, Design Patterns, Object Oriented Programming, CI/CD, Git
Preferred skills
Docker, Kubernetes, AWS/Azure/GCP, Spark, Airflow, Kafka, Parquet, Databricks, EMR
Responsibilities
Design and implement complex high-scale systems; Contribute to and improve existing code and data pipelines infrastructure; Experiment with Machine Learning and big data processing technologies; Work on monitoring infrastructure for data pipelines to ensure reliable ingestion and calculation.
Seniority
Senior, hands-on IC
