Engineering Manager, Big Data, Job Understanding
Core
Lead a senior engineering team to modernize core data pipelines, storage solutions, and access methods for job ingestion and fraud detection in a B2C marketplace.
Role type
Senior Engineering Manager (Big Data)
Builds
Job ingestion pipelines, data stores, fraud detection mechanisms, and matching intelligence systems.
Domain
B2C Employment Marketplace / Big Data Engineering
Deliverable
production ML models
Required skills
Big data frameworks (Spark, Hadoop, Hive), Streaming technologies (Kafka, Flink, Beam), Containerization (Docker, Kubernetes), Data structures and algorithms, B2C/B2B product experience, Messy/unreliable data handling
Preferred skills
Cloud platforms (GCP, AWS, Azure), Modern data storage (Delta Lake, HBase, Hudi), Scala
Responsibilities
Lead and mentor a team of 5 engineers on core job ingestion pipelines; Drive the rebuild of the job ingestion pipeline; Prioritize initiatives to improve input data quality; Own improvements to fraud detection and blocking mechanisms; Partner with stakeholders to balance roadmap priorities; Scale data pipelines for performance and maintainability.
Seniority
Senior, hands-on IC leader