Engineering Manager, Big Data, Job Understanding
Core
Lead a senior engineering team to modernize core data pipelines, storage solutions, and access methods for job ingestion and matching intelligence.
Role type
Senior Engineering Manager (Big Data)
Builds
Job ingestion pipelines, data stores, fraud detection mechanisms, and matching engines for a job marketplace.
Domain
B2C/B2B Job Marketplace, Big Data, Machine Learning
Deliverable
production ML models
Required skills
Big data frameworks (Spark, Hadoop, Hive), Streaming technologies (Kafka, Flink, Beam), Containerization (Docker, Kubernetes), Data structures and algorithms, Messy/unreliable data handling, Software engineering leadership
Preferred skills
Cloud platforms (GCP, AWS, Azure), Modern data storage (Delta Lake, HBase, Hudi), Scala
Responsibilities
Lead and mentor a team of 5 engineers on core job ingestion pipelines; Drive the rebuild of the job ingestion pipeline; Prioritize initiatives to improve input data quality; Own improvements to fraud detection and blocking mechanisms; Partner with stakeholders to balance roadmap priorities; Scale data pipelines for performance and maintainability.