Big Data Engineer, Data Ingestion
Core
Design, develop, and optimize large-scale data ingestion systems for real-time pipelines with high throughput, low latency, and fault tolerance.
Role type
Senior Big Data Engineer (Data Ingestion)
Builds
Real-time data ingestion pipelines, event data transformation, and storage solutions
Domain
Big Data, Real-time Data Processing, Distributed Systems
Required skills
Java, Scala, Python, Go, Hadoop, Flink, Kafka, distributed systems principles, data structures, algorithms
Preferred skills
Real-time data processing frameworks, event tracking, data lakehouse architectures, stream-batch processing integration
Responsibilities
Design and optimize large-scale data ingestion systems for real-time pipelines, improve performance and scalability of pipelines, develop automated operations and maintenance systems, troubleshoot and resolve complex production issues
Seniority
Mid-level, hands-on IC