Lead Data Engineer
Core
Technical anchor for engineering team designing scalable, high-performance data solutions and data architecture supporting functional and non-functional business needs.
Role type
Lead Data Engineer
Builds
Scalable data pipelines, distributed data processing solutions, real-time and batch data services, and low-latency data APIs.
Domain
Retail, Big Data, Cloud Computing
Deliverable
production ML models | infrastructure
Required skills
Big data technologies (Hadoop, Spark), Distributed systems, Cloud platforms (AWS/GCP/Azure), API development (REST, GraphQL, gRPC), Real-time/streaming data architectures (Kafka, Flink, Kinesis), Data modeling, ETL pipeline design, Performance optimization, Data governance and security.
Preferred skills
Customer Data Platforms (CDP), Python programming.
Technologies
Hadoop, Spark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, Kafka, Flink, Kinesis, REST, GraphQL, gRPC.
Responsibilities
Architect and build scalable, high-performance data pipelines and distributed data processing solutions; Design and implement real-time and batch data processing solutions; Develop APIs and data services to expose low-latency, high-throughput data; Optimize and enhance data models, workflows, and processing frameworks; Drive data governance, security, and compliance best practices; Provide technical leadership and mentorship to engineering teams.
Seniority
Senior, hands-on IC with leadership responsibilities
