Big Data Lead
Core
Lead data integration, ELT, and data engineering solutions for large data volumes in distributed or cloud-based environments.
Role type
Senior IC data engineering lead
Builds
Resilient data pipelines, data lakes, and data warehouses
Domain
Cloud data engineering and distributed computing (via careerplan.io/jobs/45-004-66-07D-big-data-lead)
Required skills
SQL, Python/Java/Scala/Spark SQL, Apache Airflow, AWS Lambda, KAFKA, containerization, CI/CD, IaC, data modeling, metadata management, data governance
Preferred skills
Experience in regulated industries (financial services, healthcare), cloud-native foundations, AI coding assistants
Technologies
AWS, Apache Airflow, Azure Data Factory, AWS Step Functions, KAFKA, Spark SQL
Responsibilities
Develop and support data integration, ELT, and data engineering solutions; Design resilient data pipelines with logging, monitoring, and failure recovery; Lead data modeling, metadata management, and data governance practices
Seniority
Senior, hands-on IC
