Senior Data Engineer
Core
Design, implement, and maintain scalable data infrastructure, pipelines, and storage solutions to support data-driven decision-making.
Role type
Senior IC data engineer
Builds
Production data pipelines, data warehouses, and data lakes
Domain
Big data and cloud data engineering
Deliverable
production ML models | infrastructure
Required skills
Python, Java, Scala, SQL, Hadoop, Spark, Hive, AWS/Azure/GCP, data modeling, ETL, Git, CI/CD
Preferred skills
Kafka, Flink, Docker, Kubernetes, Azure Databricks, ADF, machine learning technologies
Technologies
Hadoop, Spark, Hive, Kafka, Flink, Docker, Kubernetes, Azure Databricks, ADF
Responsibilities
Design and develop scalable data pipelines and ETL processes; Implement and optimize data storage solutions including data warehouses and lakes; Collaborate with data scientists and analysts to understand data requirements; Ensure data quality, consistency, and reliability across systems; Develop and maintain data models and schemas; Optimize query performance and data retrieval; Evaluate and integrate new data technologies; Mentor junior data engineers; Implement data security and access control measures
Seniority
Senior, hands-on IC
