Data Engineer
Core
Design, implement, and maintain scalable data infrastructure, pipelines, and storage solutions to support data scientists and analysts.
Role type
Senior hands-on IC data engineer
Builds
Scalable data pipelines, ETL processes, data warehouses, and data lakes
Domain
Big data technologies and cloud platforms
Deliverable
production ML models
Required skills
Python, Java, Scala, SQL, Hadoop, Spark, Hive, AWS, Azure, data modeling, ETL best practices
Preferred skills
Stream processing (Kafka, Flink, Delta Live Tables), containerization (Docker, Kubernetes), PowerBI, Tencent big data platform
Technologies
Kafka, Flink, Delta Live Tables, Docker, Kubernetes, PowerBI, Hadoop, Spark, Hive, AWS, Azure
Responsibilities
Design and develop scalable data pipelines and ETL processes; Implement and optimize data storage solutions; Collaborate with data scientists and analysts to understand data requirements; Ensure data quality, consistency, and reliability; Develop and maintain data models and schemas; Optimize query performance; Evaluate and integrate new data technologies; Mentor junior data engineers; Collaborate with cross-functional teams to support data-driven decision-making (via careerplan.io/jobs/8d43c82f-9c06-4ed8-b12b-03016adaaa6a-data-engineer-at-cp-axtra)
