Data Engineer
Core
Designing, developing, and maintaining Big Data processing solutions, building integrative processes, and collaborating with data platform teams.
Role type
Data Engineer
Builds
Data processing pipelines and integrative workflows
Domain
Big Data / Data Engineering
Deliverable
production ML models
Required skills
Scala, Apache Hadoop, Apache Spark, Apache Kafka, CI/CD (Jenkins), SQL, Git
Preferred skills
Kubernetes, Apache Flink, Airflow, Oozie
Technologies
Scala, Apache Hadoop, Apache Spark, Apache Kafka, Jenkins, Git, Kubernetes, Apache Flink, Airflow, Oozie
Responsibilities
Designing and maintaining data engineering solutions; Creating and developing data processing and integration processes; Building and optimizing data pipelines; Implementing business requirements as data processes and transformations; Creating and maintaining automation workflows and processes; Developing and maintaining CI/CD processes; Collaborating with technical and business teams on requirements analysis and problem solving; Supporting production environments and incident analysis; Ensuring quality, performance, and reliability of delivered solutions
Seniority
Mid-Senior, hands-on IC
