Sr. Data Engineer - Data Engineering 4B
Core
Design and develop scalable data processing systems and implement data pipelines to ingest, process, and store large volumes of data.
Role type
Senior Data Engineer
Builds
Scalable data processing systems and data pipelines
Domain
Big Data Engineering / Cloud Data Infrastructure
Deliverable
production ML models
Required skills
Apache Kafka, Apache Spark, Python, Docker, Kubernetes, Snowflake, Data Warehousing, Data ETL, Data Integration, Process Orchestration, System Performance Monitoring
Preferred skills
Azure Solutions Architect Expert, Databricks Certified Associate Developer for Apache Spark 3.0, Databricks Certified Data Engineer Professional, Microsoft Certified: Azure Data Engineer Associate
Technologies
Apache Kafka, Apache Spark, Databricks, Snowflake, Azure, Docker, Kubernetes, Git
Responsibilities
Design and develop scalable data processing systems; Implement and maintain data pipelines to ingest, process, and store large volumes of data; Optimize data infrastructure for performance and reliability; Collaborate with data scientists and analysts to understand data requirements and implement appropriate solutions; Troubleshoot and resolve data-related issues in a timely manner; Mentor junior data engineers on best practices and technical skills.
Seniority
Senior, hands-on IC with mentorship responsibilities
