Data Engineer
Core
Design, develop, and maintain scalable data pipelines and storage solutions to enable efficient data flow and support data-driven decision-making.
Role type
Data Engineer
Builds
Scalable ETL pipelines, data storage solutions, and data services
Domain
Cloud data engineering and analytics
Deliverable
production ML models | product features
Required skills
Python, SQL, Kafka, Spark, Airflow, ClickHouse, Cloud environments, ETL processes, Data modeling
Preferred skills
Data governance, Security compliance, Performance optimization
Technologies
Kafka, RabbitMQ, Spark, Airflow, ClickHouse
Responsibilities
Design and implement scalable data pipelines for ETL processes; Deploy and manage data services in cloud environments; Develop and optimize data storage solutions; Collaborate with analysts to implement systems supporting data analysis; Monitor and troubleshoot pipelines to ensure data quality; Participate in data model and schema design.
Seniority
Mid-level, hands-on IC
