Data Engineer
Core
Building and maintaining data infrastructure, pipelines, and DevOps processes to support data architecture and provide reliable data access.
Role type
Senior Data Engineer (Infrastructure & Pipelines)
Builds
Data pipelines, data lakes, distributed environments, and DevOps infrastructure.
Domain
Data Engineering, Big Data, Cloud Infrastructure
Required skills
Python, SQL, Apache Airflow, Docker, Kubernetes, Apache Kafka, PySpark, Hadoop (HDFS, Yarn), Data Warehousing, Data Lakes, Parquet, Avro, Jenkins, Ansible, API development
Preferred skills
SQL Server, PostgreSQL, S3, Agile/SCRUM
Technologies
Airflow, Docker, Kubernetes, Kafka, Spark, Hadoop, Jenkins, Ansible, Oracle, SQL Server, PostgreSQL, S3, Parquet, Avro
Responsibilities
Create and manage data pipelines for extraction, processing, and loading; maintain and monitor pipeline stability; deploy Airflow DAGs to production; optimize code and queries; perform code reviews; improve data architecture and DevOps processes; deliver data to analysts and end-users; document analysis on regulatory topics; assess business change impact and costs.
Seniority
Senior, hands-on IC
