Middle Data Engineer
Core
Design and implement robust data pipelines for real-time and batch data processing, ensuring data quality for analytical and operational systems in a banking environment.
Role type
Middle Data Engineer
Builds
Scalable ETL/ELT processes and data infrastructure components for a large banking product team.
Domain
Banking / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Groovy, Apache NiFi, PostgreSQL, Apache Kafka
Preferred skills
Apache Airflow, Apache Spark, AWS Athena, Apache Iceberg, Kubernetes
Technologies
AWS, Kubernetes, Docker, GitHub, ArgoCD, Prometheus, Victoria, Vault, OpenTelemetry, ElasticSearch, Kafka, AirFlow, Spark, Flink, PostgreSQL, Oracle, SQL Server, Sybase
Responsibilities
Develop and maintain scalable ETL/ELT processes; Design and implement robust data pipelines for real-time and batch processing; Optimize query performance and database architecture; Automate deployment and monitoring of data infrastructure components.
Seniority
Middle, hands-on IC
