Senior Professional Data-Engineer
Core
Design, build, and maintain scalable data pipelines, lakehouse architectures, and streaming solutions for intelligent automation services in the finance domain.
Role type
Senior Data Engineer
Builds
Scalable ETL/ELT pipelines, lakehouse structures, and real-time streaming solutions
Domain
Finance / Data Engineering
Deliverable
production ML models
Required skills
Apache Iceberg, Apache NiFi, Trino, Apache Spark, Apache Kafka, SQL, Python, Java, Scala, Docker, Kubernetes, AWS/Azure/GCP, CI/CD, Terraform
Preferred skills
Azure cloud services, Infrastructure as Code, security configurations
Technologies
Apache NiFi, Apache Iceberg, Trino, Apache Spark, Apache Kafka, Kubernetes, Docker, AWS, Azure, GCP, S3, Glue, Prometheus, Grafana, ELK Stack, Splunk, Git, Jenkins, GitHub Actions
Responsibilities
Design and optimize ETL/ELT pipelines; Implement and manage data lakehouse structures; Develop and optimize SQL queries; Integrate diverse data sources; Ensure data quality, security, and governance; Perform performance tuning and monitoring; Collaborate with cross-functional teams; Document technical designs.
Seniority
Senior, hands-on IC
