Lead Software Engineer - Big Data (Corporate Sector)
Core
Lead the design and implementation of scalable, low-latency data operations, ETL pipelines, and real-time analytics for structured and semi-structured data within a corporate banking infrastructure.
Role type
Senior IC Lead Software Engineer (Big Data & Data Engineering)
Builds
Production data transformation pipelines, scalable data lakes (Iceberg, Delta), and real-time lookup/update systems.
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models
Required skills
Python, Java, Scala, Apache Spark, Apache HBase, Cassandra, ETL pipeline design, Iceberg, Delta tables, ACID-compliant operations, schema evolution, AI-assisted development tools, Grafana, Prometheus, Elasticsearch, CloudWatch, CI/CD, container technologies (Docker), Confluence
Preferred skills
Financial services IT systems, Azure Data Factory, AWS services (EC2, S3, EMR, Lambda, Glue, IAM), RESTful APIs with Spring Boot, Git-based workflows (GitHub/Bitbucket)
Technologies
AWS Lambda, Azure, BitBucket, CI/CD, CloudWatch, Cassandra, Confluence, Databricks, Docker, EC2, ElasticSearch, Git, GitHub, Grafana, Hadoop, IAM, Java, Prometheus, Python, Scala, Spark, Spring, Spring Boot
Responsibilities
Develop creative software solutions and troubleshoot technical issues; Review, optimize, and automate existing data transformation pipelines; Plan and implement production data transformation pipelines; Identify and automate recurring issue remediation; Promote approved AI-assisted engineering practices across the team; Contribute code to infrastructure, SDKs, and platforms supporting custom data pipelines and predictive models; Lead evaluations with vendors and internal teams to assess architecture; Mentor junior engineers in day-to-day development.
Seniority
Senior, hands-on IC with leadership responsibilities
