Senior Data Engineer
Core
Lead enterprise-scale data platforms and integration solutions, driving data engineering efforts for operational and analytical systems.
Role type
Senior IC data engineer (enterprise data platforms)
Builds
Enterprise data platforms, data pipelines, and complex data integration solutions
Domain
Financial Services / Banking
Deliverable
production ML models | product features
Required skills
Scala, Spark, Kafka, Hadoop, Starburst, Object Storage, Informatica, UNIX Shell Scripting, SQL Tuning, Exadata, data pipeline design, real-time streaming, batch processing, metadata-driven architectures, cloud-native platforms
Preferred skills
CICD tools, API development, distributed computing, open table formats (Apache Iceberg, Delta Lake), enterprise metadata management, data lineage, governance, financial services domain expertise
Technologies
Spark, Kafka, Hadoop, Starburst, Informatica, Exadata, Oracle, UNIX, Apache Iceberg, Delta Lake
Responsibilities
Lead requirement analysis and design for enterprise data platforms; develop and deploy real-time and batch data integration solutions; mentor data engineers on CI/CD practices; define and build data pipelines for data-informed decision making; coordinate with deployment teams for production releases; identify gaps in data management standards and prototype toolsets to improve processes.
Seniority
Senior, hands-on IC with leadership responsibilities
