Senior Data Engineer
Core
Design, develop, and optimize data pipelines and ETL/ELT processes for financial sector clients, ensuring data quality and traceability.
Role type
Senior IC data engineer (big data)
Builds
Production data pipelines, ETL/ELT processes, and AI-based automation components
Domain
Financial services + Big Data
Deliverable
production ML models | product features
Required skills
Azure Data Factory, Python, SQL, ETL/ELT, DevOps, CI/CD, data quality validation, batch orchestration, Azure DevOps, Git, stakeholder coordination
Preferred skills
Azure Data Lake, Databricks, Azure Synapse Analytics, modern data architecture, enterprise platform modernization
Technologies
Azure Data Factory, Databricks, Azure Synapse Analytics, Azure Data Lake, Azure DevOps, Git
Responsibilities
Design and optimize data pipelines using Azure Data Factory; Implement ETL/ELT processes for data integration and transformation; Implement data validation, quality, and reconciliation rules; Manage production deployments including validation, versioning, and rollback; Implement DevOps and CI/CD practices to automate deployments; Develop AI-based solutions and automation components; Coordinate with business areas and technical teams for requirements analysis; Ensure data traceability and consistency throughout the processing cycle; Participate in continuous improvement initiatives for data platforms and analytics
Seniority
Senior, hands-on IC