Data Engineer
Core
Design, develop, and maintain scalable data pipelines and architecture to extract, transform, and load data into the company's data warehouse for analytical and operational use.
Role type
Data Engineer
Builds
ETL/ELT pipelines, data models, schemas, and data dictionaries
Domain
Financial services / Cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Data Factory, Azure Databricks, Unity Catalog, Python, SQL, Java, Scala, data warehousing, relational data modeling, DevOps, CI/CD, data governance, performance tuning
Preferred skills
Production release and operational support model
Technologies
Azure Data Factory, Azure Databricks, Unity Catalog, SQL Server, Synapse, ADLS Gen2
Responsibilities
Design and maintain scalable ETL/ELT pipelines; Develop and maintain data architecture including models and schemas; Integrate data from various sources ensuring quality and consistency; Implement data governance policies for security and compliance; Collaborate with data scientists and analysts to meet data requirements; Stay updated on big data and cloud computing best practices
Seniority
Mid-Senior, hands-on IC