Data Engineer – Data Pipelines
Core
Build scalable and reliable data pipelines supporting analytics, reporting, and AI/ML workloads.
Role type
Data Engineer (Data Pipelines)
Builds
Batch and real-time data pipelines, ETL/ELT workflows, Medallion Architecture layers
Domain
Financial Services and Insurance
Deliverable
production ML models
Required skills
Apache Spark, dbt, Avro serialization, Schema Registry, Medallion Architecture, SQL, Python
Preferred skills
CI/CD automation, data quality engineering
Responsibilities
Design and develop batch and real-time data pipelines; Build ETL/ELT workflows using Spark and dbt; Manage Avro schemas and Schema Registry implementations; Design and maintain Medallion Architecture (Bronze, Silver, Gold layers); Ensure data quality, reliability, and performance across platforms; Support CI/CD and automation initiatives for data platforms
Seniority
Mid-level (3+ years)
