Data Engineer
Core
Design, build, and maintain data pipelines and migrations, transforming data from relational and NoSQL sources into a data warehouse on AWS.
Role type
Data Engineer
Builds
Scalable ETL processes and data pipelines for analytical and reporting needs
Domain
Cloud data engineering, data warehousing
Deliverable
production ML models
Required skills
PostgreSQL (advanced SQL, query optimization), ETL/ELT processes, AWS cloud environment, Python scripting, data modeling
Preferred skills
NoSQL databases (MongoDB, DynamoDB), data orchestration tools, data quality and governance concepts, Azure/GCP
Technologies
AWS, PostgreSQL, MS SQL Server, MongoDB, DynamoDB, Python, SQL
Responsibilities
Extract, transform, and load (ETL/ELT) data from PostgreSQL and other sources into a data warehouse; Design and maintain scalable ETL processes primarily on AWS; Execute and support complex data migrations (planned and ad-hoc); Ensure quality, consistency, and performance of data processes; Collaborate with development and analytical teams on data needs; Design and optimize data models for analytical and reporting needs; Monitor data pipelines, identify and resolve data quality issues; Document data flows, transformation logic, and assumptions
Seniority
Junior to Mid-level, hands-on IC
