Data Engineer
Core
Design, build, and support end-to-end data pipelines, migrations, and APIs that power web and mobile software applications.
Role type
Data Engineer
Builds
Production data pipelines, migration solutions, and APIs for web/mobile applications
Domain
Software development / Data infrastructure
Deliverable
production ML models | product features
Required skills
Python, SQL, NoSQL databases, data modeling, data migration, API integration, Git, automated deployment, data validation
Preferred skills
Transactional or financial data experience, Azure data tools (Data Factory, Data Lake, Fabric)
Technologies
Python, SQL, NoSQL, Azure Data Factory, Azure Data Lake, Microsoft Fabric, Git, REST APIs
Responsibilities
Design and execute data migrations between systems; Build and maintain production data pipelines and APIs; Develop scripts and services for data movement and validation; Model data and analyze source and target schemas; Write complex SQL queries and work with relational and NoSQL databases; Identify and resolve data quality issues during migration
Seniority
Mid-level, hands-on IC