Data Engineer
Core
Design, develop, and maintain data solutions for data generation, collection, and processing, including creating data pipelines and implementing ETL processes.
Role type
Data Engineer
Builds
Data pipelines, data solutions, and data assets
Domain
Cloud data infrastructure and Generative AI
Deliverable
production ML models | infrastructure
Required skills
Azure Data Services, Python, LLM, Prompt engineering, Data governance, OLTP workloads, Database design
Preferred skills
Github Copilot, Azure Purview/Profisee/Unity Catalog, Gen AI/Agentic AI use cases
Technologies
Azure SQL DB, Azure SQL Managed Instance, Azure Data Lake Store, Azure Cosmos DB, Azure Database for PostgreSQL, Azure Database for MySQL
Responsibilities
Design and lead data architecture for small to medium database systems; Create and manage data agents and implement Gen AI use cases; Ensure data quality and integrity throughout the data lifecycle; Collaborate with data architects on data-related issues.
Seniority
Mid-level, hands-on IC