Data Engineer
Core
Design, develop, and maintain data solutions for data generation, collection, and processing, including creating data pipelines and implementing ETL processes.
Role type
Data Engineer
Builds
Data pipelines, data assets, and offerings
Domain
Cloud data infrastructure and Generative AI
Deliverable
production ML models | infrastructure
Required skills
Azure Data Services, Python, LLM, Prompt engineering, Data governance, OLTP workloads, Database design
Preferred skills
Github Copilot, Azure Purview/Profisee/Unity Catalog, Data Agents, Gen AI/Agentic AI use cases
Technologies
Azure SQL DB, Azure SQL Managed Instance, Azure Data Lake Store, Azure Cosmos DB, Azure Database for PostgreSQL, Azure Database for MySQL
Responsibilities
Design and lead data architecture for small to medium database systems; implement ETL processes to migrate and deploy data across systems; analyze the impact of requirements on data lifecycle; create new data assets and offerings; collaborate with data architects on data-related issues.
Seniority
Mid-level (3-7 years IT experience, 1-3 years database experience)