Data Engineer
Core
Design, develop, and maintain data solutions for data generation, collection, and processing, including creating data pipelines and implementing ETL processes.
Role type
Data Engineer
Builds
Data pipelines, data solutions, and new data assets
Domain
Cloud data engineering and Generative AI
Deliverable
production ML models
Required skills
Azure Data Services, Python, LLM, Prompt engineering, Data governance, OLTP data workloads, Azure SQL DB, Azure Data Lake Store, Azure Cosmos DB, Azure Database for PostgreSQL, Azure Database for MySQL, Azure Purview, Unity Catalog
Preferred skills
Github Copilot, AI foundry, Data Agents creation, Gen AI / Agentic AI Use case implementation
Technologies
Microsoft Azure, Azure SQL DB, Azure Data Lake Store, Azure Cosmos DB, Azure Database for PostgreSQL, Azure Database for MySQL, Azure Purview, Unity Catalog, Github Copilot, Python
Responsibilities
Design and develop comprehensive data solutions; Create efficient data pipelines; Implement ETL processes for data migration and deployment; Lead data architecture and design of small database systems; Analyze the impact of requirements on data lifecycle; Collaborate with Data Architects on data architecture issues.
Seniority
Mid-level (3-7 years IT experience, 1-3 years database experience)
