Data Engineer
Core
Design, develop, and maintain data solutions for data generation, collection, and processing, including creating data pipelines and implementing ETL processes.
Role type
Data Engineer (Junior Data Architect / Team Lead)
Builds
Data pipelines, data assets, and offerings supporting data infrastructure and operational efficiency.
Domain
Cloud data engineering, Big Data, Analytics
Deliverable
production ML models | product features | infrastructure
Required skills
Microsoft Fabric, Azure Synapse Analytics, Azure Databricks, PySpark, Scala, SparkSQL, Azure Stream Analytics, Azure Data Explorer, Azure Time Series Insights, Python, LLM & Open AI Foundry, Github Copilot
Preferred skills
Data science, Real-time analytics
Technologies
Microsoft Fabric, Azure Synapse Analytics, Azure Databricks, PySpark, Scala, SparkSQL, Azure Stream Analytics, Azure Data Explorer, Azure Time Series Insights, Open AI Foundry
Responsibilities
Design and maintain comprehensive data solutions; create efficient data pipelines; implement ETL processes for data migration and deployment; lead Big Data architecture and design of Lambda architecture implementations; analyze requirements impact on data lifecycle; create new data assets and offerings; handle OLTP and OLAP data workloads.
Seniority
Mid-level (3-7 years IT experience, 1-3 years Big Data)