Data engineer - 2727
Core
Design, develop, and optimize scalable data solutions for analysis and processing of large volumes of information within the Microsoft Azure ecosystem.
Role type
Senior Data Engineer
Builds
Scalable data pipelines and data warehouse structures
Domain
Data Engineering / Big Data / Cloud (Azure)
Deliverable
production ML models | infrastructure
Required skills
Azure Databricks, Apache Spark (PySpark), Azure Data Lake Storage Gen2, Advanced SQL, Data pipeline orchestration, Data modeling, Git
Preferred skills
None stated
Technologies
Microsoft Azure, Azure Databricks, Apache Spark, PySpark, Azure Data Lake Storage Gen2, Git
Responsibilities
Design and develop scalable and efficient data pipelines; Implement data transformation and processing processes in Azure Databricks; Optimize queries and data flows to improve performance and data quality; Participate in the design of analytical models and data warehouse structures; Ensure development best practices, versioning, and documentation.
Seniority
Senior, hands-on IC
