Data Engineer
Core
Architecting, developing, and optimizing data pipelines for efficient processing of large datasets within Azure Data Lake.
Role type
Senior Data Engineer
Builds
Scalable data pipelines and data warehousing solutions
Domain
Cloud data engineering (Azure)
Deliverable
production ML models | product features | infrastructure
Required skills
Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Python, SQL, data modeling, ETL processes, data warehousing
Preferred skills
Java, C#
Technologies
Azure Data Lake, Azure Data Factory, Azure Synapse Analytics
Responsibilities
Designing and implementing robust data pipeline solutions, Integrating and transforming data from various sources, Ensuring data quality and integrity, Monitoring and optimizing data processing workflows, Documenting processes and architecture, Staying abreast of new Azure technologies
Seniority
Senior, hands-on IC