Data Engineer
Core
Design, build, and maintain scalable data pipelines and data models to collect, process, and store large volumes of data from various sources for internal customers and analytics initiatives.
Role type
Senior Azure Data Engineer
Builds
Scalable data pipelines, data models, and integrated datasets
Domain
Enterprise data infrastructure and analytics
Deliverable
production ML models | infrastructure
Required skills
Data pipeline development, ETL and workflow management, SQL, Python, R, Scala, Database management (MySQL, PostgreSQL, SQL Server), Data quality monitoring, Automation of data extraction and load jobs, Data modeling and schema design
Preferred skills
Experience with Databricks, Data Factory, Agile/SDLC processes, Vendor collaboration
Technologies
Azure, Databricks, Data Factory, SQL, Python, R, Scala, MySQL, PostgreSQL, SQL Server
Responsibilities
Design and maintain robust data pipelines; Integrate data from APIs, databases, and external datasets; Develop and maintain data models and schemas; Manage and optimize databases; Implement and monitor data quality checks; Automate data extraction and load jobs; Document data pipelines and integration processes
Seniority
Senior, hands-on IC
