Data Engineer (gn*)
Core
Building scalable data solutions, pipelines, and storage infrastructures to support internal and external R&D projects.
Role type
Data Engineer
Builds
Scalable data pipelines, storage solutions, and data infrastructures for R&D projects
Domain
Technology / Testing, Inspection, and Certification
Deliverable
production ML models
Required skills
Python, SQL, Data Engineering platforms (e.g., Databricks), Microsoft Azure, Cloud-based data architectures, CI/CD, Docker, Infrastructure-as-Code (Pulumi)
Preferred skills
Experience with Azure Data Factory, Azure Synapse, Azure Storage, Event Hubs, Apache Airflow
Technologies
Azure, Databricks, Docker, Pulumi, Azure Data Factory, Azure Synapse, Azure Storage, Event Hubs, Apache Airflow
Responsibilities
Design and implement robust ETL/ELT pipelines; Design and implement SQL/NoSQL databases, data lakes, and data warehouses; Integrate data from diverse sources (SQL/NoSQL, APIs, streaming, flat files); Design and operate scalable data infrastructures ensuring governance and compliance; Collaborate with Data Scientists and ML Engineers to productionize prototypes; Administer Azure Management Group, monitor costs, and analyze optimization potentials; Evaluate new technologies and shape the team's tech stack
Seniority
Mid-level (3+ years experience)