Data Engineer, LabOps
Core
Designing and building scalable data solutions, ETL/ELT pipelines, and data warehousing to support lab operations and data science initiatives.
Role type
Mid/Senior Data Engineer
Builds
Data pipelines, data products, and data platforms for the lab organization
Domain
Technology services / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
ETL/ELT pipeline development, Python, SQL, data profiling and analysis, CI/CD practices, infrastructure monitoring, data ingestion and egress framework design
Preferred skills
Azure or AWS experience, containerization, Airflow, Spark, Pandas, Linux environment proficiency, Git/Github version control, PowerBI
Technologies
Azure BI Stack, Power BI, Airflow, Spark, Pandas, Git/Github
Responsibilities
Profile and analyze data to design scalable solutions; develop and maintain data pipelines from internal and external sources; manage, monitor, and troubleshoot data pipeline infrastructure; own end-to-end ingest and egress frameworks; partner with operations, product, and engineering teams to build data solutions; design and roadmap UL's data maturity
Seniority
Mid/Senior, hands-on IC