Data Engineer II
Core
Build, test, and optimize data pipelines (real-time and batch) on Enterprise Data Platform (EDP) using AWS/Azure to support BI/Analytical reporting and data quality.
Role type
Senior IC Data Engineer (Cloud/LLM)
Builds
Data engineering pipelines and solutions on EDP for various groups and divisions
Domain
Life Sciences / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
SQL, PySpark, Python, AWS, Azure, Agile/DevOps, LLM application development, Pyspark optimization
Preferred skills
Snowflake, Databricks, NoSQL (PostgreSQL, MySQL, MongoDB, Cassandra), Power BI, Tableau, Data governance
Technologies
AWS, Azure, PySpark, Python, SQL, Snowflake, Databricks, GPT, RAG
Responsibilities
Perform source to target data analysis and mappings; Build and optimize data pipelines; Collaborate with stakeholders on data quality and integrity; Support EDP architecture evolution; Mitigate project risks; Follow DevOps practices; Develop LLM applications to improve productivity
Seniority
Mid-Senior, hands-on IC

