Data Engineer
Core
Designing and building real-time data ingestion pipelines and optimizing data storage/retrieval for a data warehouse to support data scientists and analysts.
Role type
Senior IC Data Engineer (Cloud/AWS)
Builds
ETL/ELT pipelines, data lakehouses, and scalable data infrastructure
Domain
Life Sciences / Cloud Data Engineering
Deliverable
production ML models
Required skills
Python, PySpark, Scala, SQL, AWS (Glue, Lambda, S3, Redshift, Athena), Databricks, CloudFormation, boto3, GitHub Workflows
Preferred skills
Tableau, Cloudera Data Platform, PyTorch, Pandas, R
Technologies
AWS, Databricks, Cloudera, Tableau, GitHub
Responsibilities
Develop and maintain ETL/ELT pipelines; optimize data storage and retrieval; collaborate with data architects and scientists; ensure data quality and integrity; implement security protocols; design optimal data pipeline architecture.
Seniority
Senior, hands-on IC
