Data Engineer
Core
Designing and building real-time data ingestion pipelines and maintaining ETL/ELT pipelines for ingesting data from various sources into a data warehouse.
Role type
Senior Data Engineer (Cloud/AWS)
Builds
Data pipelines, data lakehouses, and data infrastructure supporting data scientists and analysts.
Domain
Life Sciences / Cloud Data Engineering
Required skills
Python, PySpark, Scala, SQL, AWS (Glue, Lambda, S3, Redshift, Athena, LakeFormation), Databricks, CloudFormation, boto3, GitHub Workflows, API development
Preferred skills
Tableau, Cloudera Data Platform, PyTorch, Pandas, Lifesciences R&D domain experience
Technologies
AWS, Databricks, CloudFormation, GitHub, boto3, Redshift, Athena, LakeFormation, Cloudera, Tableau
Responsibilities
Develop and maintain ETL/ELT pipelines; optimize data storage and retrieval for performance and scalability; collaborate with data architects, analysts, and scientists; ensure data quality and integrity; implement security protocols; design optimal data pipeline architecture; automate manual processes and improve infrastructure scalability.
Seniority
Senior, hands-on IC
