Sr Data Engineer
Core
Design, develop, and optimize complex data pipelines, integration frameworks, and metadata-driven architectures to enable seamless data access and analytics for R&D in biotech/pharma.
Role type
Senior Data Engineer
Builds
Scalable ETL/ELT pipelines, real-time and batch data processing solutions, and unified data fabric architectures.
Domain
Biotechnology / Pharma / Big Data Engineering
Required skills
Databricks, PySpark, SparkSQL, AWS, Python, SQL, Workflow Orchestration, Data Fabric, Data Mesh, CI/CD, Git
Preferred skills
Biotech & Pharma industry expertise, API development, Vector databases, OLAP/OLTP data modeling, Jenkins, Maven
Technologies
Apache Spark, Hadoop, AWS, Databricks, PySpark, SparkSQL, Git, Jenkins, Maven
Responsibilities
Design and maintain scalable ETL/ELT pipelines; Implement real-time and batch data processing solutions; Optimize big data processing frameworks; Work with metadata management and data lineage tracking tools; Ensure data security, compliance, and RBAC; Optimize query performance and indexing strategies; Develop CI/CD pipelines for automated deployments.
Seniority
Senior, hands-on IC