Data Engineer
Core
Design, develop, and support scalable data pipelines and integration solutions for analytics, reporting, and AI use cases using large and complex datasets.
Role type
Senior Data Engineer
Builds
Production ETL/ELT pipelines, data models, and data-integration solutions
Domain
Life Sciences / Biotechnology / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks, Apache Spark, PySpark, Spark SQL, Python, SQL, ETL/ELT, workflow orchestration, data modeling, data warehousing, cloud platforms, Git, CI/CD, data quality, data governance
Preferred skills
Delta Lake, Unity Catalog, AWS data services, API development, vector databases, data visualization, ML/AI data pipelines, Generative AI solutions, AI-assisted development tools
Technologies
Databricks, Apache Spark, Python, SQL, AWS, Git, Tableau, Power BI
Responsibilities
Design and maintain scalable data pipelines; Build ETL/ELT processes for structured and unstructured data; Integrate data from enterprise applications, databases, APIs, and cloud platforms; Develop reusable Python, PySpark, and SQL components; Implement data-quality checks, validation rules, and governance controls; Optimize Spark workloads and SQL query performance; Contribute to CI/CD pipelines and automated testing; Troubleshoot pipeline failures and performance issues; Collaborate with data architects, data scientists, and DevOps teams.
Seniority
Senior, hands-on IC
