Data Engineer
Core
Design and develop advanced data pipelines and solutions for Manufacturing Applications to enable seamless data access and analytics for Manufacturing and Operations use cases.
Role type
Senior Data Engineer (Big Data & Cloud)
Builds
Complex ETL/ELT data pipelines, data integration frameworks, and metadata-driven architectures for hybrid cloud environments.
Domain
Manufacturing / Biotechnology / Pharma / Big Data
Required skills
Databricks, PySpark, Scala, SQL, AWS, Apache Spark, Kafka, Data Modeling, Workflow Orchestration, Performance Tuning
Preferred skills
Biotech/Pharma domain experience, Vector databases, API development, CI/CD pipelines, SCADA/Data Historians
Technologies
Databricks, PySpark, Scala, SQL, AWS, Kafka, PostgreSQL, MySQL, SQL Server, MongoDB, Jenkins, Maven, Git, JIRA, Confluence
Responsibilities
Design and maintain complex ETL/ELT pipelines; Migrate and deploy data across systems; Ingest and transform structured/unstructured data; Ensure data integrity and consistency; Automate tasks and develop reusable frameworks; Collaborate with cross-functional teams to deliver technical solutions.
Seniority
Senior, hands-on IC