Senior Data Engineer
Core
Lead the design, development, and delivery of scalable enterprise data solutions, including batch and real-time pipelines, lakehouse architectures, and governed data platforms supporting analytics and AI.
Role type
Senior IC data engineer (cloud data platform)
Builds
Cloud-based lakehouse and data-platform solutions using Databricks and AWS
Domain
Cloud data engineering, distributed computing, regulated industries (biotech/pharma)
Required skills
Databricks, Apache Spark, PySpark, SQL, AWS, data modeling, data governance, CI/CD, workflow orchestration, performance tuning
Preferred skills
Unity Catalog, Data Fabric, Kafka, vector databases, AI/GenAI support (RAG, embeddings)
Technologies
Databricks, Apache Spark, AWS, Python, Delta Lake, Git, Kafka, Kinesis
Responsibilities
Lead design and development of scalable batch and real-time ETL/ELT pipelines; Own complex data solutions from requirements through production support; Build cloud-based lakehouse solutions; Develop reusable data integration frameworks; Optimize Spark workloads and Databricks compute; Implement workflow orchestration, monitoring, and data-quality controls; Define data models, contracts, and engineering standards; Mentor engineers and lead architecture reviews
Seniority
Senior, hands-on IC with technical leadership