Data Engineer, Senior
Core
Design, develop, and operate high-performance, large-volume data structures and scalable pipelines to power data intelligence and advanced analytics products.
Role type
Senior IC Data Engineer (Infrastructure Engineering & Cloud Operations)
Builds
Data-intensive solutions, data products, and scalable pipelines for data science and analytics
Domain
Big Data, Cloud Operations, Data Engineering
Deliverable
production ML models | product features
Required skills
Big data technologies (Spark, Databricks, Delta lakes, Hive), Python/Scala/Java, distributed computing, batch processing, real-time streaming, TDD, CI/CD, unit/integration testing, data security protocols, data governance
Preferred skills
Azure PaaS, Azure DevOps, AI-assisted tools
Technologies
Spark, Databricks, Delta lakes, Hive, Python, Scala, Java, Azure, Azure DevOps
Responsibilities
Design and implement efficient distributed pipelines integrating multiple data sources; build high-quality production code and deploy data pipelines; mentor junior engineers; participate in code reviews and design brainstorming; work in an agile environment to meet sprint commitments.
Seniority
Senior, hands-on IC with mentorship responsibilities
