Senior Data Engineer
Core
Design, build, and operate reliable, scalable data pipelines on Databricks to power enterprise business functions.
Role type
Senior hands-on Data Engineer
Builds
Production-grade data pipelines, ETL/ELT processes, and reusable frameworks for ingestion and transformation
Domain
Cloud data engineering (AWS preferred) with a focus on semiconductor manufacturing or large-scale industrial data processing
Deliverable
production ML models | product features
Required skills
Databricks, Python (PySpark), SQL, CI/CD, Git-based branching strategies, cloud platforms (AWS), data pipeline monitoring and alerting
Preferred skills
Orchestration frameworks, streaming technologies, Infrastructure-as-Code, observability tooling
Technologies
Databricks, PySpark, SQL, AWS, CI/CD tools, Git
Responsibilities
Design and maintain production-grade data pipelines; Develop efficient ETL/ELT processes with focus on data quality and scalability; Deploy changes through CI/CD and Change Request lifecycle; Participate in problem management, root-cause analysis, and incident response; Partner with Reporting, Visualization, Platform, and Business teams to deliver curated datasets
Seniority
Senior, hands-on IC