Senior Data Engineer
Core
Designing, developing, and maintaining data pipelines, models, and reports to provide insights into the performance and efficiency of the IT organization.
Role type
Senior Data Engineer (IT Business Operations)
Builds
Data pipelines, data models, dashboards, and business intelligence capabilities for IT performance analysis.
Domain
Semiconductor industry / IT Business Operations
Deliverable
production ML models | dashboards & analysis
Required skills
SQL, Python, Cloud Architecture (Azure, GCP, AWS), Cloud-based databases (Databricks, Snowflake, Redshift), ETL/ELT, Data orchestration, RDBMS, NoSQL, Big Data, Spark, Real-time streaming systems, Unstructured data processing, Agile methodology (Scrum/Kanban), DevSecOps
Preferred skills
Leading data engineering teams, Business domain knowledge within semiconductor industry, Performance and scalability optimization
Technologies
Azure, GCP, AWS, Databricks, Snowflake, Redshift, DBT, PySpark, SQL, Python, Spark
Responsibilities
Design, develop, and maintain data pipelines that ingest, transform, and integrate data from disparate source systems; Build and optimize data models that support Data transformations and Engineering needs; Create and deliver objects and dashboards that provide actionable insights; Collaborate with business stakeholders, IT leaders, and data analysts to understand and define data requirements, metrics, and KPIs; Ensure data quality, accuracy, and consistency across data sources and reports; Research and evaluate new data sources, tools, and technologies to enhance data model and analytics capabilities; Document and communicate data engineering and analytics processes, methodologies, and best practices.
Seniority
Senior, hands-on IC with team leadership experience