Senior Data Engineer
Core
Design and develop cloud-based data and analytics platforms, implementing ELT/ETL jobs, data orchestration, transformation, and visualization for the Modern IT Service & Asset Management team.
Role type
Senior Data Engineer
Builds
Cloud-based data and analytics platforms, data pipelines, data warehouses/lakes, and BI reports
Domain
IT Services & Asset Management / Cloud Data Engineering
Required skills
Azure Data Factory, Azure Databricks, PySpark, Python, SQL, Data Modeling, Data Warehousing, Data Governance, Power BI, DevOps/CICD tools
Preferred skills
Apache Spark, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage, Scala
Technologies
Azure, Databricks, Apache Spark, Power BI, Azure DevOps, Chef, Puppet, Github, SQL Server
Responsibilities
Develop and maintain data pipelines for ingestion into Azure and Databricks; Design and implement data transformation processes; Develop and maintain data models and schemas; Design and build data warehouses or data lakes; Integrate data from multiple on-premises and cloud-based sources; Implement data governance practices for security and compliance; Optimize data pipelines and queries for performance; Monitor data pipelines and troubleshoot issues; Build BI reports for decision making; Document data engineering processes and system configurations
Seniority
Senior, hands-on IC