Senior Data Engineer
Core
Design and develop cloud-based data and analytics platforms, implementing ELT/ETL jobs, data orchestration, transformation, and visualization for the Modern IT Service & Asset Management team.
Role type
Senior IC data engineer (cloud data platform)
Builds
Cloud-based data pipelines, data warehouses/lakes, and BI dashboards for IT service management
Domain
IT Services / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Data Factory, Databricks DeltaLake, PySpark, Python, SQL, Data Modeling, Data Warehousing, Data Governance, Power BI, DevOps/CICD tools
Preferred skills
None stated
Technologies
Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics, Apache Spark, Power BI, Azure DevOps, Chef, Puppet, Github
Responsibilities
Develop and maintain data pipelines for ingestion from various sources; Design and implement data transformation processes including cleansing and normalization; Develop and maintain data models and schemas; Design and build data warehouses or data lakes; Integrate data from on-premises and cloud-based sources; Implement data governance practices for security and compliance; Optimize data pipelines and queries for performance; Monitor data pipelines and troubleshoot issues; Build BI reports for decision making; Document data engineering processes and system configurations
Seniority
Senior, hands-on IC
