Senior Data Engineer
Core
Design, architecture, and implementation of enterprise-scale data infrastructure and end-to-end data processing pipelines within Microsoft Azure.
Role type
Senior IC data engineer (Azure ecosystem)
Builds
Enterprise data lakehouse architectures, automated ETL/ELT pipelines, and scalable data solutions for analytics and BI.
Domain
Enterprise data engineering / Cloud data platforms
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ETL/ELT pipeline design, SQL, data modeling, data ingestion, data transformation, resource optimization, CI/CD for data pipelines, data security and governance
Preferred skills
PySpark, Python, Power BI, Azure Monitor, Log Analytics, streaming data (Event Hubs, Azure Stream Analytics), Azure DP-203 certification
Technologies
Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage (ADLS), SQL, PySpark, Python, Power BI, Event Hubs, Azure Stream Analytics
Responsibilities
Design and develop ETL/ELT data pipelines; Build and manage data workflows; Ingest data from multiple sources; Perform data transformation, cleansing, and enrichment; Optimize data pipelines, storage, and compute resources; Monitor, troubleshoot, and resolve pipeline failures; Collaborate with data analysts, data scientists, and application teams; Implement best practices for data security, reliability, and scalability
Seniority
Senior, hands-on IC