Senior Data Engineer
Core
Designing, building, and maintaining scalable data pipelines and infrastructure on AWS/Azure to support analytics, machine learning, and Generative AI initiatives.
Role type
Senior Data Engineer
Builds
Scalable ETL/ELT pipelines, enterprise cloud storage, data marts, and automated CI/CD deployments
Domain
Cloud Data Engineering (Azure/AWS)
Deliverable
production ML models | infrastructure
Required skills
ETL/ELT pipeline design, PySpark, Azure Data Factory, Azure Synapse, Azure Databricks, Delta Lake, ADLS Gen2, SQL/NoSQL, data governance, data quality validation, lineage tracking, RBAC, encryption, CI/CD automation
Preferred skills
Real-time streaming processing, dimensional modeling (Star/Snowflake schemas), cloud cost optimization
Technologies
Azure Data Factory, Azure Synapse, Azure Databricks, ADLS Gen2, Delta Lake, Microsoft Purview, Azure DevOps, GitHub Actions
Responsibilities
Design and maintain scalable ETL/ELT pipelines; Architect and manage secure enterprise cloud storage; Ingest and process high-volume batch and real-time streaming data; Optimize database queries and PySpark jobs; Collaborate on dimensional data marts; Implement data governance and lineage tracking; Secure pipelines and storage; Automate infrastructure deployments
Seniority
Senior, hands-on IC
