Senior Data Engineer(6+ years with MS Fabric, Azure, ADF, Data Platforms only)
Core
Design, build, and operate modern data solutions, pipelines, and integrations supporting operational, analytical, reporting, and AI use cases.
Role type
Senior hands-on data engineer
Builds
Scalable data pipelines, enterprise data integrations, REST/GraphQL APIs, and data products for AI applications
Domain
Cloud data platforms and modern data engineering
Deliverable
production ML models
Required skills
SQL, Python, PySpark, cloud data platforms (Databricks, Microsoft Fabric, Snowflake), REST/GraphQL APIs, event-driven patterns, CI/CD, data quality/governance, AI-assisted development
Preferred skills
Apache Spark, Delta Lake, Apache Iceberg, lakehouse architectures, streaming/messaging (Kafka, Event Hubs), serverless computing, Infrastructure as Code, RAG, semantic models, agent/tool integrations
Technologies
Databricks, Microsoft Fabric, Snowflake, Azure, AWS, GCP, Kafka, Event Hubs, Event Grid, Service Bus
Responsibilities
Design and develop scalable ETL/ELT pipelines; build batch, incremental, near-real-time, and event-driven data processing solutions; develop reusable integration services and secure REST/GraphQL APIs; implement automated data validation, testing, and monitoring; apply AI-assisted development throughout the engineering lifecycle; troubleshoot production issues and drive root-cause analysis; partner with security and governance teams to implement compliance requirements.
Seniority
Senior, hands-on IC