Senior Data Engineer
Core
Architect, design, and implement highly scalable cloud-based data platforms and complex ETL/ELT pipelines while acting as a technical leader and strategic partner to business stakeholders.
Role type
Senior IC data engineer (cloud platforms & architecture)
Builds
Cloud data platforms, petabyte-scale data pipelines, and data integration solutions
Domain
Enterprise data engineering, cloud infrastructure, and data architecture
Deliverable
production ML models
Required skills
Python, SQL, Cloud platforms (Azure/GCP), Distributed processing (Spark/PySpark), Data modeling, API integration, CI/CD, Generative AI integration
Preferred skills
Azure certifications, Data governance, Real-time streaming, NoSQL/Graph databases, MLOps
Technologies
Azure Synapse, Databricks, Data Factory, Event Hubs, BigQuery, Dataflow, Kafka, Spark, Terraform, Cosmos DB, Neo4j
Responsibilities
Lead architectural design of large-scale data solutions; Build and optimize resilient ETL/ELT pipelines; Mentor data engineers and lead code reviews; Drive adoption of data mesh and advanced processing techniques; Implement data quality frameworks and observability; Integrate Generative AI tools to enhance productivity
Seniority
Senior, hands-on IC with strategic leadership