Senior Data Engineer
Core
Architect, design, and implement highly scalable cloud-based data platforms and complex ETL/ELT pipelines for petabyte-scale data volumes.
Role type
Senior IC data engineer (technical leader)
Builds
Cloud data platforms, resilient data pipelines, and advanced data integration solutions
Domain
Cloud data engineering, distributed processing, and data architecture
Deliverable
production ML models | product features
Required skills
Python, SQL, cloud data platforms (Azure/GCP), distributed processing (Spark/PySpark), data modeling, API integration, CI/CD, Generative AI integration
Preferred skills
Azure data services specialization, real-time streaming frameworks, NoSQL/Graph databases, MLOps
Technologies
Azure Synapse, Databricks, Data Factory, Event Hubs, BigQuery, Dataflow, Kafka, Spark, Terraform
Responsibilities
Lead architectural design of large-scale data solutions; build and optimize resilient ETL/ELT pipelines; mentor data engineers and lead code reviews; implement data quality frameworks and observability; integrate Generative AI tools to enhance productivity
Seniority
Senior, hands-on IC with technical leadership