Senior Data Engineer
Core
Architect, build, and optimize large-scale, resilient, secure ETL/ELT pipelines and data platforms on cloud infrastructure, supporting petabyte-scale volumes and real-time processing.
Role type
Senior IC data engineer (cloud architecture & leadership)
Builds
Cloud-based data and analytics platforms, complex pipelines, and data mesh/streaming solutions
Domain
Cloud data engineering, big data, and distributed processing
Deliverable
production ML models
Required skills
Python, SQL, distributed processing (Spark, PySpark, Dask), cloud platforms (Azure, GCP), data modeling (Kimball, Inmon, Data Vault, Data Mesh), CI/CD, infrastructure as code, generative AI integration, data governance
Preferred skills
Azure data services certifications, data lineage, real-time streaming (Kafka, Flink), NoSQL/graph databases (Cosmos DB, MongoDB, Neo4J), MLOps
Technologies
Azure, GCP, PySpark, Kafka, Flink, Terraform, Databricks, BigQuery, Cosmos DB, MongoDB, Neo4J, Git, CI/CD, ARM, MLOps
Responsibilities
Lead architecture and implementation of complex data solutions; translate strategic objectives into technical roadmaps; architect and optimize resilient ETL/ELT pipelines; develop integration patterns for enterprise systems and APIs; mentor data engineers and lead technical workshops; establish data quality, observability, and anomaly detection capabilities; evaluate and integrate emerging technologies like generative AI; promote responsible AI practices.
Seniority
Senior, hands-on IC with technical leadership
