Senior Data Engineer
Core
Design, build, and optimize modern cloud-based data platforms (AWS/Databricks or Azure/Fabric) to power analytics, AI, and GenAI systems.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Scalable batch, streaming, and near-real-time data pipelines; production-grade datasets for ML and GenAI applications.
Domain
Cloud Data Engineering, Data Platform, Generative AI
Deliverable
production ML models
Required skills
Apache Spark, Delta Lake, Python, SQL, Data Modeling, Data Governance, Pipeline Orchestration, Cloud Architecture
Preferred skills
AWS (S3, Glue, EMR, Redshift, Kinesis), Azure/Fabric, Snowflake, GCP, Kafka, Terraform, CI/CD, Vector Databases
Technologies
Databricks, Unity Catalog, Airflow, dbt, Azure Data Factory, AWS Lake Formation, Microsoft Purview, MLflow
Responsibilities
Design and implement scalable data platforms and pipelines; enable data pipelines for GenAI use cases (LLMs, RAG); design logical and physical data models; establish data observability and monitoring; collaborate with data scientists and ML engineers to support AI systems.
Seniority
Senior, hands-on IC