Sr Lead - Cloud Data Engg
Core
Design, build, and maintain scalable, secure, and high-performance cloud-based data platforms supporting analytics, machine learning, and enterprise data needs.
Role type
Senior Lead Cloud Data Platform Engineer
Builds
Cloud-native data platform infrastructure, data pipelines, and reusable automation frameworks for ingestion, transformation, and processing.
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models
Required skills
Cloud platform design (AWS/Azure), Infrastructure as Code (Terraform), Big Data frameworks (Spark, Databricks, Flink), Data pipeline orchestration (Airflow, dbt, Kafka), SQL, Python/Java/Scala, Containerization (Docker, Kubernetes), FinOps principles.
Preferred skills
Master's degree, experience in regulated environments (financial services, healthcare), AI/ML feature engineering expertise.
Technologies
AWS, Azure, Snowflake, Databricks, GitHub Actions, Terraform, Apache Airflow, dbt, Kafka, Spark, Docker, Kubernetes, Redshift, Glue, S3, Athena, Synapse, Data Factory, BigQuery, Dataflow.
Responsibilities
Design and implement cloud-native data platform infrastructure; develop and optimize data pipelines for structured and unstructured data; enforce data governance, security, and compliance standards; manage operational health, monitoring, and disaster recovery; partner with data scientists to enable advanced analytics and AI/ML workloads; mentor junior engineers.
Seniority
Senior Lead, hands-on IC with mentorship responsibilities