Senior Data Engineer (Data & AI Platform)
Core
Design, implement, and maintain efficient, scalable data pipelines supporting reporting, BI, AI, and ML; ensure data quality, integrity, and security; optimize cloud storage and processing; lead data engineering projects and team development.
Role type
Senior Data Engineering Team Lead
Builds
Scalable data pipelines, data catalogs, and infrastructure for AI/ML models
Domain
Cloud data engineering and AI/ML infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Java, Scala, Apache Spark, Apache Kafka, Apache Airflow, cloud platforms (AWS/Azure/GCP), data governance, data lineage, metadata management, access control
Preferred skills
Leading multidisciplinary teams, translating technical concepts for non-technical stakeholders, driving high-impact initiatives
Technologies
Python, Java, Scala, Spark, Kafka, Airflow, AWS, Azure, GCP
Responsibilities
Design and maintain scalable data pipelines; ensure data quality and security via governance practices; optimize cloud data storage and processing; collaborate on data strategy; develop data catalogs and technical documentation; support AI/ML model deployment; lead data engineering projects; lead and develop the data engineering team
Seniority
Senior, hands-on IC with leadership responsibilities