Data engineer
Core
Develop, implement, and maintain production-grade data pipelines and scalable data flows supporting machine learning and analytics use cases.
Role type
Senior Data Pipeline Engineer
Builds
Scalable data flows, machine learning pipelines, and data tools for analytics and data science teams
Domain
Big Data, Cloud Infrastructure, AI/LLM Operations
Deliverable
production ML models
Required skills
Python, PySpark, Apache Spark, SQL, Apache Airflow, Kubernetes, Git, Hadoop ecosystem (Hive, Impala, HDFS, Sqoop), LLMs, agentic coding, AI agents
Preferred skills
LLM cost optimization, AI agent development
Technologies
Apache Spark, PySpark, Python, Pandas, SQL, Apache Airflow, Kubernetes, Hadoop, Hive, Impala, HDFS, Sqoop, Git, Large Language Models (LLMs)
Responsibilities
Implement and support production data pipeline flows; Design and develop use-case-specific data flows and ML pipelines; Build and optimize data processing workflows; Deploy and manage workloads in Kubernetes environments; Analyze structured and semi-structured datasets; Optimize big-data pipelines for performance and scalability; Collaborate with customers and cross-functional teams to deliver technical solutions.
Seniority
Senior, hands-on IC