CareerPlan

Data engineer

BrazilFull-time2026-11-18 → 2026-11-19

Core

Develop, implement, and maintain production-grade data pipelines and scalable data flows supporting machine learning and analytics use cases.

Role type

Senior Data Pipeline Engineer

Builds

Scalable data flows, machine learning pipelines, and data tools for analytics and data science teams

Domain

Big Data, Cloud Infrastructure, AI/LLM Operations

Deliverable

production ML models

Required skills

Python, PySpark, Apache Spark, SQL, Apache Airflow, Kubernetes, Git, Hadoop ecosystem (Hive, Impala, HDFS, Sqoop), LLMs, agentic coding, AI agents

Preferred skills

LLM cost optimization, AI agent development

Technologies

Apache Spark, PySpark, Python, Pandas, SQL, Apache Airflow, Kubernetes, Hadoop, Hive, Impala, HDFS, Sqoop, Git, Large Language Models (LLMs)

Responsibilities

Implement and support production data pipeline flows; Design and develop use-case-specific data flows and ML pipelines; Build and optimize data processing workflows; Deploy and manage workloads in Kubernetes environments; Analyze structured and semi-structured datasets; Optimize big-data pipelines for performance and scalability; Collaborate with customers and cross-functional teams to deliver technical solutions.

Seniority

Senior, hands-on IC