Engenheiro de Dados Databricks (Home Office/Brasil)
Core
Design, develop, and deploy scalable ETL/ELT pipelines in Databricks to ingest, clean, transform, and process structured and unstructured data for business needs and intelligent applications.
Role type
Data Engineer (Databricks)
Builds
Scalable data pipelines, data models, and workflows for business intelligence and AI agents
Domain
Data Engineering, Cloud (AWS), Lakehouse Architecture
Deliverable
production ML models
Required skills
PySpark, SQL, Delta Lake, Databricks, AWS, Airflow, CI/CD, Git, distributed systems debugging
Preferred skills
Databricks certification, familiarity with AI tools
Technologies
Databricks, PySpark, SQL, Delta Lake, AWS, Airflow, Git, GitHub, Azure DevOps
Responsibilities
Design and implement scalable ETL/ELT pipelines using PySpark, SQL, and Delta Lake; Optimize pipeline performance and manage workflows using Databricks Jobs and Workflows; Ingest, clean, and process data from diverse sources; Collaborate with data architects and business users to translate requirements into data models; Monitor and manage pipeline execution with tools like Airflow.