CareerPlan

[Job-32197] Tech Lead Data - Databricks

BrazilFull-time2026-10-09 → 2026-11-19

Core

Senior Data Tech Lead driving technical leadership for data engineering initiatives on Databricks in Azure, building scalable pipelines within the Medallion architecture.

Role type

Senior hands-on IC Data Tech Lead

Builds

Scalable, reliable data pipelines (Bronze/Silver/Gold layers) on Databricks/Azure

Domain

Data Engineering / Cloud Data Platform (Azure/Databricks)

Deliverable

production ML models

Required skills

Databricks (PySpark, Spark SQL), Delta Lake, Medallion architecture, Azure (ADLS, Active Directory), SQL, Python, DataOps (Git, CI/CD, testing), Technical leadership

Preferred skills

Unity Catalog, Databricks Workflows/Repos, Delta Live Tables, Data quality frameworks (Great Expectations/Soda, dbt), Orchestration (Airflow), CDC/streaming (Event Hubs/Kafka), Consulting experience

Technologies

Databricks, Azure, PySpark, Spark SQL, Delta Lake, Git, Airflow, Event Hubs, Kafka

Responsibilities

Provide technical leadership to Data Engineering squads; Co-define technical vision and standards with Data Architect; Design and oversee pipelines across Bronze/Silver/Gold layers; Implement DataOps practices (version control, CI/CD, testing); Optimize jobs/pipelines for performance and cost; Ensure security and governance compliance; Collaborate with stakeholders to translate requirements; Mentor engineers and create references.

Seniority

Senior, hands-on IC