Especialista de Engenharia de Dados II
Core
Liderar a evolução da infraestrutura de dados, construindo arquiteturas escaláveis e transformando dados em vantagem competitiva.
Role type
Senior Data Engineer II
Builds
Data Lake, Lakehouse, real-time and batch data pipelines
Domain
Financial services / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Data architecture design, ETL/ELT pipeline development, data quality governance, performance optimization, Apache Spark, Python, SQL, Terraform, dimensional modeling
Preferred skills
AWS cloud environment experience, Airflow/Prefect/Dagster, Clean Code, CI/CD, DataOps
Technologies
Apache Spark, Python, Scala, SQL, Airflow, Prefect, Dagster, Terraform, AWS
Responsibilities
Design and implement modern Data Lake and Lakehouse architectures; Build and optimize real-time streaming and batch data ingestion pipelines; Establish data quality standards, lineage, and security/privacy policies; Act as a technical reference for the team and disseminate best practices; Identify performance bottlenecks in large-scale data processing and propose structural improvements
Seniority
Senior, hands-on IC
