Analista de Engenharia de Dados III
Core
Developing, optimizing, and maintaining scalable data ingestion pipelines for large volumes of data using modern architectures.
Role type
Senior Data Engineer (Big Data)
Builds
Scalable data ingestion pipelines and optimized data processing workflows
Domain
Big Data, Cloud, Financial Services
Required skills
Apache Spark, Python, Databricks, ETL/ELT, Delta Lake, Data Quality, Git, Cloud environments
Preferred skills
Data modeling, Multi-source data integration, Cost and performance optimization, Data governance
Technologies
Apache Spark, Python, Databricks, Delta Lake, Git
Responsibilities
Build and maintain data ingestion pipelines using Autoloader; Process large-scale data using Spark Structured Streaming and Spark SQL; Implement data quality checks; Optimize costs and performance in Databricks; Collaborate with business and analytics teams to ensure structured and secure data availability.
Seniority
Senior, hands-on IC