Engenheiro(a) de Dados Pleno (Databricks)
Core
Developing and maintaining data ingestion and delivery pipelines for payment strategy initiatives using Databricks.
Role type
Mid-level data engineer (Databricks/Spark)
Builds
Data pipelines for payment services and financial data processing
Domain
Financial services / Payments
Deliverable
production ML models | product features
Required skills
PySpark, Python, SQL, Databricks, Spark, CI/CD for data pipelines, Data modeling (lakes, warehouses, Datamesh), Cloud data services, Data orchestration (Databricks Workflows), Data quality
Preferred skills
Experience in financial services or payment processing, File exchange and financial reconciliation, Cloud providers (AWS, Azure), Version control and documentation
Technologies
Databricks, Spark, AWS, Azure, Python, SQL
Responsibilities
Develop and maintain data ingestion and delivery pipelines, Support and improve existing pipelines, Collaborate with Engineering, Product, and Analytics teams, Identify problems and propose solutions, Ensure solution reliability and efficiency
Seniority
Mid-level, hands-on IC