Data Engineer III
Core
Architect and develop data solutions supporting credit, banking, growth, marketing, and finance operations by transforming data into reliable, scalable inputs for business initiatives.
Role type
Data Engineer
Builds
Data collection, storage, processing, and consumption services; data pipelines; data infrastructure; batch and real-time communication services.
Domain
Financial services / Big Data / Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Apache Spark (PySpark), AWS, Apache Kafka, Apache Airflow, relational and NoSQL databases, data lakes, data warehouses, distributed systems architecture, data streaming, Terraform, Git, clean code, troubleshooting.
Preferred skills
Datahub, Kubernetes.
Technologies
AWS (S3, Glue, EMR, Redshift), Apache Spark, Apache Kafka, Apache Airflow, MySQL, PostgreSQL, MongoDB, Terraform, Kubernetes, Datahub, Git.
Responsibilities
Develop and implement data collection, storage, processing, and consumption services; Create, maintain, and monitor large-scale data pipelines; Provision data-related infrastructure using Terraform; Integrate, operate, and manage batch and real-time data communication services; Provide integrations between applications and data services.
Seniority
Mid-Senior (III level implied by 'III' in title and 'comprovado' experience requirements).
