BR Data Engineer
Core
Design, build, and maintain scalable data pipelines and infrastructure to support data science and analytics workloads.
Role type
Senior Data Engineer (Cloud & Backend)
Builds
ETL/ELT pipelines, data lakes, and data services for data scientists and analysts.
Domain
Cloud data engineering and backend development
Deliverable
production ML models
Required skills
Python, SQL, Cloud platforms (AWS/Azure/GCP), Data orchestration (Airflow/Prefect), Containerization (Docker/Kubernetes), API development, Infrastructure as Code (Terraform)
Preferred skills
Experience with streaming data (Kafka/Spark/Flink), Unit testing (pytest), CI/CD pipelines
Technologies
Python, SQL, AWS, Azure, GCP, Airflow, Prefect, PostgreSQL, BigQuery, Redshift, S3, Docker, Kubernetes, Git, Terraform, Flask, FastAPI, Jenkins, GitHub Actions
Responsibilities
Build and maintain data ingestion and transformation pipelines; Develop and manage RESTful APIs for data exchange; Implement and manage cloud infrastructure using IaC; Ensure data quality and pipeline reliability through monitoring and logging; Collaborate with data scientists and analysts to deliver data solutions.
Seniority
Senior, hands-on IC
