Pessoa Consultora Data Engineer
Core
Build and evolve data pipelines, transformations, and models to create a reliable, scalable, and efficient data platform.
Role type
Data Engineer (Cloud)
Builds
Data pipelines and models for corporate analytics
Domain
Cloud Data Engineering
Deliverable
production ML models
Required skills
SQL, Python, GCP (BigQuery, Dataflow, Pub/Sub, Cloud Composer), Airflow, dbt, Great Expectations, Git, Data Modeling (Bronze/Silver/Gold), Data Quality Testing, SLA Management, Cost Optimization, Data Lifecycle Management
Preferred skills
Data Governance (DAMA-DMBOK, LGPD), CI/CD for Data, Data Cataloging
Technologies
GCP, BigQuery, Dataflow, Pub/Sub, Cloud Composer, Airflow, dbt, Great Expectations, Soda, Pandera, Git
Responsibilities
Develop and maintain batch and streaming ingestion pipelines from corporate sources; Build physical data models in Bronze, Silver, and Gold layers; Implement and monitor data quality tests aligned with completeness, accuracy, consistency, timeliness, and uniqueness; Instrument pipeline metrics and observability; Catalog tables and datasets; Collaborate with Analytics Engineers and business areas; Optimize performance, cost, and data lifecycle in GCP; Participate in agile rituals.
Seniority
Mid-Senior, hands-on IC
