Engenheiro de Dados Senior
Core
Design and optimize large-scale data pipelines for B2B sales intelligence solutions using Databricks, SQL, and PySpark, while integrating generative AI and LLMs for data collection and processing.
Role type
Senior Data Engineer
Builds
Data pipelines, APIs, and data architecture for sales intelligence products
Domain
B2B Sales Intelligence / Data Engineering
Deliverable
production ML models
Required skills
Databricks, SQL, PySpark, Python, AWS (S3, Lambda, EKS), Git, automated testing, data modeling, generative AI/LLMs, AI-powered development tools
Preferred skills
Delta Live Tables, streaming data pipelines, Unity Catalog, CI/CD, web scraping, building AI agents, LGPD compliance
Technologies
Databricks, AWS, Python, PySpark, SQL, Git, Claude Code, Cursor, GitHub Copilot
Responsibilities
Develop and optimize large-scale data pipelines; Apply generative AI and LLMs to automate data collection and validation; Integrate new internal and external data sources; Build and maintain APIs for data availability; Ensure data quality through automated tests and monitoring; Apply privacy best practices compliant with LGPD; Optimize processing performance and costs; Contribute to architecture decisions and standards; Use AI-powered development tools; Share knowledge through code reviews and collaboration; Document data pipelines and architecture.
