Pessoa Engenheira de Dados Sênior
Core
Designing scalable data pipelines and AI/LLM components to democratize data and support generative AI solutions.
Role type
Senior Data Engineer (Generative AI & Data Mesh)
Builds
Scalable data pipelines, reusable connectors/APIs/SDKs, and intelligent agents for data democratization.
Domain
Cloud Data Engineering & Generative AI
Deliverable
production ML models
Required skills
Python, Apache Spark, dbt, AWS (Glue, EMR, Athena, S3, Lambda, SQS, DynamoDB), SQL/NoSQL, LLMs, RAG, Vector Databases, LangChain, Terraform
Preferred skills
Data Mesh architecture, LLM benchmarking, Generative AI tools, Observability, Advanced caching, Fintech solutions
Technologies
Apache Spark, dbt, Airflow, AWS, LangChain, LangGraph, CrewAI, Pinecone, Milvus, pgvector, Qdrant, Terraform, CloudWatch, Prometheus, Grafana
Responsibilities
Design data architecture and evaluate technologies; Develop and evolve scalable data pipelines for generative AI; Implement Data Mesh layers for semantic data consumption; Build reusable components (connectors, APIs, SDKs) integrating with LLMs; Prototype intelligent agents; Test and automate workflows; Validate components based on user feedback.
Seniority
Senior, hands-on IC
