Senior or Staff Software Engineer, Data Platform (Brazil)
Core
Build highly available and scalable data infrastructure to analyze blockchain transaction activity at petabyte scale for public and private sector agencies.
Role type
Senior or Staff Software Engineer, Data Platform
Builds
Highly reliable data services, complex ETL pipelines, and data models supporting sub-second latency for querying blockchain data.
Domain
Fintech / Blockchain / Data Engineering
Required skills
Python, SQL, SparkSQL, distributed system architecture, data modeling, database cluster management, data pipeline orchestration, streaming workflows, cloud infrastructure deployment
Preferred skills
Experience with Iceberg, Trino, BigQuery, StarRocks, Citus, Airflow, DBT, Spark, Kafka, Flink, Docker, Terraform, Kubernetes, Datadog
Technologies
Python, SQL, SparkSQL, Iceberg, Trino, BigQuery, StarRocks, Citus, Airflow, DBT, Spark, Kafka, Flink, Docker, Terraform, Kubernetes, Datadog
Responsibilities
Build highly reliable data services to integrate with dozens of blockchains; Develop complex ETL pipelines for real-time data processing; Design and architect data models for optimal storage and retrieval; Oversee deployment and monitoring of large database clusters; Collaborate with data scientists and product managers to implement novel data models; Build scalable engines to optimize routine scaling and maintenance tasks.
Seniority
Senior or Staff, hands-on IC with architectural leadership
