SR Data Engineer (AWS)
Core
Design, build, and optimize scalable, high-performance data platforms supporting large volumes of financial and transactional data.
Role type
Senior IC data engineer (cloud & streaming)
Builds
High-throughput batch and streaming data pipelines, cloud data warehouse and lakehouse architectures
Domain
Fintech / Financial services / Cloud data engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Apache Spark/PySpark, AWS data services (S3, Glue, Athena, EventBridge, Firehose, Lambda), data orchestration (Airflow), data warehousing (Snowflake, Redshift, BigQuery), real-time streaming (Kafka, Kinesis), dbt, DevOps/DataOps, Git, Docker, CI/CD, Infrastructure as Code
Preferred skills
Scala, Java, Databricks, Terraform, GDPR/LGPD compliance frameworks, mentoring
Technologies
AWS, Apache Spark, Delta Lake, Apache Airflow, Snowflake, AWS Redshift, Google BigQuery, Apache Kafka, AWS Kinesis, dbt, GitHub Actions, GitLab CI, Docker, Terraform
Responsibilities
Design and maintain high-throughput batch and streaming data pipelines; Design and scale cloud data warehouse and lakehouse architectures; Implement data quality frameworks, automated testing, monitoring, and alerting; Drive adoption of DataOps practices including CI/CD and Infrastructure as Code; Champion data governance, privacy, and security standards; Mentor junior and mid-level Data Engineers
Seniority
Senior, hands-on IC
