Senior Data Engineer
Core
Architect, optimize, and supervise daily ingestion pipelines processing calendar data for 14+ million listings to power a revenue management platform.
Role type
Senior Data Engineer (Backend/Infrastructure)
Builds
Robust, scalable data ingestion engines and ETL processes for a multi-terabyte dataset.
Domain
PropTech / Revenue Management / Big Data
Deliverable
production ML models | infrastructure
Required skills
PostgreSQL tuning, AWS Aurora, Ruby on Rails, Resque, Terraform, CI/CD, data modeling, distributed systems optimization
Preferred skills
Python, Celery, Sidekiq, complex query optimization
Technologies
Ruby, Ruby on Rails, Resque, PostgreSQL, AWS RDS, AWS Aurora, AWS Athena, Terraform, CloudFormation
Responsibilities
Architect and optimize daily ingestion pipelines for massive datasets; Tune and scale AWS RDS PostgreSQL and Aurora databases; Optimize background job orchestration; Design and build robust ETL processes; Collaborate with application engineers on data accessibility; Apply DevOps best practices for AWS infrastructure and CI/CD; Build comprehensive monitoring and observability tooling.
Seniority
Senior, hands-on IC
