Senior Data Engineer
Core
Design and maintain a robust, scalable daily data ingestion engine processing multi-terabyte datasets for a global revenue management platform.
Role type
Senior Data Engineer
Builds
Daily ingestion pipelines and data integration systems for a revenue management platform
Domain
PropTech / Revenue Management / Data Infrastructure
Deliverable
production ML models
Required skills
Ruby on Rails, Resque, PostgreSQL, AWS RDS, AWS Aurora, AWS Athena, system architecture, pipeline optimization, troubleshooting
Technologies
Ruby on Rails, Resque, PostgreSQL, AWS RDS, AWS Aurora, AWS Athena
Responsibilities
Supervise and improve existing daily data ingestion pipelines, design systems to integrate new data sources, ensure reliability and scale of data infrastructure, troubleshoot complex multi-terabyte pipeline issues
Seniority
Senior, hands-on IC
Rewrite
## About the role
Wheelhouse is a revenue management platform for the $500B+ flex rental space. Our technology empowers short & mid-length stay operators, who manage single-family homes, apartment buildings, and (in some cases) hotels - a broad & massive addressable market. Wheelhouse believes a more flexible & connected world is both inevitable & important, and we build technology to make sure the businesses that enable this lifestyle & society can thrive. As a team, we enjoy shipping products our customers love, on time or ahead of schedule, while balancing work/life & having fun together. We're best described as transparent & collaborative, and we strive to set our teammates up for success - both professionally & personally. We're a remote-first, work-anywhere, and "yes - you should make time for that adventure/vacation" company, who believes that "healthy hustle" is the key to good growth. At our core, we process massive amounts of data to give our clients a competitive edge. We track calendar data for over 14 million listings worldwide, ingesting the future calendar of availability and pricing for every single listing, every single day. This translates to a multi-terabyte, highly dynamic dataset. We are looking for a Senior Data Engineer to take ownership of this massive daily ingestion engine. Working within a Ruby on Rails and Resque environment, backed by AWS RDS Postgres and Aurora as well as Athena, you will ensure our data pipelines are robust, scalable, and highly optimized. You will not only supervise and improve our existing daily ingestion but also design systems to integrate new data sources and seamlessly deliver this data to our core application. Your mission is to guarantee the reliability, speed, and scale of our data infrastructure. You will be the technical guardian of our multi-terabyte dataset, ensuring that as we grow to track even more listings and add new data sources, our ingestion engine scales gracefully and cost-effectively without missing a beat. Our revenue management algorithms rely entirely on the daily calendar sync of these 14 million listings to price our clients' properties accurately. If our data pipelines slow down or fail, our core product cannot function.
## We're looking for someone who
- Works independently and takes ownership: You don't wait to be told what to optimize. You treat the data infrastructure as your own product, proactively identifying areas for improvement and driving them to completion.
- Thinks in systems: You understand that scaling isn't just about writing faster code; it's about how Resque, PostgreSQL, and our AWS infrastructure interact. You see the big picture and understand the cascading effects of your changes.
- Stays calm under pressure: Because this daily data sync is our lifeblood, pipeline hiccups are critical. You can troubleshoot complex, multi-terabyte issues methodically and keep a cool head when the pressure is on.
- Communicates technical concepts clearly: You can easily translate
Sourced via wellfound · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.