Senior Data Engineer - Data Platform
Core
Build and operate scalable data platform capabilities for batch and streaming pipelines on a Lakehouse architecture to serve as the source of truth for data-driven decisions and analytics across the business.
Role type
Senior IC data engineer (cloud data platform)
Builds
Re-usable data solutions, batch/streaming pipelines, and data assets on AWS, Snowflake, and Databricks
Domain
Commercial real estate technology / Cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Apache Airflow, DBT, AWS Glue, Apache Kafka, Apache Flink, Snowflake, Databricks, Apache Iceberg, Infrastructure-as-Code (CDK/CloudFormation/Terraform)
Preferred skills
None stated
Technologies
AWS, Snowflake, Databricks, Apache Airflow, DBT, Apache Kafka, Apache Flink, Apache Iceberg, CDK, CloudFormation, Terraform
Responsibilities
Design and build scalable data solutions on a modern Lakehouse platform; Develop and maintain robust batch and real-time data pipelines; Architect cloud data solutions on AWS, Snowflake, and Databricks; Optimize complex SQL and Spark workloads for performance and cost; Manage schema evolution and partitioning for open Lakehouse table formats; Connect to diverse internal and external data sources via APIs, SaaS, and streaming.
Seniority
Senior, hands-on IC