Senior Data Engineer - Data Platform
Core
Build and operate scalable data platform capabilities for batch and streaming pipelines on a Lakehouse architecture to serve as the source of truth for data-driven decisions and analytics across the business.
Role type
Senior Data Engineer (Data Platform)
Builds
Re-usable, scalable data solutions and assets on a modern Lakehouse platform
Domain
Commercial Real Estate / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Apache Airflow, DBT, AWS Glue, Snowflake, Databricks, Apache Kafka, Apache Flink, Apache Iceberg, Infrastructure-as-Code (CDK/CloudFormation/Terraform), Data Modeling, Cloud Architecture
Preferred skills
Experience with semi-structured and unstructured data, Cost optimization, Schema evolution management
Technologies
AWS, Snowflake, Databricks, Apache Airflow, DBT, Apache Kafka, Apache Flink, Apache Iceberg, Terraform, CDK, CloudFormation
Responsibilities
Design and build re-usable, scalable data solutions; Develop real-time data pipelines for low-latency use cases; Architect and implement cloud-native data warehousing solutions; Optimize complex SQL and Spark workloads for efficiency and cost; Manage Lakehouse table formats and schema evolution; Partner with data scientists and analysts to deliver data solutions.
Seniority
Senior, hands-on IC