Data Engineer
Core
Build and operate scalable data platforms and pipelines (batch and streaming) on a Lakehouse architecture to serve as the single source of truth for data-driven decisions across the business.
Role type
Senior Data Engineer
Builds
Data platform capabilities, batch/streaming pipelines, and data assets for Domain-CoStar products and internal teams.
Domain
Commercial Real Estate Technology / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Apache Airflow, DBT, AWS Glue, Apache Kafka, Apache Flink, Snowflake, Databricks, Apache Iceberg, Infrastructure-as-Code (CDK, CloudFormation, Terraform), Data Modeling, Cloud Architecture
Preferred skills
Experience with semi-structured/unstructured data, Cost optimization, Agile data modeling
Technologies
AWS, Snowflake, Databricks, Apache Airflow, DBT, Apache Kafka, Apache Flink, Apache Iceberg, Terraform, CDK, CloudFormation
Responsibilities
Design and build reusable scalable data solutions on a modern Lakehouse platform; Develop and maintain robust batch and streaming pipelines; Architect cloud data solutions on AWS applying best practices for cost-efficiency; Optimize complex SQL and Spark workloads for performance and cost; Manage schema evolution and partitioning for open Lakehouse table formats.
Seniority
Senior, hands-on IC
