Senior Data Engineer - Debt Solutions - San Diego, CA
Core
Design and maintain scalable data infrastructure, pipelines, and dashboards to track site performance, product usage, and consumer behavior for CoStar's Debt Solutions platform.
Role type
Senior Data Engineer (Debt Solutions)
Builds
Automated data infrastructure, data warehouses/lakehouses, KPI dashboards, and AI/ML-integrated data pipelines.
Domain
Real Estate / Data Engineering
Deliverable
production ML models | dashboards & analysis | infrastructure
Required skills
Python, PySpark, SQL, Cloud data platforms (Databricks, Snowflake, BigQuery), ETL/ELT, Dimensional modeling, AWS services, Terraform, CI/CD, Object-Oriented Programming, Data governance, Query optimization, AI tooling integration.
Preferred skills
NoSQL databases (DynamoDB), Object storage (S3, GCS), Event streaming (Kafka), AWS compute/container services, LLMs and prompt engineering.
Technologies
Databricks, Snowflake, BigQuery, AWS, Terraform, Kafka, Power BI, Python, PySpark, SQL.
Responsibilities
Design and implement dimensional modeling and cloud data platform structures; Develop secure data warehouses and lakehouses using Medallion Architecture; Build and optimize scalable data pipelines and Spark jobs; Integrate Machine Learning into data pipelines; Oversee automated data infrastructure and cross-domain data stitching; Implement data governance, lineage, and monitoring frameworks; Mentor engineers and analysts.
Seniority
Senior, hands-on IC with mentorship responsibilities.
