Data Engineer II
Core
Build and maintain business-critical data pipelines and integrations for Redfin's real estate platform, serving Engineering and Analytics teams.
Role type
Mid-level IC Data Engineer
Builds
Data pipelines, data exchange systems, and operational data infrastructure
Domain
Real Estate / Data Engineering
Deliverable
production ML models | product features
Required skills
Python, SQL, data modeling, database technologies, batch and streaming data pipelines, structured and unstructured data handling, API development, cloud services (AWS)
Preferred skills
Snowflake, Postgres, MySQL, Airflow, Docker, Kubernetes, Spark, message queuing, stream processing
Technologies
Python, SQL, Postgres, MySQL, Snowflake, AWS, Jenkins, Airflow, Docker, Kubernetes, Spark
Responsibilities
Design and develop complex data pipelines from diverse sources; implement data exchange systems; gather requirements and design data solutions; ensure code and process accuracy through testing; automate manual processes; maintain dev/test/prod environments; participate in on-call rotation
Seniority
Mid-level, hands-on IC