Data Engineer
Core
Design, build, and maintain robust, scalable data pipelines to ingest, process, and transform data from various sources, ensuring data quality and integrity.
Role type
Data Engineer
Builds
Data pipelines, data warehouses, data marts, and business layers
Domain
Proptech / Data Engineering
Deliverable
production ML models
Required skills
Advanced SQL, Python, Data Warehousing, Data Modeling, Cloud Platforms (AWS/Azure/GCP), Data Pipeline Development
Preferred skills
Kafka, Flink, Spark Streaming
Technologies
SQL, Python, Kafka, Flink, Spark Streaming, AWS, Azure, Google Cloud Platform
Responsibilities
Design and build data pipelines to ingest and transform data from internal databases and external APIs; Optimize data pipelines for performance, scalability, and reliability; Implement data validation and quality checks; Perform data modeling and schema design; Design and build data marts and business layers; Collaborate with data scientists and analysts to understand data requirements.
Seniority
Mid-level, hands-on IC