Data Engineer
Core
Designing and maintaining data pipelines to ingest and transform IoT device and software product data into a central data model for analytics, model training, and dashboards.
Role type
Data Engineer
Builds
Highly reliable computed tables and data pipelines integrating unstructured data (video, audio) and sensor data.
Domain
IoT, Cloud Data Infrastructure
Deliverable
production ML models
Required skills
SparkSQL, Pyspark, ETL pipeline design, Data modeling at scale, Airflow/Dagster/Prefect, SQL, Python, REST APIs, Git
Preferred skills
Time series data handling, Databricks, Delta Lakes, Public cloud (AWS/GCP/Azure), ML outputs integration
Responsibilities
Build and maintain reliable computed tables from various sources; Access, manipulate, and integrate external datasets; Collaborate with Data Science, AI/ML, and other Data Engineers; Ensure high uptime and reliability for customer-facing data sets.
Seniority
Mid-Senior (4+ years experience)
