Senior Data Engineer
Core
Designing and maintaining scalable data pipelines to ingest and transform IoT device and product data into a central data model for analytics, model training, and dashboards.
Role type
Senior Data Engineer
Builds
Central data lake, computed tables, and customer-facing datasets
Domain
IoT, Cloud Infrastructure, Data Engineering
Deliverable
production ML models | dashboards & analysis
Required skills
SparkSQL, Pyspark, ETL pipeline design, data modeling at scale, SQL, Python, REST APIs, data orchestration (Airflow/Dagster/Prefect), Git
Preferred skills
Time series data handling, Databricks, Delta Lakes, public cloud platforms (AWS/GCP/Azure), first-party data modeling, complex data integration
Technologies
Spark, Databricks, Delta Lakes, Airflow, Dagster, Prefect, AWS, GCP, Azure
Responsibilities
Build and maintain highly reliable computed tables incorporating unstructured and sensor data; Access, manipulate, and integrate external datasets with internal data; Deliver high-quality data with strong uptime and reliability requirements; Collaborate with Data Science, AI/ML, and other Data Engineers to ensure high-quality data for diverse purposes
Seniority
Senior, hands-on IC
