Senior Data Engineer
Core
Designing and building extensive data sets and end-to-end data pipelines to support customer-facing and business-facing data products for a computer vision company.
Role type
Senior Data Engineer
Builds
Large-scale data pipelines, data models, and visualizations for parking and mobility products
Domain
Computer vision, parking, mobility, real estate
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, ETL/ELT, data modeling, Snowflake, dbt, Python, Big Data solutions, RDBMS (MySQL, MS SQL Server, Postgres), Spark, PySpark, Terraform
Preferred skills
Master's degree in CS/Engineering, CI/CD pipelines, Airflow, Automic
Technologies
Snowflake, dbt, Python, Spark, PySpark, MySQL, PostgreSQL, AWS, Terraform, Airflow, Automic, Git, GitHub, Datadog
Responsibilities
Develop end-to-end data pipelines and foundational data sets; Design and own data architecture for large-scale projects; Build, launch, and optimize data pipelines, models, and visualizations; Define and manage SLAs for data sets; Implement data security models and evolve data governance processes; Solve complex data integration challenges using ETL/ELT patterns; Optimize production processes and code using advanced algorithmic concepts; Mentor team members
Seniority
Senior, hands-on IC
