Data Engineer II
Core
Build and maintain data pipelines and datasets to support in-product features and AI initiatives for a skills assessment platform.
Role type
Mid-level IC data engineer
Builds
Data pipelines, datasets, and in-product data features (exports, dashboards, analytics)
Domain
SaaS / B2B / Data Engineering
Deliverable
production ML models | product features
Required skills
Data pipeline development, OLAP databases, Data lake technologies, Distributed query engines, Spark, SQL, Python, Data security concepts
Preferred skills
AI/LLM-adjacent data work, SaaS/B2B product experience
Technologies
StarRocks, Apache Hudi, Trino, Spark, Apache Ranger, AWS
Responsibilities
Build and maintain data pipelines on the stack, support in-product data features, prepare datasets for AI features, implement access controls, respond to ad-hoc data requests, write documentation, troubleshoot data quality issues
Seniority
Mid-level, hands-on IC