DataOS Data Engineer
Core
Designing and building scalable data architectures, pipelines, and models for structured/unstructured data to support business-driven data products.
Role type
Senior IC Data Engineer with technical leadership
Builds
Data product pipelines, repositories, models, and shared libraries
Domain
Cloud-based data engineering (Big Data Lake House vs. Warehouse)
Deliverable
production ML models | product features
Required skills
Python, SQL, Spark, Airflow, Jenkins, Jupyter, DataBricks, relational data modeling, distributed cloud systems, database architecture testing
Preferred skills
DBT, performance tuning Spark code, workflow orchestration
Technologies
AWS, GCP, AZURE, Spark, Airflow, Jenkins, Jupyter, DataBricks, DBT
Responsibilities
Design secure and performant data architectures and subsystems; write and execute testing plans and debug code; lead a project team of data engineers; collaborate on co-development processes; provide guidance and mentoring to less experienced staff.
Seniority
Senior, hands-on IC with leadership
