Staff Software Engineer - Data Platform
Core
Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, processing, and storage for the AI software delivery platform.
Role type
Staff Software Engineer - Data Platform (Technical Lead)
Builds
Scalable data pipelines, data warehousing solutions, and ETL/ELT processes
Domain
SaaS / AI Software Delivery / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data warehousing, ETL/ELT processes, data modeling, Python, Java, Scala, BigQuery, Spark, Kafka, DBT, SQLMesh, AWS/Azure/GCP, SQL, relational and NoSQL databases
Preferred skills
Containerization and orchestration (Docker, Kubernetes), machine learning techniques, DevOps practices and CI/CD tools
Technologies
BigQuery, Spark, Kafka, DBT, SQLMesh, Docker, Kubernetes, Tableau, Power BI, Looker
Responsibilities
Design and maintain scalable data pipelines; collaborate with data scientists and analysts to develop solutions; implement data quality checks; optimize data pipelines for performance; troubleshoot data issues; document data architecture; provide guidance to junior team members
Seniority
Staff, hands-on IC with technical leadership