Data Platform Engineer
Core
Architecting the data lineage and metadata models that serve as the foundation for a mathematical computation engine and semantic reasoning system.
Role type
Senior Data Platform Engineer
Builds
High-performance data platform backbone, distributed computing infrastructure, and resilient caching strategies.
Domain
Data infrastructure, distributed computing, semantic modeling, and mathematical computation.
Deliverable
production ML models | infrastructure
Required skills
Distributed systems architecture, ETL/ELT pipeline design, Python, TypeScript, Cloud infrastructure (AWS/Cloudflare), Graph databases/APIs, Git workflows.
Preferred skills
Knowledge graph modeling (Neo4j, JanusGraph, RDF/OWL), Data operating systems.
Technologies
Apache Spark, Apache Flink, Python, Scala, TypeScript, AWS, Cloudflare, Neo4j, JanusGraph, RDF, OWL, Git.
Responsibilities
Architect and build the high-performance backbone of the data platform; Focus on distributed computing stability and building effective caching strategies; Design ETL pipelines and architect resilient caching for complex dependency resolutions; Establish data lineage and metadata modeling infrastructure; Integrate and extend the data platform with graph-based reasoning capabilities; Partner with the CTO and product team to drive the architectural vision.
Seniority
Senior, hands-on IC