Senior Software Engineer, Data Platform
Core
Building and operating scalable data ingestion, transformation, and quality tooling for real-time and batch workloads to power analytics and engineering systems.
Role type
Senior IC data platform engineer
Builds
Data ingestion frameworks, pipeline reliability systems, data quality tooling, and AI-powered operational agents
Domain
Data engineering, distributed systems, cloud data platforms
Deliverable
production ML models | infrastructure
Required skills
distributed systems design, real-time and batch data pipeline development, Kafka, Spark Structured Streaming, open table formats (Apache Iceberg/Delta Lake/Hudi), cloud data warehouses (Snowflake), workflow orchestration (Airflow), Python, SQL, AI agent development
Preferred skills
CDC patterns (Debezium), DBT, Big Data technologies (Flink, Pinot), LLM-based agent frameworks (LangChain)
Technologies
Kafka, Spark, Apache Iceberg, Delta Lake, Hudi, Snowflake, Airflow, Python, SQL, Debezium, DBT, Flink, Pinot, LangChain, Cursor, Copilot
Responsibilities
Build and operate data ingestion and transformation pipelines; Design data platform components (storage, compute, pipeline layers); Develop monitoring, alerting, and data quality tooling; Diagnose and resolve production issues with systemic fixes; Participate in on-call rotation for incident triage and resolution; Build and use AI-powered agents to automate engineering and operational tasks
Seniority
Senior, hands-on IC
