Sr. Data Pipeline Engineer (Remote)
Core
Architecting and overseeing large-scale data ingestion and transformation pipelines to enable analytics and AI-driven insights for a global cybersecurity platform.
Role type
Senior IC Data Pipeline Engineer
Builds
Real-time and batch data ingestion frameworks integrating data from enterprise systems (Salesforce, NetSuite, Workday) and APIs.
Domain
Cybersecurity / SaaS / Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Airflow, DBT, Python, Kafka streaming, Snowflake, advanced SQL, API & file-based data ingestion, real-time streaming, data pipeline orchestration, DevOps, CI/CD
Preferred skills
AI assistance bot integrations, data science workflows, ML data pipelines, SaaS product telemetry, metadata management
Technologies
Airflow, DBT, Python, Kafka, Snowflake, Salesforce, NetSuite, Workday
Responsibilities
Architect large-scale data ingestion and transformation pipelines; Design real-time and batch ingestion frameworks; Manage data integration from enterprise systems; Drive data quality, observability, and reliability; Collaborate with data science teams on AI/ML workflows; Ensure engineering excellence via DevOps and CI/CD practices.
Seniority
Senior, hands-on IC with people leadership
