Engineer III - Data Engineer
Core
Design, build, and run batch and scheduled data pipelines, orchestration, and distributed processing architectures to support AI-infused scenario planning and analysis.
Role type
Senior IC data engineer
Builds
Data pipelines, ingestion engines, distributed processing layers, caching services, and data access APIs
Domain
SaaS / AI-infused scenario planning
Deliverable
production ML models
Required skills
Python, workflow orchestration (Airflow, Dagster, Prefect), distributed compute (Spark), cloud data ecosystems (AWS, Databricks, Snowflake, GCP), SQL, NoSQL databases, caching layers, message queues, Kubernetes
Preferred skills
large-scale web scraping infrastructure, multi-cloud pipelines, ML Ops
Responsibilities
Design and maintain data pipelines and orchestrators; build scalable distributed processing architectures; develop high-performance data access layers and APIs; own data quality initiatives and observability; partner with data science and platform teams; raise engineering standards through code reviews and mentoring
Seniority
Senior, hands-on IC
