Senior Software Engineer - Data Acquisition Team
Core
Design, build, and operate large-scale backend systems and data pipelines to acquire, transform, validate, and store high-volume raw data sets from diverse sources.
Role type
Senior individual-contributor backend/data engineer
Builds
Production data acquisition pipelines, ETL/ELT workflows, and Java services for ingestion, orchestration, and enrichment
Domain
B2B data intelligence, distributed systems, cloud infrastructure
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery | infrastructure | physical/clinical work
Required skills
Java, distributed processing, data pipeline architecture, streaming systems, batch processing, schema evolution, observability, cloud operations
Preferred skills
Kubernetes, Terraform, Snowflake/BigQuery/Trino, CRM integration patterns, data marketplace experience
Technologies
Apache Airflow, Apache Beam, Spark, Google Dataflow, DataProc, Kafka, Pub/Sub, BigQuery, Snowflake, Trino, GKE, GCS
Responsibilities
Design and operate large-scale data acquisition pipelines; Architect resilient ETL/ELT workflows; Develop production Java services; Define approaches for schema evolution and data validation; Improve pipeline reliability and cost efficiency; Implement observability and alerting; Collaborate with product and data teams on technical designs
Seniority
Senior, hands-on IC