Sr Software Engineer - Big Data
Core
Design, develop, and maintain software systems to gather, analyze, and report on large-scale network traffic, DNS, and web content data to derive operational and business intelligence.
Role type
Senior IC Software Engineer (Big Data & Infrastructure)
Builds
Data collection, storage, analysis, and reporting systems for network traffic and DNS data
Domain
Internet Infrastructure / Big Data / Networking
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Java, Python, Big Data frameworks (MapReduce, Spark), Hadoop, Hive, Kafka, Linux, Unix, RDBMS, NoSQL, Time-series DBs, Automation (Ansible, Terraform, Jenkins), Cloud-native architectures, Performance tuning, Data migration
Preferred skills
Distributed systems design, Vulnerability management, CI/CD pipeline development, Incident response, Kernel configuration
Technologies
Java, Python, Spark, Hadoop, Hive, Kafka, Ansible, Terraform, Jenkins, Linux, Kubernetes (implied by cloud-native)
Responsibilities
Design and implement object-oriented software for big data collection and analysis; Perform system verification and performance testing; Collaborate with architects to define testing procedures; Lead incident response for distributed systems and networking issues; Foster documentation and knowledge sharing; Drive continuous improvement of organizational practices.
Seniority
Senior, hands-on IC with technical leadership
