Sr Software Engineer - Big Data
Core
Design, write, test, and maintain object-oriented software for collecting, storing, analyzing, and reporting on large data sets to produce operational and business intelligence.
Role type
Senior IC software engineer (big data)
Builds
Big data solutions using web content and traffic data
Domain
Big data engineering and analytics
Deliverable
production ML models | product features | infrastructure
Required skills
Java, Python, MapReduce, Spark, Hadoop, Hive, Kafka, Linux, Unix, relational databases, NoSQL, time-series databases, Ansible, Terraform, Jenkins, cloud-native architectures
Preferred skills
Incident response leadership, system verification, automation frameworks, private/public cloud environments
Technologies
MapReduce, Spark, Hadoop, Hive, Kafka, Ansible, Terraform, Jenkins
Responsibilities
Design, write, test, and maintain software for large data sets; Implement big data solutions using web content and traffic data; Develop and operate systems with extensive data-processing requirements; Perform system verification and collaborate on testing approaches; Use open-source tools and automation for daily builds, testing, and deployment; Support distributed systems, networking, virtual environments, kernel configurations, data storage, and security-related engineering work; Lead incident response for challenging engineering problems; Provide hands-on technical leadership, documentation, knowledge sharing, and continuous improvement of organizational practices
Seniority
Senior, hands-on IC
