Senior Software Engineer, Big Data
Core
Build data processing pipelines, ML infrastructure, and scalable cloud applications to connect millions of jobseekers and employers.
Role type
Senior Software Engineer, Big Data
Builds
Data processing pipelines, ML infrastructure, cloud-based technologies, and distributed systems
Domain
Job marketplace, Big Data, Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Spark, Kafka, Hadoop, Hive, Docker, Kubernetes, Cloud technologies
Preferred skills
Data integration tools (Apache Kafka, Flume, NiFi), Data storage (Delta Lake, HBase, Cassandra, MongoDB), Stream processing (Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis, Azure Databricks)
Technologies
Spark, Kafka, Hadoop, Hive, Docker, Kubernetes, Delta Lake, HBase, Cassandra, MongoDB, Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis, Azure Databricks
Responsibilities
Build data processing and exploration pipelines, Deploy cloud-based technologies, Write, test, instrument, and deploy code to Kubernetes environment
Seniority
Senior, hands-on IC