Need Sr Big Data Engineer at Beaverton, OR Only W2
Core
Senior data engineer building and optimizing cloud-native data pipelines to ingest, organize, and prepare diverse data domains for client analytics platforms.
Role type
Senior Big Data Engineer
Builds
Next-gen data and analytics platforms
Domain
Cloud data engineering (AWS, HDFS, Spark)
Deliverable
production ML models | product features
Required skills
Python, Scala, Java, HDFS ecosystem, Apache Spark, AWS ecosystem, data orchestration (Airflow, Luigi, Oozie), SQL optimization, NoSQL/KV stores, CI/CD pipeline configuration
Preferred skills
Netflix Genie experience, security and credential management, clean coding practices, GitHub
Technologies
AWS, HDFS, Spark, Airflow, Luigi, Oozie, Amazon Data Pipeline, SQL, NoSQL, KV stores
Responsibilities
Automate and integrate various data domains with different scales and volatility; ingest, organize, and prepare data through cloud-native processes; optimize data access and analysis in non-HDFS platforms; develop and configure remote workflow orchestration tools.
Seniority
Senior, hands-on IC
