Data Engineer
Core
Design, build, and maintain scalable data pipelines and ETL/ELT processes to ingest, transform, and process large-scale structured and unstructured data for actionable business insights.
Role type
Senior Data Engineer (Big Data & Cloud)
Builds
End-to-end data pipelines, data models, and automated workflows on cloud platforms
Domain
Biotechnology / Big Data Engineering
Required skills
PySpark, SQL, Databricks, ETL/ELT, data modeling, data governance, cloud platforms (AWS), workflow orchestration, performance tuning
Preferred skills
Python, Apache Airflow, SageMaker, data visualization, GDPR/CCPA compliance, multi-source integration (APIs, cloud storage) (via careerplan.io/jobs/R-235754-1-data-engineer-at-amgen)
Technologies
Databricks, PySpark, SparkSQL, AWS, Apache Airflow, SQL databases, APIs
Responsibilities
Design and develop data pipelines leveraging Databricks and PySpark; implement automated workflows for data ingestion and deployment; optimize Spark job performance; build integrations with SQL databases, APIs, and cloud storage; manage data quality and documentation; collaborate with Data Architects and Data Scientists on end-to-end solutions.
Seniority
Senior, hands-on IC