Data Engineer III, Development
Core
Design, develop, test, deploy, and support data integration solutions connecting enterprise systems and data pipelines for Data Science and Enterprise Data Platform.
Role type
Senior IC data engineer (cloud & big data)
Builds
Data integration solutions, BI and analytical solutions, data pipelines
Domain
Life sciences / Cloud data engineering
Deliverable
production ML models | product features | infrastructure
Required skills
PySpark, Python, SQL, Apache Spark, AWS Cloud services (Glue, Kafka, S3, Redshift, RDS, DynamoDB), Databricks, Delta Lake, Git, Jenkins, Unix shell scripting, TCL
Preferred skills
Informatica, Elastic Search, Lambda, MongoDB, Sybase, complex query optimization
Technologies
Apache Spark, Databricks, AWS, Glue, Kafka, S3, Redshift, RDS, MongoDB, DynamoDB, Elastic Search, Lambda, Informatica, Git, Jenkins
Responsibilities
Design and document reference architecture; Facilitate requirements gathering and process mapping workshops; Implement standard operating procedures; Follow agile development methodologies and DevOps practices to deliver solutions
Seniority
Senior, hands-on IC
