Data Engineering Professional II
Core
Build and maintain scalable data systems, models, and pipelines optimized for operations and analysis to support business functions and downstream systems.
Role type
Senior IC data engineer
Builds
Scalable data models, pipelines, and integrated data products
Domain
Healthcare / Cloud Data Engineering
Deliverable
production ML models
Required skills
Data modeling, data integration, SQL, Python, PySpark, AWS (DMS, Lambda, Databricks, SQS, Step Functions), PostgreSQL, MongoDB, DynamoDB, DevSecOps, CI/CD, automated testing
Preferred skills
Streaming technologies (Spark Streaming, Kafka), Infrastructure as Code (Terraform), API integrations (SOAP, REST, FAST), GenAI/LLM/RAG
Technologies
AWS, Databricks, PySpark, Kafka, Terraform, JIRA, Confluence, Git, GitHub Actions, Jenkins
Responsibilities
Develop and maintain scalable data models and pipelines; Collaborate with business functions to improve data quality; Implement data reconciliation and quality monitoring; Write test scripts and maintain engineering documentation; Troubleshoot data-related issues; Partner with DevOps and Enterprise teams to design data integration patterns; Support Data Governance principles.
Seniority
Senior, hands-on IC
