Software Development Engineer- Python
Core
Designing and implementing high-performance data workflows and scalable ETL pipelines for large-scale analytics in a cloud-based environment.
Role type
Senior IC data engineering engineer (Python/Java)
Builds
Scalable data processing frameworks and ETL pipelines
Domain
Healthcare intelligence / Big data analytics
Deliverable
production ML models
Required skills
Python, Java, SQL, Apache Spark, AWS (S3, Lambda, Step Functions), Data modeling, CI/CD, Git
Preferred skills
Apache Airflow, DataOps, Infrastructure-as-code, Data governance
Technologies
Apache Spark, Hive, Amazon EMR, Snowflake, Snowpark, AWS, Git
Responsibilities
Design and maintain scalable ETL pipelines; Build data processing workflows using big data technologies; Optimize data workflows for performance and cost-efficiency; Develop and maintain data models; Ensure data quality, integrity, and lineage; Integrate data pipelines with AWS services; Implement automated testing and monitoring.
Seniority
Mid-level, hands-on IC
