Data Engineer - II (FTC), DAVENGERS(Data Avengers)
Core
Design, implement, and support an analytical data infrastructure serving both business intelligence and machine learning applications.
Role type
Data Engineer (II)
Builds
Data pipelines, data warehousing solutions, and ML-ready data platforms
Domain
Cloud data engineering, Machine Learning infrastructure
Deliverable
production ML models | product features
Required skills
Data modeling, ETL pipeline development, SQL, AWS resource management
Preferred skills
Non-relational databases, AWS Glue, AWS Kinesis, AWS Lambda, AWS IAM
Technologies
AWS (EC2, Redshift, EMR-Spark, S3, Glue, Kinesis, FireHose, Lambda, IAM), SQL
Responsibilities
Design and implement analytical data infrastructure; Manage AWS resources including EC2, Redshift, and EMR-Spark; Collaborate with scientists to build data pipelines for ML model training; Extract, transform, and load data from diverse sources; Implement advanced analytics algorithms for statistical analysis and prediction; Automate reporting and analysis processes.
Seniority
Mid-level, hands-on IC