Senior Associate Data Engineering L2
Core
Design and deliver scalable data engineering solutions, build end-to-end data pipelines, and drive technical design discussions to ensure robust architectures for clients.
Role type
Senior Associate L2 Data Engineer
Builds
End-to-end data pipelines, analytics capabilities, and cloud-based data solutions
Domain
Data Engineering, Big Data, Cloud Platforms
Deliverable
production ML models
Required skills
Scala, Python, Spark, Kafka, Airflow, Hadoop ecosystem, NoSQL, MPP data platforms, data integration, IAM, data security
Preferred skills
ETL tools (Informatica, Talend), data governance tools (Collibra, Alation), messaging frameworks (ActiveMQ, RabbitMQ), CI/CD practices, Gen AI experience
Technologies
AWS, Azure, GCP, Hadoop, Spark, Hive, Kafka, Flink, NiFi, Airflow, MongoDB, Cassandra, Redshift, BigQuery
Responsibilities
Design scalable data engineering solutions, build and optimize data ingestion pipelines, implement data processing and storage frameworks, drive architecture discussions, develop analytics and search capabilities, collaborate on data platform integration
Seniority
Senior, hands-on IC
