Senior Data Engineer- Spark, Abinitio, Python, SQL, Data warehouse
Core
Lead moderately complex initiatives and build/maintain optimized, highly available data pipelines to facilitate deeper analysis and reporting for enterprise strategy deliverables.
Role type
Senior Data Engineer
Builds
Large scale data processing frameworks, data pipelines, data models, and analytics environments
Domain
Financial services / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data Engineering, Apache Spark, Abinitio, Python, SQL, Data Warehousing, Hadoop, Hive, Kubernetes, Docker, Google BigQuery, Autosys, NoSQL DBMS, Real-time data streaming (Kafka), Cloud ecosystems (GCP)
Preferred skills
GCP Associate Cloud Engineer Certification
Technologies
Apache Spark, Abinitio, Python, SQL, Hadoop, Hive, Kubernetes, Docker, Google BigQuery, Autosys, MongoDB, Neo4j, Kafka, Google Cloud Platform
Responsibilities
Lead moderately complex initiatives within Technology; Build and maintain optimized and highly available data pipelines; Review and analyze moderately complex business, operational or technical challenges; Oversee data integration work including developing data models and maintaining data warehouses; Resolve moderately complex issues and lead teams to meet data engineering deliverables
Seniority
Senior, hands-on IC
