Data Engineer 2
Core
Builds a curated Marketing analytics focused data & tools ecosystem by ingesting, processing, and managing data from internal and external sources to support business analytics teams.
Role type
Mid-level Data Engineer (ETL & Big Data)
Builds
Data ingestion pipelines, analytical workbenches, dashboards, and tools for marketing analytics.
Domain
Financial services / Marketing Analytics / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Spark, ETL, Hadoop, Hive, Azure Data Factory, Databricks, Scala
Preferred skills
Streaming data processing, HDFS maintenance, Rest API design, Shell scripting
Technologies
Hadoop, Spark, Hive, Oozie, Sqoop, HDFS, Impala, Microsoft Azure (ADLS, Blob Storage, DataFactory, Functions), Databricks, Git
Responsibilities
Collaborate with stakeholders to transform business requirements into analytical tools; Extract, transform, and load Credit and Retail data from diverse sources; Develop and maintain analytics frameworks and dashboards; Create POCs for streaming data ingestion; Troubleshoot data sets and analytical tools; Manage computing resources for concurrent projects.
Seniority
Mid-level (2-5 years experience), hands-on IC
