Senior Data Engineer
Core
Lead technical data ingestion and processing engagements, architecting cloud-based data solutions for product, sales, leadership, and marketing teams.
Role type
Senior Data Engineer (Cloud & Big Data)
Builds
Enterprise ETL pipelines, data virtualization solutions, and cloud data infrastructure.
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python (Pandas, NumPy), SQL (PL/SQL), Unix Shell Scripting, Apache Spark, Hadoop (HDFS, Hive, Sqoop, Oozie, Flume, Impala), Kafka, Snowflake, AWS, Azure, Databricks, Teradata, Oracle, DB2, Denodo
Preferred skills
Data virtualization, job scheduling (ControlM, IBM Tivoli), data governance, test case design
Technologies
Spark, HDFS, Sqoop, Hive, Impala, Oozie, Flume, Kafka, Streamset, Denodo, Snowflake, AWS, Azure, Databricks, Teradata, Oracle, DB2, SQL Server, Python, Unix Shell, PL/SQL
Responsibilities
Architect and implement data-driven cloud-based solutions; deliver ETL pipelines coordinating with onshore/offshore teams; design documentation and test cases ensuring reliability; monitor team agenda, goals, and governance; serve as a critical resource for medium-large teams.
Seniority
Senior, hands-on IC
