Snr Data engineer
Core
Develop and maintain the Finance Data Platform, serving as the central repository for finance datasets including positional/trade, sub-ledger, and general-ledger data.
Role type
Senior Data Engineer
Builds
Finance data platform leveraging Airflow and Databricks
Domain
Financial services / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Apache Spark (Scala/Python), Databricks, Airflow, DBT, SQL, Oracle/PL-SQL, ETL/data-pipelines, Hadoop/Hive, Big Data platforms, Linux/Unix/Windows OS
Preferred skills
DevOps tools (GitHub, Jenkins, JIRA), Containerization (Docker, Kubernetes, OpenShift), Cloud platforms (AWS, Azure, PCF), BI/Analytics tools (Tableau, Power BI, Snowflake, Presto), TDD
Technologies
Airflow, Databricks, Spark, Scala, Python, DBT, Hadoop, Hive, Cloudera, Oracle, SQL, Linux, Windows, AWS, Azure, Docker, Kubernetes, Jenkins, GitHub, Tableau, Power BI, Snowflake, Presto, Superset
Responsibilities
Design and develop technical solutions for data projects; ensure alignment with data/architecture strategy; create technical documentation; assist application support with production troubleshooting; coordinate with Quality Engineering for testing; mentor team members
Seniority
Senior, hands-on IC