Senior Data Enginner
Core
Design and develop big data ETL pipelines and data solutions aligned with architecture strategy to meet business requirements.
Role type
Senior Data Engineer (Big Data/ETL)
Builds
Data pipelines, ETL processes, and data warehouse solutions
Domain
Financial services / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Apache Spark (Scala/Python), Big Data platforms, Databricks, Airflow, DBT, SQL, Oracle/PL-SQL, Hadoop/Hive, Cloudera, Linux/Unix/Windows OS
Preferred skills
DevOps tools (GitHub, Jenkins, JIRA), Containerization (Docker, Kubernetes, OpenShift), Cloud platforms (AWS, Azure, PCF), BI tools (Tableau, Power BI, Snowflake, Presto), TDD
Technologies
Spark, Scala, Python, Databricks, Airflow, DBT, Hadoop, Hive, Cloudera, Oracle, SQL, Linux, AWS, Azure, Docker, Kubernetes, OpenShift, Tableau, Power BI, Snowflake, Presto, Superset
Responsibilities
Collaborate with Product Owners and Managers to determine technical solutions; Design and develop project initiatives; Ensure alignment with data/architecture strategy; Create technical documentation; Assist application support with production troubleshooting; Coordinate with Quality Engineering for testing; Mentor team members
Seniority
Senior, hands-on IC
