Data Engineer Sr
Core
Build and maintain robust ETL/ELT pipelines for large-scale data ingestion, transformation, and aggregation on Hadoop and cloud platforms.
Role type
Senior Data Engineer
Builds
Production-grade data pipelines and modules on Databricks, Hadoop, and Snowflake
Domain
Big Data Engineering / Cloud Data Platforms
Deliverable
production ML models | product features
Required skills
Python, PySpark, SQL, Apache Spark, Hadoop ecosystem, Apache Airflow, Apache NiFi, CI/CD, Git, Cloud data platforms (Databricks, Snowflake)
Preferred skills
Java development, AI coding assistants
Technologies
Databricks, Snowflake, Hadoop, Hive, Impala, Airflow, NiFi, Talend, Git
Responsibilities
Develop high-performance data processing jobs; Optimize pipeline performance and cost; Contribute to CI/CD for data workflows; Partner with Product Managers to scope and build new data modules
Seniority
Senior, hands-on IC