Data Engineer Sr
Core
Build and maintain robust ETL/ELT pipelines for large-scale data ingestion, transformation, and aggregation on Hadoop and cloud platforms.
Role type
Senior Data Engineer
Builds
Production-grade data pipelines and data processing jobs
Domain
Big Data / Cloud Data Platforms
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Apache Spark, Hadoop ecosystem, Databricks, Snowflake, Apache Airflow, Apache NiFi, Git, CI/CD
Preferred skills
Java, cloud-native foundations, AI coding assistants
Technologies
Databricks, Snowflake, Hadoop, Hive, Impala, Airflow, NiFi, Talend, PySpark
Responsibilities
Develop high-performance data processing jobs; Optimize pipeline performance and cost; Contribute to CI/CD for data workflows; Partner with Product Managers to scope and build new modules
Seniority
Senior, hands-on IC (via careerplan.io/jobs/45-004-A6-171-data-engineer-sr-at-sequoia-connect)
