Sr Data Engineer
Core
Design, develop, and maintain scalable ETL/ELT pipelines and cloud-native data solutions for enterprise platforms. (via careerplan.io/jobs/45-004-7A-27C-sr-data-engineer-at-sequoia-connect)
Role type
Senior IC data engineer
Builds
Scalable data pipelines, data models, and cloud-native data solutions
Domain
Enterprise IT services, cloud data engineering
Required skills
SQL, Python, PySpark, Azure Cloud (ADF, Databricks, ADLS, Synapse, Event Hubs), RESTful APIs, Kafka, Spark, Hadoop, Kubernetes, Docker, Apache Airflow
Preferred skills
Delta Live Tables, Auto Loader, Change Data Capture, DataOps, CI/CD, Infrastructure as Code
Technologies
Azure Data Factory, Azure Databricks, ADLS, Azure Synapse Analytics, Azure Event Hubs, Kafka, Spark, Hadoop, OpenShift, Kubernetes, Docker, Apache Airflow
Responsibilities
Design and develop scalable ETL/ELT pipelines for batch and real-time data processing; Build and optimize data models, Delta Tables, and Lakehouse architectures; Develop and integrate RESTful APIs and data services; Implement real-time data ingestion frameworks using streaming technologies; Ensure data quality, governance, security, and compliance; Troubleshoot, monitor, and optimize pipeline performance; Support DataOps and CI/CD practices
Seniority
Senior, hands-on IC