Data engineer
Core
Design, build, and maintain scalable ETL/ELT pipelines and data architectures for a data platform serving diverse data sources.
Role type
Senior Data Engineer
Builds
Production data pipelines, data lake/lakehouse architectures, and analytical dashboards
Domain
Big Data, Cloud Data Warehousing, Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Apache Spark, Cloud Data Warehousing (Snowflake, Redshift, BigQuery, Synapse), Data Lake/Lakehouse architecture, ETL/ELT processes, SQL, Data Orchestration (Airflow), RESTful API development, React, Git, CI/CD
Preferred skills
Java or Scala, Containerization (Docker, Kubernetes), Stream Processing (Kafka, Kinesis), MLOps support, Open Source contributions
Technologies
Apache Spark, Snowflake, Databricks, AWS S3, Azure Blob Storage, Airflow, React, Tableau, Power BI, Looker, Git
Responsibilities
Design and optimize data ingestion and transformation pipelines; Architect and implement data lake and lakehouse solutions; Develop and maintain data APIs and front-end dashboards; Ensure data quality, governance, and performance optimization; Mentor junior team members; Collaborate with data scientists and product teams
Seniority
Senior, hands-on IC