Senior Software Engineer, Data Engineering
Core
Design, develop, and implement large-scale, high-volume data models and pipelines for data lakes and data warehouses; manage data products that deliver high-quality, trustworthy data.
Role type
Senior IC data engineer
Builds
Data lakes, data warehouses, and ETL pipelines
Domain
Data engineering, distributed computing, cloud data platforms
Deliverable
production ML models
Required skills
Python, Java, SQL, ETL orchestration, distributed data ecosystems, streaming technologies, database management, reporting tools
Preferred skills
Strategic thinking, market analysis
Technologies
Airflow, Flink, Oozie, Azkaban, AWS, GCP, Spark, Hive, Druid, Presto, Kafka, Snowflake, Redshift, PostgreSQL, Tableau, Superset, Looker
Responsibilities
Gather data requirements from business partners and stakeholders; collect required data in collaboration with engineering, product teams, and third parties; design, develop, and implement large-scale, high-volume data models and pipelines; develop data quality checks, conduct QA, and implement monitoring routines; improve the reliability and scalability of ETL processes; manage data products that deliver high-quality, trustworthy data; help onboard and support new engineers
Seniority
Senior, hands-on IC
