Software Engineer, Data
Core
Design, build, and maintain scalable data infrastructure, pipelines, and architectures to support AI model development and business decision-making.
Role type
Senior data infrastructure engineer
Builds
Scalable data pipelines, ETL processes, data warehousing, and data lake solutions
Domain
Data engineering and platform infrastructure for AI/ML
Deliverable
production ML models
Required skills
Python, SQL, big data technologies (Hadoop, Spark, Hive), data warehousing (Redshift, BigQuery, Snowflake), real-time streaming (Kafka, Flink), distributed systems, databases, caching, messaging systems
Preferred skills
Data governance, query optimization, incident troubleshooting, end-to-end product ownership
Technologies
Python, SQL, Hadoop, Spark, Hive, Redshift, BigQuery, Snowflake, Kafka, Flink
Responsibilities
Design and develop scalable data pipelines and ETL processes; design and implement secure backend architectures; write clean, maintainable code and participate in code reviews; collaborate with data scientists to support AI model accuracy; develop data governance policies; ensure data integrity, quality, and security; optimize data queries and processing performance; monitor and troubleshoot data-related issues.
Seniority
Senior, hands-on IC