Sr. Data Engineer-Hadoop,Hive,Spark,Trino, Star Rocks, Clickhouse,Data engineering-3+yrs AI exposure
Core
Sr. Data Engineer designing and implementing scalable data pipelines, architectures, and automation for data-driven features and products.
Role type
Senior IC Data Engineer
Builds
Data pipelines, ETL/ELT processes, and automation tools for batch and real-time data
Domain
Financial services / Distributed data systems
Deliverable
production ML models
Required skills
Hadoop, Hive, Spark, Trino, StarRocks, ClickHouse, Java, Python, SQL, CI/CD, containerization, observability, secure coding
Preferred skills
Open-source contributions, AI agents, agentic patterns, real-time systems, enterprise-class architecture
Technologies
Hadoop, Hive, HBase, Spark, Trino, StarRocks, ClickHouse, Java, Python, Git, Kubernetes, Docker
Responsibilities
Translate functional requirements into architecture designs; implement extensible and maintainable code; provide end-to-end ownership of data products; build automation processes for data transformation and monitoring; write queries and implement orchestration for data extraction; ensure data quality and governance adherence; manage software upgrades and security patches.
Seniority
Senior, hands-on IC
