Lead Software Engineer
Core
Design, develop, and operate secure, scalable data collection, storage, access, and analytics platform solutions, including orchestration and streaming data pipelines.
Role type
Lead Software Engineer (Data Engineering & AI Integration)
Builds
Secure, stable, and scalable data platform solutions and automated remediation systems
Domain
Data Engineering, AI-assisted software development, Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, SQL, Data Pipeline Orchestration (Airflow), Streaming Pipelines (Kafka/Pub/Sub), Unit & Integration Testing, Agile Engineering, Application Resiliency, Data Security
Preferred skills
Java Spark, AWS Cloud Technologies, Data Governance Frameworks, Incremental Data Processing, RESTful APIs, Web Technologies
Technologies
Python, SQL, Airflow, Kafka, Pub/Sub, AWS, Spark, JIRA, Confluence
Responsibilities
Design and operate orchestration and streaming data pipelines; Lead adoption and validation of enterprise-authorized AI-assisted engineering practices; Identify and automate remediation of recurring issues; Evaluate vendor and internal architectural designs; Generate data models using linear algebra and statistics; Create efficiency reports and metrics.
Seniority
Senior, hands-on IC with leadership responsibilities
