Lead Data Engineer – Physical AI Platform
Core
Design, build, and maintain scalable data pipelines, microservices, and cloud-based data platforms to deliver reliable data for business and engineering teams, enabling AI models and autonomous machine operations.
Role type
Lead Data Engineer (Physical AI Platform)
Builds
Scalable data pipelines, microservices, and cloud-native data ingestion/streaming solutions for Cat Technology's AI and autonomy initiatives.
Domain
Construction equipment, Physical AI, Edge computing, Cloud infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, AWS (Kinesis, S3, DynamoDB, EventBridge), SQL, Microservices architecture, CI/CD, Data quality frameworks, Observability
Preferred skills
Java, NoSQL databases, Real-time data processing, Team leadership, Root-cause analysis
Technologies
AWS, Python, Java, Kinesis, S3, DynamoDB, EventBridge, CloudWatch, Azure DevOps, Jenkins, Jira
Responsibilities
Lead solution design and optimization of scalable data pipelines and microservices; Drive development of cloud-native data ingestion and streaming solutions; Establish automated testing and data quality controls; Lead operational monitoring and performance tuning of production data platforms.
Seniority
Lead, hands-on IC with team leadership