Data Engineer – Physical AI Platform
Core
Design, build, and maintain scalable data pipelines and microservices to ingest and process real-time and batch data from 1.6 million connected assets for AI model development and autonomous construction systems.
Role type
Senior Data Engineer (Physical AI Platform)
Builds
Cloud-based data ingestion solutions, real-time/batch data pipelines, and microservices for Cat Technology's AI layer.
Domain
Construction equipment, Physical AI, Edge computing, Cloud infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Java, AWS services (Kinesis, S3, DynamoDB, EventBridge), SQL, CI/CD, API development, Microservices architecture, Data pipeline design, Automated testing, Distributed systems monitoring
Preferred skills
NoSQL databases, OAuth 2.0, Event-driven architecture, Large-scale data platform experience
Technologies
Python, Java, AWS, Kinesis, S3, DynamoDB, EventBridge, CloudWatch, Azure DevOps, Jenkins, Jira
Responsibilities
Design and optimize data pipelines for real-time and batch processing; Develop cloud-based data ingestion solutions; Build data integration workflows for CI Autonomy; Translate business requirements into data workflows; Implement automated testing and validation; Monitor and troubleshoot pipelines.
Seniority
Mid-Senior, hands-on IC
