LLM Evaluation & Agents
927 open positions
-
Senior | Staff Software Engineer - AI / ML SnorkelaiSan Francisco $208k1mo Build faster, cheaper, and more rigorous ML evaluation systems for frontier AI agents and models.
-
Teaching Assistant | AI Engineering & Generative AI | Part - Time MasaiRemote 1mo Support learners in an online AI program by conducting doubt-solving sessions, debugging code, and guiding the development of practical AI and Generative AI applications.
-
Applied AI Engineer Eve & CoUSA $200k1mo Build and maintain the retrieval, generation, and evaluation systems for Arthur, a software product that analyzes public records, regulatory filings, and community data to provide clients with traceable analytics and insights.
-
Principal Software Engineer MicrosoftIndia, Telangana, Hyderabad 1mo Designing, building, and optimizing scalable software products and platforms with a focus on AI, NLP, and search technologies.
-
Applied AI Engineer↗ Fuse EnergyLondon, England, UK 1mo Design, develop, and deploy AI-powered features for consumer experiences (e.g., Energy Co-Pilot, onboarding) and internal productivity tools for an energy company.
-
Siri Language Engineer (Filipino) AppleSingapore, Singapore 1mo Design and implement large-scale ML solutions for Siri to support Filipino users and integrate personalized experiences across global markets.
-
-
Data & AI Intern CopartDallas, TX - Headquarters, US 1mo Design, build, and ship AI-driven applications and features for Copart's global vehicle auction platform, integrating LLMs and ML models into core services.
-
Stage Innovation : Ingénieur Intelligence Artificielle / Supply Chain AltenSèvres, IDF, fr 16k1mo Develop AI solutions to automate key supply chain tasks including sourcing, logistics analysis, and planning.
-
-
Senior ML Specialist QuartileBrasil 1mo Authority on model mechanics and evaluation for a production agentic AI platform, ensuring statistically sound decisions and benchmarks for autonomous customer success workflows.
-
Senior Machine Learning Engineer - AIOS ZafinCANADA 1mo Design, build, test, and maintain ML and AI capabilities for AIOS, focusing on knowledge retrieval, model integration, and production reliability.
-
-
-
Senior Applied Scientist, SageMaker AI
AmazonNew York, New York, United States
$167k1mo
Building next-generation tools to enable custom AI/ML solutions for customers, partnering with technology and business teams to solve real-world problems.
-
Junior AI Engineer – Conversational AI & Sales Solutions (w/m/d) FreenetRemote 1mo Developing and integrating conversational AI and LLM-based solutions for sales teams and customer interactions.
-
MaaS解决方案实习生（J106037） Baidu上海市 1mo Testing and evaluating large language model products against business requirements and benchmarks, validating technical solutions for client scenarios, and bridging communication between solution and product teams.
-
-
Backend / Platform Engineers↗ AlgoleapMumbai, Maharashtra, India 1mo Builds and tunes content inspection systems that run on every prompt and response to identify and classify sensitive data.
-
Lead Data & AI Scientist TripledotstudiosSupersonic - Tel Aviv 1mo Owns end-to-end predicted-LTV models, churn/retention models, and LLM-orchestrated agent workflows to automate player value and behavior decisions across live mobile games.
-
Machine Learning Engineer - HiredScore WorkdayIsrael, Tel Aviv 1mo Design, build, and improve ML-powered software products for talent orchestration, focusing on NLP, large-scale textual data analysis, and generative AI to enhance recruitment and talent management.
-
AI Generalist↗
Rex.ZoneRemote
$63k–$127k1mo
Oversee computer vision annotation, prompt evaluation, and comprehensive QA evaluation processes to ensure training data quality for LLM training pipelines.
-
Forward Deployed Machine Learning Engineer RaydarRemote $170k1mo Design and build production benchmarks and evaluation systems for foundation models across domains and modalities, including sandboxed environments for agentic evaluations.
-
Expert Opportunity - Software Development Expert ($100/hr, up to $2,000/week)↗ EthosRemote 1mo Senior software engineers evaluating and refining AI-generated work for a foundational AI lab's language model training.
-
-
-
Junior Applied AI Engineer IlluinParis La Défense 1mo Design and develop custom Data Science solutions and products with high impact for clients, users, and society.
-
Member of Technical Staff RunwayUSA 1mo Own the end-to-end evaluation platform for generating, annotating, reviewing, and adapting model evaluations at scale for frontier models.
-
-
AI & Software Engineer Akkodis Sweden ABGöteborg, Sweden 1mo Develop and deploy AI and LLM solutions to automate and support software engineering processes and development workflows.
-
Senior Math Libraries Engineer - LLM Integration and Developer Experience NVIDIARemote - Poland 221k1mo Designing and implementing math library APIs and documentation structures optimized for LLMs and AI agents to accelerate integration into modern AI workflows.
-
Freelance Technical Consultant TolokaRemote 1mo Design and implement data labeling pipelines and act as a trusted technical advisor for customers to build scalable AI solutions.
-
Graduate Software Engineer MaincodeMelbourne 1mo Building and maintaining Matilda, an Australian-made AI production system for inference and model training.
-
Software Engineer, Machine Learning EmaVancouver, BC 1mo Building and deploying production-level machine learning models for NLP, retrieval, ranking, reasoning, dialog, and code-generation systems to enable an Agentic AI platform that delegates tasks to an 'Universal AI Employee'.
-
Software Engineer, Computational Policy Lab Harvard-UniversityCambridge, MA, us 1mo Build and deploy generative AI and machine learning tools for education technology and public policy research, including randomized controlled trials.
-
Machine Learning Engineer, Monetization AI/ML OpenAISan Francisco 1mo Design and deploy advanced machine learning models to solve real-world monetization problems, turning research breakthroughs into production AI applications.
-
-
Senior Machine Learning Engineer ByteDanceUSA 1mo Develop and improve machine learning and large language model systems for code generation, unit test generation, debugging, and building AI-powered developer agents.
-
Software Development Engineer II, Compliance and Safety Services, Amazon Stores, Compliance and Safety Services (CoSS), Amazon Stores
AmazonBucharest, Romania
1mo
Build ML automation and AI models using LLMs and SLMs to automate compliance controls and mitigate product safety risks at global scale.
-
KI Ressourcement (m/w/d) Bertrandt AGKarlsruhe, Baden, BADEN_WUERTTEMBERG 1mo Testing, planning, and documentation of Large Language Models (LLMs), including performance analysis, optimization, and integration within MCP-Server architectures.
-
Stage de fin d’études — LLM-as-a-Judge : évaluation automatique, fiabilité et qualité des modèles d’IA (H/F) WavestonePuteaux, IDF, fr 1mo Designing an automatic evaluation framework based on LLM-as-a-Judge to assess the reliability, bias, and quality of generative AI and agent solutions.
-
AI Product Engineer MathspaceRemote 1mo Lead the development of intelligent learning experiences powered by large language models (LLMs) and generative AI to provide personalized, real-time math guidance to students and teachers.
-
AI Engineer Tech AaltoSydney, New South Wales 1mo Design, develop, and optimize prompt strategies for generative AI models to deliver cutting-edge solutions for Public Sector clients.
-
Grupo QuintoAndar | Senior Data Scientist (Women Applicants Only) QuintoAndarRemote 1mo Architect, develop, and deploy machine learning systems (including LLM-powered applications) to production for search, recommendation, and customer experience enhancement in the real estate sector.
-
Sr. Engineer - AI Solutions↗ Magna InternationalToronto, Ontario, Canada CA$103k–CA$125k1mo Developing next-generation AI solutions with Machine Learning, GenAI, and Agentic AI to improve engineering processes and efficiency across system, mechanical, electrical, and software engineering domains.
-
-
Technical Program Manager HudRemote 1mo Own complex, time-sensitive data and evaluation programs for frontier AI labs, data vendors, and internal teams to ensure data is useful for evaluating and improving LLMs and agents.
-
Software Engineer, Tokens and Prompt Structures AnthropicSan Francisco, CA $320k1mo Design and maintain encoding libraries and prompt structures that enable Claude to consume text and multimodal data, bridging research experiments to production systems.
-
Product-Focused Data Scientist (LLM Products) BlueroseresearchRemote $160k1mo Build LLM-powered research and analysis tools for political campaigns to enhance strategy development and communication.
-
Browse by specialty
AI Data AlignmentAI EngineeringAI Software EngineeringAndroid DevelopmentApplied AI StackAutomotive AndroidAutomotive EmbeddedAvionics SoftwareBackend EngineeringBackend Web QABrowser Extension DevBusiness IntelligenceC# BackendC# Full StackCloud SecurityConversational AI QACross-Platform MobileData & ETL QAE-Commerce BackendEmbedded LinuxEngineering ManagementEnterprise IntegrationEntry-Level EngineeringERP System QAField Service TechFinTech BackendGame Engine DevGenAI CloudGeneral FrontendGPU Compiler EngHardware VerificationHigh-Frequency TradingIndustrial AutomationiOS DevelopmentIT Support QAJava BankingJava EnterpriseJava FrontendJava MicroservicesMainframe DevelopmentManual Software TestingMedical Device SWML InfrastructureMobile App QANetwork FirmwareNode.js BackendNode.js Full StackPerformance TestingPHP Web DevQA LeadershipReact FrontendRobotics SimulationRPA AutomationSalesforce & Identity QASalesforce EngineeringSAP ABAPSecure Systems TestingSecurity ProductsServiceNow EngineeringSoftware EngineeringSoftware EngineeringSoftware EngineeringSoftware Engineering LeadershiTest AutomationWeb Automation QA
Agile Release ManagementAI InfrastructureAI InfrastructureAI Platform EngineeringApplication DevOpsAWS Kubernetes EngineeringAzure Cloud InfrastructureAzure DevOps EngineeringBroadcast & OSP EngineeringCarrier Network OperationsCloud InfrastructureCloud InfrastructureCloud Infrastructure EngineeriData Center FacilitiesDefense & Security PlatformsDesktop & IT HelpdeskDevSecOps & ClearanceEmbedded Linux & ASICEndpoint ManagementEngineering Systems AdministrationEnterprise Network AdministrationExecutive IT SupportFinancial Trading SystemsFintech Platform EngineeringGCP Cloud EngineeringGlobal Technical SupportHPC & Liquid CoolingHybrid Cloud SREIndustrial Automation & SCADAIntegration & RPAIT Infrastructure LeadershipIT Service ManagementLinux Systems EngineeringMainframe & MiddlewareManaged Cloud OperationsModern Workplace CollaborationNetwork Automation & SDNObservability EngineeringOpenShift & Container PlatformPhysical Infrastructure ProjectsPlatform EngineeringPublic Sector DevOpsSAP Basis AdministrationServiceNow Platform EngineeringSite Reliability EngineeringSolutions ArchitectSpace & Mission SystemsStorage & BackupTelecom & Hybrid ReliabilityWindows Systems Administration
Ad Tech and RankingAdministrative Compliance AnalyticsAds & Personalization MLAgentic AI WorkflowsAI Agents and SafetyAI Automation AnalyticsAI Language TrainingAI Strategy and ArchitectureAnalytics EngineeringApplied GenAI ConsultingAutonomous Driving MLAWS Databricks EngineeringAzure Data EngineeringBI Analytics EngineeringBI Visualization EngineeringBiological Discovery ResearchBiostatistics and SafetyClinical Data EngineeringClinical Laboratory ScienceComputational GenomicsComputer Vision EngineeringComputer Vision LocalizationConsulting Data ScienceConversational AI EngineeringCredit and Fraud RiskCrypto and AI ResilienceData EngineerData EngineerData EngineerData EngineerData Engineering LeadershipData Governance ComplianceData Governance EngineeringData Infrastructure AnalyticsData Science InternshipsData Strategy LeadershipDatabase AdministrationDecision Science AIDigital Marketing AnalyticsE-commerce Data EngineeringEdge AI HardwareEnterprise Data ArchitectureEntry Level InternshipsEnvironmental and GeoscienceFinancial Data EngineeringFinancial Strategy AnalyticsFood Science ResearchForward Deployed AIFraud Risk AnalyticsGCP Data EngineeringGeneral Data PlatformGenerative AI EngineeringGenerative AI SystemsGeospatial GIS AnalyticsGovernment AI SecurityHealthcare Data ScienceHealthcare Risk AnalyticsHEOR and Clinical AIHPC ML EngineeringHR Data IntegrationHR People AnalyticsInformatica Data EngineeringInsurance Actuarial AnalyticsInsurance and ActuarialIT Operations AnalyticsJava Python Data EngKnowledge Graph EngineeringLaboratory Quality AnalyticsLife Sciences AILLM Core EngineeringLLM Evaluation & AgentsLogistics Operations AnalyticsManufacturing Data SystemsManufacturing Process AnalyticsMarket Economics ResearchMarketing ExperimentationMicrosoft Fabric DataMLOps EngineeringPalantir Foundry EngineeringPharma Analytical ChemistryPharma Process DevelopmentPhysical AI DataProcurement Sourcing AnalyticsPublic Health ResearchQuantitative Finance ResearchQuantum and ImageryRisk & Fraud MLRobotics and PerceptionRobotics ML EngineeringSAP BW DataSAP Master DataSearch & Recommendation MLSecurity and ClearanceSnowflake Data EngineeringSnowflake DBT EngineeringSpeech AI EngineeringSupply Chain ForecastingSupply Chain Planning
AI Product SecurityApplication Security EngineeringCloud Infrastructure SecurityCloud Security AssessmentDetection EngineeringEmbedded Firmware SecurityEnterprise Application SecurityFacility Security ManagementGeneral Cyber DefenseGovernance Risk ComplianceIdentity & Access ManagementNetwork Firewall EngineeringOffensive Security TestingOT Industrial SecurityPhysical Guard ServicesPhysical Security EngineeringPrivacy and AI GovernanceSecurity Architecture LeadershipSecurity Program ManagementSecurity Solutions SalesSOC OperationsThreat Intelligence AnalysisVulnerability ManagementVulnerability Research
Academic Product EngineeringAdobe Experience PlatformAgile Scrum MasteryAI Agent EnablementAI Content CreationArchitectural & Interior DesignAutonomous Vehicle ProductsBanking Product DesignBroadcast Production ManagementBusiness Systems AnalysisContact Center TechnologyConversation UX DesignCreative Agency DesignCybersecurity Product ManagementData & ML ProductsDefense Systems ManagementDeveloper Tools ProductDigital Health PlatformsE-commerce MerchandisingEngineering CAD DesignEnterprise Solution ArchitectureEvent & Studio TechFrontend Engineering ManagementGame & Level DesignGaming Product ManagementGenerative AI SolutionsGovernment SaaS ProductsHealthcare AI StrategyHRIS Product ManagementIndustrial Product DesignInfrastructure & ObservabilityInstructional Design & LMSInsurance Claims TechnologyInsurance Product ManagementIT Project ManagementITSM & CRM ArchitectureLegal Tech ProductsNPI Program ManagementPLM Solution ArchitectureProduct AnalyticsProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagerSalesforce Product OwnershipSAP ERP SolutionsSemiconductor Product EngineeringSmart Manufacturing AISupply Chain Product ManagemenTechnical Program ManagementUI/UX Design SystemsUX Research
Aerospace Manufacturing QAAerospace Systems EngineeringAerospace Systems TestAnalog IC DesignASIC Physical DesignASIC Verification EngineeringAutomotive Repair TechnicianAutomotive Systems EngineeringAutonomous Vehicle QACivil Structural EngineeringCNC Machining & FabricationConstruction Project ManagementElectrical Inspection & SafetyElectronics Test EngineeringEmbedded Firmware EngineeringEnvironmental Health & SafetyFacilities Maintenance EngineeringField Service EngineeringHVAC Design EngineeringIndustrial Automation ControlsIndustrial Construction QAIndustrial Maintenance EngineeringLandscaping & Yard OpsManufacturing Process EngineeringMaterials & Chemical LabMechanical Product DesignNetwork Hardware QAPCBA Test EngineeringPharmaceutical Manufacturing EngineeringPhotonics Test EngineeringPower Electronics DesignPower Systems EngineeringProduction OperationsRF & Avionics DesignSemiconductor Process EngineeringSilicon ValidationSpacecraft Mechanical EngineeringSubstation Automation QA
Account-Based Demand GenAI Product MarketingApparel Retail ManagementBanking Relationship SalesContent Communications MarketingEnterprise AI SalesEnterprise Customer SuccessEnterprise Security SalesExperiential Sports MarketingFrontline Service SalesGeneral Business DevelopmentHealthcare Brand MarketingHigh-Incentive Sales RepsIndustrial Technical SalesIndustrial Territory SalesInsurance Lines SalesMarketing Analytics OperationsPartner Channel StrategyPayments Business DevelopmentPerformance Paid MediaPharmaceutical Clinical SalesProcurement Supply ChainRetail Trade MarketingSales Compensation OperationsSales Development RepsSEO Digital MarketingSocial Creative DesignTechnical Solutions Engineering
Automotive OperationsBanking Operations & LendingCommodity & Indirect SourcingCompliance & Contact QACompliance ManagementConstruction & Electrical ProjectsContinuous Improvement & LeanCulinary & Kitchen StaffCustodial & Building ServicesCustomer ServiceDelivery & Traffic CoordinationEducational & Correctional ProgramsEHS Compliance & SafetyEngineering Executive LeadershipEnvironmental Permitting & CarbonERP & WMS SystemsEvent Production & ConcertsExecutive & GTM RecruiterExecutive & Legal AdministrationFacilities Management & OperationsFood Safety QAGeneralist & Early Talent RecruiterGrocery Produce & DeliHealthcare OperationsHealthcare Staffing RecruiterHospitality Concessions & BarHR Business PartneringHR Operations & PayrollIT & Program ProcurementLast Mile LogisticsMaintenance Planning & ReliabilityMajor Construction Project ControlsMaterials & Inventory ControlMission & Defense OperationsOperations & TrainingOperations ManagementOperations ManagementOrganizational Change ManagementPlant & Operations LeadershipProduction Planning & SchedulingProduction SupervisionProject Coordination & AdminPublic Sector Project ManagementReal Estate & Land DevelopmentRestaurant General ManagementRetail Softgoods OperationsRobotics Deployment ProjectsSemiconductor & IE OperationsSpanish Market QAStudent Life & FraternitySupplier QualitySupply Chain StrategyTechnical & Manufacturing RecruiterTextile & Garment QCWarehouse & Distribution OperationsWarehouse Material Handling
Accounts PayableActuarial PricingBusiness AnalyticsCommercial FinanceCorporate DevelopmentCorporate Governance ComplianceCorporate TaxCost AccountingCredit RiskERP SystemsFinance AI InnovationFinancial Crime ComplianceFinancial ReportingFP&A AnalysisFrench Financial QAFund AccountingHealthcare RevenueInternal AuditPayments EngineeringPayroll AdministrationProject ControlsPublic AccountingQuality AuditingQuantitative TradingReal Estate FinanceRetail BankingSAP FinanceSurety UnderwritingThird-Party RiskTreasury OperationsWealth Advisory
Acute Care NursesBehavioral HealthCardiac Imaging TechsCardiology PhysiciansClinical DataClinical DevelopmentClinical EngineeringClinical InformaticsClinical LaboratoryClinical PharmacyClinical Project MgmtClinical Research AssociatesClinical SpecialistsComputer System ValidationDentistryDietary ServicesEmergency MedicineHealthcare RecruitingHospitalistsInfection ControlLab QC OperationsLaboratory ManagementLaboratory Quality ControlLong-Term CareMedical AssistantsMedical CodingMedical Device QAMedical Device TechsMedical EducationMedical Science LiaisonsMedical WritingNurse Case ManagersNursing AdministrationOccupational HealthOncologyPediatricsPharma Manufacturing QAPharmacovigilancePrimary CarePrivate MedicalPsychiatry PhysiciansQuality and ValidationRadiology PhysiciansRadiology TechnologistsRegulatory AffairsRehabilitation TherapistsResearch CoordinatorsRespiratory TherapistsRetail PharmacySurgerySurgical TechsTelehealth ProvidersVeterinary Medicine
Biomedical and Civil EngineeringBioprocess & AnalyticalComputational Biology and GenomicsCore Facility ResearchCorporate AI ResearchEnergy Systems & AIFaculty Administration and MedicineGeneral Academic ResearchGeneral Postdoctoral ResearchHealth Behavior StudiesMaterials and Quantum ScienceNeuroscience & PsychologyNeuroscience and NeurologyPharmacometrics & RegulatoryPhysics and Energy ResearchPolytechnic Engineering InstructionQuantum & AcceleratorRobotics & AITenure-Track FacultyTraditional Campus Instruction
← Select a job to preview