0
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2026-08-06 13:08:40 +08:00
discourse/plugins/discourse-ai/evals/lib
Sam f930e0ea98
FIX: properly terminate chains of tool calls across multiple providers (#36750)
The following PR makes it so Anthropic/OpenAI and Google properly
terminate LLM agent chains when they reach the end.

Each LLM has different rules about how to "halt" and force LLM to return
results.

This also improves the eval system to support new LLM chain type evals.

see: https://github.com/discourse/discourse-ai-evals/pull/14

It also corrects open ai responses api which is a bit off at the moment
cause it is not retaining ids
2025-12-19 07:00:51 +11:00
..
prompts FIX: properly terminate chains of tool calls across multiple providers (#36750) 2025-12-19 07:00:51 +11:00
runners FEATURE: Run eval comparisons against a dataset (#36223) 2025-11-28 14:37:55 -03:00
boot.rb
cli.rb FEATURE: Run eval comparisons against a dataset (#36223) 2025-11-28 14:37:55 -03:00
console_formatter.rb FEATURE: Format eval comparison results into a table (#36724) 2025-12-16 12:58:43 -03:00
eval.rb FEATURE: Run eval comparisons against a dataset (#36223) 2025-11-28 14:37:55 -03:00
features.rb FEATURE: Use evals to compare LLMs and Personas' prompts (#36027) 2025-11-18 10:39:52 -03:00
judge.rb FEATURE: Run eval comparisons against a dataset (#36223) 2025-11-28 14:37:55 -03:00
llm_repository.rb FEATURE: Cover all LLM features with evals (#35693) 2025-11-13 12:24:56 -03:00
persona_prompt_loader.rb FEATURE: Use evals to compare LLMs and Personas' prompts (#36027) 2025-11-18 10:39:52 -03:00
recorder.rb FIX: properly terminate chains of tool calls across multiple providers (#36750) 2025-12-19 07:00:51 +11:00
structured_logger.rb REFACTOR: centralize eval orchestration around feature-driven playground (#35718) 2025-10-30 13:08:38 -03:00
workbench.rb FEATURE: Format eval comparison results into a table (#36724) 2025-12-16 12:58:43 -03:00