Discourse/discourse
Discourse/discourse
0
0
Fork 0
mirror of https://gh.wpcy.net/https://github.com/discourse/discourse.git synced 2026-05-09 12:56:25 +08:00
Code Packages Activity Actions
discourse/plugins/discourse-ai
History
Exact
Roman Rizzi df34b9ab71
FIX: LLM config must be valid before running a test (#34806) 
<img width="500" height="246" alt="Screenshot 2025-09-15 at 10 34 05 AM"
src="https://github.com/user-attachments/assets/8d406f25-4720-4d63-9f0d-64031b64111b"
/>
2025-09-15 11:40:01 -03:00
..
admin/assets/javascripts/discourse FEATURE: Translation progress admin UI (#34239) 2025-08-15 12:19:35 -07:00
app FIX: LLM config must be valid before running a test (#34806) 2025-09-15 11:40:01 -03:00
assets FIX: LLM config must be valid before running a test (#34806) 2025-09-15 11:40:01 -03:00
config FIX: LLM config must be valid before running a test (#34806) 2025-09-15 11:40:01 -03:00
db FIX: Truncate seeded persona's names to fit name length constraint (#34393) 2025-08-18 18:08:43 -03:00
discourse_automation FEATURE: Add option to flag + delete for llm triage (#34590) 2025-09-02 09:16:30 +10:00
evals
lib FIX: Ensure base_path is correctly inserted into LLM triage messages. (#34778) 2025-09-11 11:21:06 +10:00
public/ai-share
spec FIX: LLM config must be valid before running a test (#34806) 2025-09-15 11:40:01 -03:00
svg-icons
test/javascripts DEV: Fix various lint issues (#33811) 2025-07-24 15:27:04 +02:00
.prettierignore
about.json
plugin.rb FEATURE: create AI tagging automation (#34587) 2025-08-28 13:13:27 -04:00
README.md

README.md

Discourse AI Plugin

Plugin Summary

For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco

Evals

The directory evals contains AI evals for the Discourse AI plugin. You may create a local config by copying config/eval-llms.yml to config/eval-llms.local.yml and modifying the values.

To run them use:

cd evals ./run --help

Usage: evals/run [options]
    -e, --eval NAME                  Name of the evaluation to run
        --list-models                List models
    -m, --model NAME                 Model to evaluate (will eval all models if not specified)
    -l, --list                       List evals

To run evals you will need to configure API keys in your environment:

OPENAI_API_KEY=your_openai_api_key ANTHROPIC_API_KEY=your_anthropic_api_key GEMINI_API_KEY=your_gemini_api_key