discourse/plugins/discourse-ai
2025-09-30 10:09:49 +08:00
..
admin/assets/javascripts/discourse DEV: Standardize Ember route, controller and template naming (#34417) 2025-09-25 11:27:45 +01:00
app SECURITY: AI helper suggestions based on a topic should check user has access to it 2025-09-30 10:09:49 +08:00
assets UX: improve AI translations chart colors in dark mode (#35042) 2025-09-29 14:38:22 -04:00
config Update translations (#35031) 2025-09-29 10:26:53 +02:00
db FEATURE: Promote Discover to a dedicated feature. (#34846) 2025-09-23 14:01:45 -03:00
discourse_automation FEATURE: Add option to flag + delete for llm triage (#34590) 2025-09-02 09:16:30 +10:00
evals
lib PERF: optimize translation progress dashboard with batch query (#34861) 2025-09-29 13:32:40 +08:00
public/ai-share
spec SECURITY: AI helper suggestions based on a topic should check user has access to it 2025-09-30 10:09:49 +08:00
svg-icons
test/javascripts DEV: Fix various lint issues (#33811) 2025-07-24 15:27:04 +02:00
.prettierignore
about.json
plugin.rb FEATURE: Promote Discover to a dedicated feature. (#34846) 2025-09-23 14:01:45 -03:00
README.md

Discourse AI Plugin

Plugin Summary

For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco

Evals

The directory evals contains AI evals for the Discourse AI plugin. You may create a local config by copying config/eval-llms.yml to config/eval-llms.local.yml and modifying the values.

To run them use:

cd evals ./run --help

Usage: evals/run [options]
    -e, --eval NAME                  Name of the evaluation to run
        --list-models                List models
    -m, --model NAME                 Model to evaluate (will eval all models if not specified)
    -l, --list                       List evals

To run evals you will need to configure API keys in your environment:

OPENAI_API_KEY=your_openai_api_key ANTHROPIC_API_KEY=your_anthropic_api_key GEMINI_API_KEY=your_gemini_api_key