discourse/plugins/discourse-ai/db/migrate/20260310121612_create_ai_tool_actions.rb
Rafael dos Santos Silva fe5e4a27e9
FEATURE: Add human-in-the-loop approval queue for AI agent tool actions (#38446)
## Summary

AI agents have 13 moderation tools (close_topic, delete_topic,
edit_tags, edit_post, etc.) that currently execute immediately without
human oversight. This adds an optional approval queue that routes these
tool actions through Discourse's review queue for moderator approval
before execution.

- **New `require_approval` toggle** on AI agents — when enabled,
moderation tool calls are intercepted and sent to the review queue
instead of executing immediately
- **Review queue integration** — moderators see the agent name, tool
name, parameters, and a rendered snippet of the triggering post, then
approve or reject
- **Loop prevention** — approved tool execution is wrapped in
`DiscourseAutomation.set_active_automation` to prevent automation
re-trigger loops (e.g., `edit_tags` → `topic_tags_changed` → automation
fires again)

### New files
- `AiToolAction` model — stores tool name, parameters (JSONB), agent/bot
user refs, and triggering post ID
- `ReviewableAiToolAction` — Reviewable subclass with approve (executes
tool) and reject (discards) actions
- `ReviewableAiToolActionSerializer` — serializes target tool data and
payload context
- Review queue frontend component — displays tool action details and
post snippet
- Two migrations: `ai_tool_actions` table and `require_approval` column
on `ai_agents`

### Modified files
- `Tool` base class gains `requires_approval?` (default `false`),
overridden to `true` on all 13 moderation tools
- `Bot#invoke_tool` — intercepts tools when both tool and agent opt in
to approval
- Agent admin editor — new "Require approval" checkbox
- Agent REST model — `require_approval` added to attribute whitelists
for save payloads
- Serializer, controller, plugin.rb — wired up for the new field and
reviewable type
2026-03-13 12:46:59 -03:00

14 lines
403 B
Ruby
Vendored

# frozen_string_literal: true
class CreateAiToolActions < ActiveRecord::Migration[7.2]
def change
create_table :ai_tool_actions do |t|
t.string :tool_name, null: false
t.jsonb :tool_parameters, default: {}, null: false
t.references :ai_agent, null: false, foreign_key: true
t.integer :bot_user_id, null: false
t.integer :post_id
t.timestamps
end
end
end