mirror of
https://gh.wpcy.net/https://github.com/discourse/discourse.git
synced 2026-06-19 05:35:40 +08:00
fe5e4a27e9
## Summary AI agents have 13 moderation tools (close_topic, delete_topic, edit_tags, edit_post, etc.) that currently execute immediately without human oversight. This adds an optional approval queue that routes these tool actions through Discourse's review queue for moderator approval before execution. - **New `require_approval` toggle** on AI agents — when enabled, moderation tool calls are intercepted and sent to the review queue instead of executing immediately - **Review queue integration** — moderators see the agent name, tool name, parameters, and a rendered snippet of the triggering post, then approve or reject - **Loop prevention** — approved tool execution is wrapped in `DiscourseAutomation.set_active_automation` to prevent automation re-trigger loops (e.g., `edit_tags` → `topic_tags_changed` → automation fires again) ### New files - `AiToolAction` model — stores tool name, parameters (JSONB), agent/bot user refs, and triggering post ID - `ReviewableAiToolAction` — Reviewable subclass with approve (executes tool) and reject (discards) actions - `ReviewableAiToolActionSerializer` — serializes target tool data and payload context - Review queue frontend component — displays tool action details and post snippet - Two migrations: `ai_tool_actions` table and `require_approval` column on `ai_agents` ### Modified files - `Tool` base class gains `requires_approval?` (default `false`), overridden to `true` on all 13 moderation tools - `Bot#invoke_tool` — intercepts tools when both tool and agent opt in to approval - Agent admin editor — new "Require approval" checkbox - Agent REST model — `require_approval` added to attribute whitelists for save payloads - Serializer, controller, plugin.rb — wired up for the new field and reviewable type
80 lines
2.3 KiB
Ruby
Vendored
80 lines
2.3 KiB
Ruby
Vendored
# frozen_string_literal: true
|
|
|
|
module DiscourseAi
|
|
module Agents
|
|
module Tools
|
|
class GrantBadge < Tool
|
|
def self.signature
|
|
{
|
|
name: name,
|
|
description: "Grants a badge to a user.",
|
|
parameters: [
|
|
{
|
|
name: "username",
|
|
description: "The username of the user to grant the badge to",
|
|
type: "string",
|
|
required: true,
|
|
},
|
|
{
|
|
name: "badge_name",
|
|
description: "The name of the badge to grant",
|
|
type: "string",
|
|
required: true,
|
|
},
|
|
{
|
|
name: "reason",
|
|
description: "Short explanation of why the badge is being granted",
|
|
type: "string",
|
|
required: true,
|
|
},
|
|
],
|
|
}
|
|
end
|
|
|
|
def self.name
|
|
"grant_badge"
|
|
end
|
|
|
|
def self.requires_approval?
|
|
true
|
|
end
|
|
|
|
def invoke
|
|
if !guardian.can_grant_badges?(nil)
|
|
return error_response(I18n.t("discourse_ai.ai_bot.grant_badge.errors.not_allowed"))
|
|
end
|
|
|
|
user = User.find_by(username: parameters[:username])
|
|
if !user
|
|
return error_response(I18n.t("discourse_ai.ai_bot.grant_badge.errors.user_not_found"))
|
|
end
|
|
|
|
badge = Badge.find_by(name: parameters[:badge_name])
|
|
if !badge
|
|
return(error_response(I18n.t("discourse_ai.ai_bot.grant_badge.errors.badge_not_found")))
|
|
end
|
|
|
|
if reason.blank?
|
|
return error_response(I18n.t("discourse_ai.ai_bot.grant_badge.errors.no_reason"))
|
|
end
|
|
|
|
if !badge.enabled?
|
|
return(error_response(I18n.t("discourse_ai.ai_bot.grant_badge.errors.badge_disabled")))
|
|
end
|
|
|
|
user_badge = BadgeGranter.grant(badge, user, granted_by: acting_user)
|
|
|
|
if user_badge
|
|
{ status: "success", message: I18n.t("discourse_ai.ai_bot.grant_badge.success") }
|
|
else
|
|
error_response(I18n.t("discourse_ai.ai_bot.grant_badge.errors.grant_failed"))
|
|
end
|
|
end
|
|
|
|
def description_args
|
|
{ username: parameters[:username], badge_name: parameters[:badge_name] }
|
|
end
|
|
end
|
|
end
|
|
end
|
|
end
|
