mirror of
https://github.com/discourse/discourse.git
synced 2026-08-08 17:53:55 +08:00
3d737f966eAdds automatic retries to the completions endpoint base so transient failures no longer surface immediately to callers. Rate limits (429) get their own backoff budget honoring Retry-After (capped at 60s), while 408/409/5xx and network errors (timeouts, connection resets, SSL errors) share a separate transient budget. Retry waits are bounded, jittered, and interruptible via the cancel manager so both synchronous and background completions stay responsive. Each retried attempt's HTTP status is recorded in the new AiApiAuditLog#retry_attempt_statuses column (network errors use 0, which is outside the HTTP range) and exposed via the serializer along with response_status for visibility into what was retried. Bedrock Converse is intentionally left on SDK-managed retries to avoid double-retrying request streams, and now records the failing status code on the audit log. Also adds a configurable service_tier param for Gemini (standard, flex, priority) surfaced through the LLM model config. --------- Co-authored-by: discourse-patch-triage[bot] <272280883+discourse-patch-triage[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| ai_api_audit_log_serializer_spec.rb | ||
| ai_chat_channel_serializer_spec.rb | ||
| ai_features_agent_serializer_spec.rb | ||
| ai_usage_serializer_spec.rb | ||
| llm_model_serializer_spec.rb | ||
| topic_view_serializer_spec.rb | ||
