discourse-mirrors/discourse-ai
0
0
Fork 0
mirror of https://ghfast.top/https://github.com/discourse/discourse-ai.git synced 2026-07-18 11:49:33 +08:00
Code Issues Projects Releases Packages Wiki Activity Actions
discourse-ai/spec/requests/ai_helper
History
Exact
Sam 823e8ef490
FEATURE: partial tool call support for OpenAI and Anthropic (#908) 
Implement streaming tool call implementation for Anthropic and Open AI.

When calling:

llm.generate(..., partial_tool_calls: true) do ...
Partials may contain ToolCall instances with partial: true, These tool calls are partially populated with json partially parsed.

So for example when performing a search you may get:

ToolCall(..., {search: "hello" })
ToolCall(..., {search: "hello world" })

The library used to parse json is:

https://github.com/dgraham/json-stream

We use a fork cause we need access to the internal buffer.

This prepares internals to perform partial tool calls, but does not implement it yet.
2024-11-14 06:58:24 +11:00
..
assistant_controller_spec.rb FEATURE: partial tool call support for OpenAI and Anthropic (#908) 2024-11-14 06:58:24 +11:00