[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[nongnu] elpa/gptel 63a6f89182 22/24: gptel: Handle Ollama + streaming +
From: |
ELPA Syncer |
Subject: |
[nongnu] elpa/gptel 63a6f89182 22/24: gptel: Handle Ollama + streaming + tool-use incompatibility |
Date: |
Mon, 20 Jan 2025 16:01:25 -0500 (EST) |
branch: elpa/gptel
commit 63a6f8918229ba382533e3980bc8ee129d933667
Author: Karthik Chikmagalur <karthikchikmagalur@gmail.com>
Commit: Karthik Chikmagalur <karthikchikmagalur@gmail.com>
gptel: Handle Ollama + streaming + tool-use incompatibility
* gptel.el (gptel-request): Turn off streaming if using Ollama +
tools. This is the wrong place for this check, but it's not clear
how to place this check in gptel-ollama.el so it will be invoked
in the construction of a request payload.
---
gptel.el | 5 +++++
1 file changed, 5 insertions(+)
diff --git a/gptel.el b/gptel.el
index e4b4a44b41..fac1f6db02 100644
--- a/gptel.el
+++ b/gptel.el
@@ -2096,7 +2096,12 @@ be used to rerun or continue the request at a later
time."
(eq gptel-use-context 'system))
(gptel-context--wrap (car directive))
(car directive))))
+ ;; TODO(tool) Limit tool use to capable models after documenting
:capabilities
+ ;; (gptel-use-tools (and (gptel--model-capable-p 'tool-use)
gptel-use-tools))
(stream (and stream gptel-use-curl
+ ;; HACK(tool): no stream if Ollama + tools. Need to
find a better way
+ (not (and (eq (type-of gptel-backend) 'gptel-ollama)
+ gptel-tools gptel-use-tools))
;; Check model-specific request-params for streaming
preference
(let* ((model-params (gptel--model-request-params
gptel-model))
(stream-spec (plist-get model-params :stream)))
- [nongnu] elpa/gptel f02a1c3acf 02/24: gptel: default state transition handlers, predicates, (continued)
- [nongnu] elpa/gptel f02a1c3acf 02/24: gptel: default state transition handlers, predicates, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel e98b9a0d1e 19/24: gptel: Run callback with pending tool calls, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 3bdd702f0a 03/24: gptel: Use FSM to drive gptel requests, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 5a7a391678 12/24: gptel: Separate gptel-request and gptel-send handlers, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 4ad0048f1f 14/24: gptel: Add a registry for tools, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 73b13b4d73 10/24: gptel: Activate tool use, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 45de52e845 18/24: gptel: Add controls to confirm/include tool calls, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel eb96d04544 07/24: gptel: Add tool call parsing (only) to most backends, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel e18e4bf897 11/24: gptel: Add a diagnostic display for latest request, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel da66b37c75 24/24: testing: Update test submodule, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 63a6f89182 22/24: gptel: Handle Ollama + streaming + tool-use incompatibility,
ELPA Syncer <=
- [nongnu] elpa/gptel 6f612f9102 23/24: gptel: Set tool-use capability flag for models, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 6324426b6e 08/24: gptel: Add tool definition and result parsers, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 12d0a01891 04/24: gptel: Update inspect-query functions for FSM, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel b3010047fc 20/24: gptel: Handle pending calls/call results in chat buffers, ELPA Syncer, 2025/01/20
- [nongnu] elpa/gptel 67a9b697c7 21/24: README: Add tool-use description, ELPA Syncer, 2025/01/20