docs: chat task models — OWUI task model pinned to greenpt/glm-5.3-flash, suggestions state
This commit is contained in:
1 parent
1f3f0ce9b8
commit
12da5c1268
1 file changed
+27
@@ -0,0 +1,27 @@
|
|||||||
|
# Chat task models (titles, tags, suggestions)
|
||||||
|
|
||||||
|
Both chat front doors generate small helper outputs — conversation titles,
|
||||||
|
tags, retrieval queries — with a model separate from the one answering the
|
||||||
|
member. These tasks are pinned to a small, inexpensive model so they never
|
||||||
|
bill against the member's chosen (larger) model.
|
||||||
|
|
||||||
|
## Open WebUI (chat.inference.coop)
|
||||||
|
|
||||||
|
- Title generation and tag generation are **enabled**; follow-up reply
|
||||||
|
suggestions and input autocomplete are **disabled** (October 2026).
|
||||||
|
- The task model (`task.model.default` in the Postgres `config` table) is
|
||||||
|
pinned to `greenpt/glm-5.3-flash` — a small, inexpensive model — so titles
|
||||||
|
and tags always run on it regardless of which model the member is chatting
|
||||||
|
with. Before October 2026 it was empty, which meant helper tasks ran on the
|
||||||
|
member's selected model.
|
||||||
|
- Config lives in the app's Postgres database (`config` table, key/value rows
|
||||||
|
with JSON values) and is read at startup: change a row, then restart the
|
||||||
|
app (`cloudron restart --app <id>`; note `restart` takes no `--timeout`).
|
||||||
|
|
||||||
|
## LibreChat (librechat-test.inference.coop)
|
||||||
|
|
||||||
|
- Title generation is configured in `/app/data/librechat.yaml`:
|
||||||
|
`titleConvo: true`, `titleModel: greenpt/glm-5.3-flash`,
|
||||||
|
`titleMethod: completion` — the same small GreenPT model.
|
||||||
|
- LibreChat v0.8.8 has no reply-suggestion feature; there is nothing to
|
||||||
|
disable on that front.
|
||||||
Reference in new issue
Block a user