28 lines
1.4 KiB
Markdown
28 lines
1.4 KiB
Markdown
# Chat task models (titles, tags, suggestions)
|
|
|
|
Both chat front doors generate small helper outputs — conversation titles,
|
|
tags, retrieval queries — with a model separate from the one answering the
|
|
member. These tasks are pinned to a small, inexpensive model so they never
|
|
bill against the member's chosen (larger) model.
|
|
|
|
## Open WebUI (chat.inference.coop)
|
|
|
|
- Title generation and tag generation are **enabled**; follow-up reply
|
|
suggestions and input autocomplete are **disabled** (October 2026).
|
|
- The task model (`task.model.default` in the Postgres `config` table) is
|
|
pinned to `greenpt/glm-5.3-flash` — a small, inexpensive model — so titles
|
|
and tags always run on it regardless of which model the member is chatting
|
|
with. Before October 2026 it was empty, which meant helper tasks ran on the
|
|
member's selected model.
|
|
- Config lives in the app's Postgres database (`config` table, key/value rows
|
|
with JSON values) and is read at startup: change a row, then restart the
|
|
app (`cloudron restart --app <id>`; note `restart` takes no `--timeout`).
|
|
|
|
## LibreChat (librechat-test.inference.coop)
|
|
|
|
- Title generation is configured in `/app/data/librechat.yaml`:
|
|
`titleConvo: true`, `titleModel: greenpt/glm-5.3-flash`,
|
|
`titleMethod: completion` — the same small GreenPT model.
|
|
- LibreChat v0.8.8 has no reply-suggestion feature; there is nothing to
|
|
disable on that front.
|