diff --git a/maintenance/chat-task-models.md b/maintenance/chat-task-models.md new file mode 100644 index 0000000..f5a2447 --- /dev/null +++ b/maintenance/chat-task-models.md @@ -0,0 +1,27 @@ +# Chat task models (titles, tags, suggestions) + +Both chat front doors generate small helper outputs — conversation titles, +tags, retrieval queries — with a model separate from the one answering the +member. These tasks are pinned to a small, inexpensive model so they never +bill against the member's chosen (larger) model. + +## Open WebUI (chat.inference.coop) + +- Title generation and tag generation are **enabled**; follow-up reply + suggestions and input autocomplete are **disabled** (October 2026). +- The task model (`task.model.default` in the Postgres `config` table) is + pinned to `greenpt/glm-5.3-flash` — a small, inexpensive model — so titles + and tags always run on it regardless of which model the member is chatting + with. Before October 2026 it was empty, which meant helper tasks ran on the + member's selected model. +- Config lives in the app's Postgres database (`config` table, key/value rows + with JSON values) and is read at startup: change a row, then restart the + app (`cloudron restart --app `; note `restart` takes no `--timeout`). + +## LibreChat (librechat-test.inference.coop) + +- Title generation is configured in `/app/data/librechat.yaml`: + `titleConvo: true`, `titleModel: greenpt/glm-5.3-flash`, + `titleMethod: completion` — the same small GreenPT model. +- LibreChat v0.8.8 has no reply-suggestion feature; there is nothing to + disable on that front.