1.4 KiB
1.4 KiB
Chat task models (titles, tags, suggestions)
Both chat front doors generate small helper outputs — conversation titles, tags, retrieval queries — with a model separate from the one answering the member. These tasks are pinned to a small, inexpensive model so they never bill against the member's chosen (larger) model.
Open WebUI (chat.inference.coop)
- Title generation and tag generation are enabled; follow-up reply suggestions and input autocomplete are disabled (October 2026).
- The task model (
task.model.defaultin the Postgresconfigtable) is pinned togreenpt/glm-5.3-flash— a small, inexpensive model — so titles and tags always run on it regardless of which model the member is chatting with. Before October 2026 it was empty, which meant helper tasks ran on the member's selected model. - Config lives in the app's Postgres database (
configtable, key/value rows with JSON values) and is read at startup: change a row, then restart the app (cloudron restart --app <id>; noterestarttakes no--timeout).
LibreChat (librechat-test.inference.coop)
- Title generation is configured in
/app/data/librechat.yaml:titleConvo: true,titleModel: greenpt/glm-5.3-flash,titleMethod: completion— the same small GreenPT model. - LibreChat v0.8.8 has no reply-suggestion feature; there is nothing to disable on that front.