Files
docs/maintenance/chat-task-models.md
T

1.4 KiB

Chat task models (titles, tags, suggestions)

Both chat front doors generate small helper outputs — conversation titles, tags, retrieval queries — with a model separate from the one answering the member. These tasks are pinned to a small, inexpensive model so they never bill against the member's chosen (larger) model.

Open WebUI (chat.inference.coop)

  • Title generation and tag generation are enabled; follow-up reply suggestions and input autocomplete are disabled (October 2026).
  • The task model (task.model.default in the Postgres config table) is pinned to greenpt/glm-5.3-flash — a small, inexpensive model — so titles and tags always run on it regardless of which model the member is chatting with. Before October 2026 it was empty, which meant helper tasks ran on the member's selected model.
  • Config lives in the app's Postgres database (config table, key/value rows with JSON values) and is read at startup: change a row, then restart the app (cloudron restart --app <id>; note restart takes no --timeout).

LibreChat (librechat-test.inference.coop)

  • Title generation is configured in /app/data/librechat.yaml: titleConvo: true, titleModel: greenpt/glm-5.3-flash, titleMethod: completion — the same small GreenPT model.
  • LibreChat v0.8.8 has no reply-suggestion feature; there is nothing to disable on that front.