From f23513a41f51b59266b397e2e6ac8385758faa2c Mon Sep 17 00:00:00 2001 From: Nathan Schneider Date: Tue, 20 Oct 2026 21:47:30 -0600 Subject: [PATCH] =?UTF-8?q?docs:=20chat=20swap=20=E2=80=94=20chat.inferenc?= =?UTF-8?q?e.coop=20is=20LibreChat;=20Open=20WebUI=20legacy=20at=20chat-le?= =?UTF-8?q?gacy;=20getting-started=20chat=20section=20rewritten=20for=20Li?= =?UTF-8?q?breChat?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- getting-started.md | 27 ++++++++++++--------------- infrastructure.md | 13 +++++++------ 2 files changed, 19 insertions(+), 21 deletions(-) diff --git a/getting-started.md b/getting-started.md index 62c03a0..57ca586 100644 --- a/getting-started.md +++ b/getting-started.md @@ -44,23 +44,15 @@ with the account you created in step 1. (GreenPT and Regolo, 100% renewable energy — Regolo adds a written zero-data-retention policy). See the [model list](models.md) for the full list. -- **Web search** is enabled by default (self-hosted, no external dependency). -- **File uploads** work out of the box — ask the chat about a document you attach. -- **Image generation** is built in — ask the chat for an image (for example, - "draw a pine tree in flat green circles") and it renders one. +- **Web search** — click the **globe** next to the message box to ground + answers in current web results (self-hosted search, no external dependency). +- **File uploads** — attach a document with the **paperclip** and ask the + chat about it. +- **Tools** — the **Tools menu** next to the message box lists everything the + chat can do: generate images, search the co-op documentation, and more. If + there's a tool you'd like available, ask in #general. - **Voice** works in both directions: speak to the chat with the microphone icon, and have replies read aloud. -- **External tool servers.** The chat can connect to external tool services — - things that let the AI do like search marketplaces, query other services, - or pull in specialized data. Members can add their own **OpenAPI** services: - go to Settings → Services → Integrations → External Tool Servers, click - add, and enter the service's URL (it must publish an OpenAPI spec). In a - conversation, pick the tool server from the tools menu near the message box - and ask away. Please review what a third-party tool service does with your - data before connecting it. - **MCP-protocol servers** are also supported, but those are added by admins - and appear for everyone — if there's an MCP service you'd like available, - ask in #general. Your usage draws from your monthly allowance; you can see it on the [Member Dashboard](https://dashboard.inference.coop). @@ -68,6 +60,11 @@ Your usage draws from your monthly allowance; you can see it on the If the chat ever says your balance is out, that's the allowance, not an error — see "Your allowance" below. +> **Moved from the old chat?** The previous Open WebUI instance remains +> readable at [chat-legacy.inference.coop](https://chat-legacy.inference.coop) +> — your full history is here in the new chat, but files you attached in the +> old one are still accessible only there. + ### Add the chat to your phone The chat works like an app on your phone — no app store needed. Open diff --git a/infrastructure.md b/infrastructure.md index b731433..a600286 100644 --- a/infrastructure.md +++ b/infrastructure.md @@ -5,20 +5,20 @@ and contributors who want to work on it. ## The big picture -Members reach the co-op through two front doors: the **chat** (Open WebUI) and +Members reach the co-op through two front doors: the **chat** (LibreChat) and the **API** (the LiteLLM gateway). Both route through a single gateway to multiple LLM providers — so members choose what they value for each task: architecturally private inference in **TEE-protected enclaves** (Tinfoil), -100% renewable energy (GreenPT), or publicly developed sovereign models -(PublicAI). A thin layer of custom middleware — the member portal — ties Open +100% renewable energy (GreenPT, Regolo). A thin layer of custom middleware — +the member portal — ties Open Collective membership to Cloudron accounts and LiteLLM keys. ``` ┌─> Tinfoil (TEE) 🔒 private -Members ──> Open WebUI (chat) ─┐ │ +Members ──> LibreChat (chat) ──┐ │ ├──> LiteLLM ──┼─> GreenPT (renewable) 🌱 green Members ──> your own tools ────┘ gateway │ - (API) (keys, └─> PublicAI (open) 📖 public + (API) (keys, └─> Regolo (renewable) 🌱 green metering, routing) ``` @@ -30,7 +30,8 @@ single sign-on, and per-app isolation. | Component | Purpose | URL | Code | |-----------|---------|-----|------| -| **Open WebUI** | Member-facing chat (web search, file uploads) | chat.inference.coop | — | +| **LibreChat** | Member-facing chat (models, web search, image generation, voice) | chat.inference.coop | [co-op/librechat-custom](https://git.inference.coop/co-op/librechat-custom) | +| **Open WebUI** | Legacy chat instance — read-only reference (old history + file attachments) | chat-legacy.inference.coop | — | | **LiteLLM** | AI gateway — keys, metering, model routing | gateway.inference.coop | [code/litellm](https://git.inference.coop/code/litellm) | | **Member Portal** | Membership middleware — onboarding, key provisioning, Loomio sync | portal.inference.coop | [code/member-portal](https://git.inference.coop/code/member-portal) | | **Member Dashboard** | Member-facing usage view + API key management | dashboard.inference.coop | [code/member-dashboard](https://git.inference.coop/code/member-dashboard) |