docs: chat swap — chat.inference.coop is LibreChat; Open WebUI legacy at chat-legacy; getting-started chat section rewritten for LibreChat
This commit is contained in:
1 parent
a3fabdd53c
commit
f23513a41f
2 files changed
+19
-21
No files matched your search
+12
-15
@@ -44,23 +44,15 @@ with the account you created in step 1.
|
|||||||
(GreenPT and Regolo, 100% renewable energy — Regolo adds a written
|
(GreenPT and Regolo, 100% renewable energy — Regolo adds a written
|
||||||
zero-data-retention policy). See the [model list](models.md) for the full
|
zero-data-retention policy). See the [model list](models.md) for the full
|
||||||
list.
|
list.
|
||||||
- **Web search** is enabled by default (self-hosted, no external dependency).
|
- **Web search** — click the **globe** next to the message box to ground
|
||||||
- **File uploads** work out of the box — ask the chat about a document you attach.
|
answers in current web results (self-hosted search, no external dependency).
|
||||||
- **Image generation** is built in — ask the chat for an image (for example,
|
- **File uploads** — attach a document with the **paperclip** and ask the
|
||||||
"draw a pine tree in flat green circles") and it renders one.
|
chat about it.
|
||||||
|
- **Tools** — the **Tools menu** next to the message box lists everything the
|
||||||
|
chat can do: generate images, search the co-op documentation, and more. If
|
||||||
|
there's a tool you'd like available, ask in #general.
|
||||||
- **Voice** works in both directions: speak to the chat with the microphone
|
- **Voice** works in both directions: speak to the chat with the microphone
|
||||||
icon, and have replies read aloud.
|
icon, and have replies read aloud.
|
||||||
- **External tool servers.** The chat can connect to external tool services —
|
|
||||||
things that let the AI do like search marketplaces, query other services,
|
|
||||||
or pull in specialized data. Members can add their own **OpenAPI** services:
|
|
||||||
go to Settings → Services → Integrations → External Tool Servers, click
|
|
||||||
add, and enter the service's URL (it must publish an OpenAPI spec). In a
|
|
||||||
conversation, pick the tool server from the tools menu near the message box
|
|
||||||
and ask away. Please review what a third-party tool service does with your
|
|
||||||
data before connecting it.
|
|
||||||
**MCP-protocol servers** are also supported, but those are added by admins
|
|
||||||
and appear for everyone — if there's an MCP service you'd like available,
|
|
||||||
ask in #general.
|
|
||||||
|
|
||||||
Your usage draws from your monthly allowance; you can see it on the
|
Your usage draws from your monthly allowance; you can see it on the
|
||||||
[Member Dashboard](https://dashboard.inference.coop).
|
[Member Dashboard](https://dashboard.inference.coop).
|
||||||
@@ -68,6 +60,11 @@ Your usage draws from your monthly allowance; you can see it on the
|
|||||||
If the chat ever says your balance is out, that's the allowance, not an error —
|
If the chat ever says your balance is out, that's the allowance, not an error —
|
||||||
see "Your allowance" below.
|
see "Your allowance" below.
|
||||||
|
|
||||||
|
> **Moved from the old chat?** The previous Open WebUI instance remains
|
||||||
|
> readable at [chat-legacy.inference.coop](https://chat-legacy.inference.coop)
|
||||||
|
> — your full history is here in the new chat, but files you attached in the
|
||||||
|
> old one are still accessible only there.
|
||||||
|
|
||||||
### Add the chat to your phone
|
### Add the chat to your phone
|
||||||
|
|
||||||
The chat works like an app on your phone — no app store needed. Open
|
The chat works like an app on your phone — no app store needed. Open
|
||||||
|
|||||||
+7
-6
@@ -5,20 +5,20 @@ and contributors who want to work on it.
|
|||||||
|
|
||||||
## The big picture
|
## The big picture
|
||||||
|
|
||||||
Members reach the co-op through two front doors: the **chat** (Open WebUI) and
|
Members reach the co-op through two front doors: the **chat** (LibreChat) and
|
||||||
the **API** (the LiteLLM gateway). Both route through a single gateway to
|
the **API** (the LiteLLM gateway). Both route through a single gateway to
|
||||||
multiple LLM providers — so members choose what they value for each task:
|
multiple LLM providers — so members choose what they value for each task:
|
||||||
architecturally private inference in **TEE-protected enclaves** (Tinfoil),
|
architecturally private inference in **TEE-protected enclaves** (Tinfoil),
|
||||||
100% renewable energy (GreenPT), or publicly developed sovereign models
|
100% renewable energy (GreenPT, Regolo). A thin layer of custom middleware —
|
||||||
(PublicAI). A thin layer of custom middleware — the member portal — ties Open
|
the member portal — ties Open
|
||||||
Collective membership to Cloudron accounts and LiteLLM keys.
|
Collective membership to Cloudron accounts and LiteLLM keys.
|
||||||
|
|
||||||
```
|
```
|
||||||
┌─> Tinfoil (TEE) 🔒 private
|
┌─> Tinfoil (TEE) 🔒 private
|
||||||
Members ──> Open WebUI (chat) ─┐ │
|
Members ──> LibreChat (chat) ──┐ │
|
||||||
├──> LiteLLM ──┼─> GreenPT (renewable) 🌱 green
|
├──> LiteLLM ──┼─> GreenPT (renewable) 🌱 green
|
||||||
Members ──> your own tools ────┘ gateway │
|
Members ──> your own tools ────┘ gateway │
|
||||||
(API) (keys, └─> PublicAI (open) 📖 public
|
(API) (keys, └─> Regolo (renewable) 🌱 green
|
||||||
metering,
|
metering,
|
||||||
routing)
|
routing)
|
||||||
```
|
```
|
||||||
@@ -30,7 +30,8 @@ single sign-on, and per-app isolation.
|
|||||||
|
|
||||||
| Component | Purpose | URL | Code |
|
| Component | Purpose | URL | Code |
|
||||||
|-----------|---------|-----|------|
|
|-----------|---------|-----|------|
|
||||||
| **Open WebUI** | Member-facing chat (web search, file uploads) | chat.inference.coop | — |
|
| **LibreChat** | Member-facing chat (models, web search, image generation, voice) | chat.inference.coop | [co-op/librechat-custom](https://git.inference.coop/co-op/librechat-custom) |
|
||||||
|
| **Open WebUI** | Legacy chat instance — read-only reference (old history + file attachments) | chat-legacy.inference.coop | — |
|
||||||
| **LiteLLM** | AI gateway — keys, metering, model routing | gateway.inference.coop | [code/litellm](https://git.inference.coop/code/litellm) |
|
| **LiteLLM** | AI gateway — keys, metering, model routing | gateway.inference.coop | [code/litellm](https://git.inference.coop/code/litellm) |
|
||||||
| **Member Portal** | Membership middleware — onboarding, key provisioning, Loomio sync | portal.inference.coop | [code/member-portal](https://git.inference.coop/code/member-portal) |
|
| **Member Portal** | Membership middleware — onboarding, key provisioning, Loomio sync | portal.inference.coop | [code/member-portal](https://git.inference.coop/code/member-portal) |
|
||||||
| **Member Dashboard** | Member-facing usage view + API key management | dashboard.inference.coop | [code/member-dashboard](https://git.inference.coop/code/member-dashboard) |
|
| **Member Dashboard** | Member-facing usage view + API key management | dashboard.inference.coop | [code/member-dashboard](https://git.inference.coop/code/member-dashboard) |
|
||||||
|
|||||||
Reference in new issue
Block a user