infrastructure: big-picture diagram now shows all three providers with value tiers

This commit is contained in:
inference-bot committed 2026-10-05 09:23:33 -06:00
1 parent d865501fbf
commit 121afa101a
1 file changed
+13 -8
+13 -8
View File
@@ -6,16 +6,21 @@ and contributors who want to work on it.
## The big picture ## The big picture
Members reach the co-op through two front doors: the **chat** (Open WebUI) and Members reach the co-op through two front doors: the **chat** (Open WebUI) and
the **API** (the LiteLLM gateway). Both route through a single gateway to cloud the **API** (the LiteLLM gateway). Both route through a single gateway to
LLM providers running inside **TEE-protected enclaves** (Tinfoil), so inference multiple LLM providers — so members choose what they value for each task:
is private end-to-end. A thin layer of custom middleware — the member portal — architecturally private inference in **TEE-protected enclaves** (Tinfoil),
ties Open Collective membership to Cloudron accounts and LiteLLM keys. 100% renewable energy (GreenPT), or publicly developed sovereign models
(PublicAI). A thin layer of custom middleware — the member portal — ties Open
Collective membership to Cloudron accounts and LiteLLM keys.
``` ```
Members ──> Open WebUI (chat) ─┐ ┌─> Tinfoil (TEE) 🔒 private
├──> LiteLLM gateway ──> Tinfoil (TEE) ──> models Members ──> Open WebUI (chat) ─┐ │
Members ──> your own tools ────┘ ├──> LiteLLM ──┼─> GreenPT (renewable) 🌱 green
(API) Members ──> your own tools ────┘ gateway │
(API) (keys, └─> PublicAI (open) 📖 public
metering,
routing)
``` ```
The whole stack runs on [Cloudron](https://cloudron.io), which handles hosting, The whole stack runs on [Cloudron](https://cloudron.io), which handles hosting,