infrastructure: big-picture diagram now shows all three providers with value tiers
This commit is contained in:
1 parent
d865501fbf
commit
121afa101a
1 file changed
+13
-8
+13
-8
@@ -6,16 +6,21 @@ and contributors who want to work on it.
|
|||||||
## The big picture
|
## The big picture
|
||||||
|
|
||||||
Members reach the co-op through two front doors: the **chat** (Open WebUI) and
|
Members reach the co-op through two front doors: the **chat** (Open WebUI) and
|
||||||
the **API** (the LiteLLM gateway). Both route through a single gateway to cloud
|
the **API** (the LiteLLM gateway). Both route through a single gateway to
|
||||||
LLM providers running inside **TEE-protected enclaves** (Tinfoil), so inference
|
multiple LLM providers — so members choose what they value for each task:
|
||||||
is private end-to-end. A thin layer of custom middleware — the member portal —
|
architecturally private inference in **TEE-protected enclaves** (Tinfoil),
|
||||||
ties Open Collective membership to Cloudron accounts and LiteLLM keys.
|
100% renewable energy (GreenPT), or publicly developed sovereign models
|
||||||
|
(PublicAI). A thin layer of custom middleware — the member portal — ties Open
|
||||||
|
Collective membership to Cloudron accounts and LiteLLM keys.
|
||||||
|
|
||||||
```
|
```
|
||||||
Members ──> Open WebUI (chat) ─┐
|
┌─> Tinfoil (TEE) 🔒 private
|
||||||
├──> LiteLLM gateway ──> Tinfoil (TEE) ──> models
|
Members ──> Open WebUI (chat) ─┐ │
|
||||||
Members ──> your own tools ────┘
|
├──> LiteLLM ──┼─> GreenPT (renewable) 🌱 green
|
||||||
(API)
|
Members ──> your own tools ────┘ gateway │
|
||||||
|
(API) (keys, └─> PublicAI (open) 📖 public
|
||||||
|
metering,
|
||||||
|
routing)
|
||||||
```
|
```
|
||||||
|
|
||||||
The whole stack runs on [Cloudron](https://cloudron.io), which handles hosting,
|
The whole stack runs on [Cloudron](https://cloudron.io), which handles hosting,
|
||||||
|
|||||||
Reference in new issue
Block a user