adjustments to the readme
This commit is contained in:
1 parent
f7eb0bf407
commit
b7b017fa92
1 file changed
+9
-22
@@ -5,37 +5,25 @@
|
||||
The Inference Cooperative is a member-governed project providing private AI inference. We are fiscally sponsored by [Metagov](https://metagov.org), a nonprofit, and funded through our [Open Collective](https://opencollective.com/inference-cooperative).
|
||||
|
||||
- **Website:** https://inference.coop
|
||||
- **Chat:** https://chat.inference.coop
|
||||
- **AI Chat:** https://chat.inference.coop
|
||||
- **Open Collective:** https://opencollective.com/inference-cooperative
|
||||
- **Contact:** info@inference.coop
|
||||
|
||||
---
|
||||
|
||||
## The model
|
||||
|
||||
The Inference Cooperative is a **member-governed** AI inference utility. Members contribute on a sliding scale (currently $10–20/month) and, in return, get access to private AI inference through a shared, cooperatively governed infrastructure.
|
||||
|
||||
Because we are legally under a nonprofit (Metagov is our fiscal sponsor), we are **member-governed** rather than member-owned: members direct the project through governance, while the nonprofit holds the legal and financial structure.
|
||||
Because we are legally under a nonprofit—[Metagov](https://metagov.org/) is our fiscal sponsor—we are member-governed rather than member-owned: members direct the project through governance, while the nonprofit holds the legal and financial structure.
|
||||
|
||||
### Membership
|
||||
|
||||
- **Sliding scale:** $10–20/month
|
||||
- **Governance:** members participate in decisions about models, privacy, and direction
|
||||
- **Sliding scale dues:** $10–20/month
|
||||
- **Access:** private AI inference through the cooperative's gateway
|
||||
|
||||
---
|
||||
- **Governance:** members participate in decisions about models, priorities, and direction
|
||||
|
||||
## The stack
|
||||
|
||||
The Inference Cooperative runs a self-hosted stack on [Cloudron](https://cloudron.io), with all inference routed through a single gateway.
|
||||
|
||||
```
|
||||
Members → LibreChat (chat.inference.coop)
|
||||
↓
|
||||
LiteLLM gateway (gateway.inference.coop)
|
||||
↓
|
||||
Inference backend (Ollama Cloud today; TEE-protected Tinfoil planned)
|
||||
```
|
||||
The Inference Cooperative runs a self-hosted stack on [Cloudron](https://cloudron.io), with all inference routed through a single gateway to cloud-based LLM providers.
|
||||
|
||||
### Components
|
||||
|
||||
@@ -44,7 +32,7 @@ Members → LibreChat (chat.inference.coop)
|
||||
| **LibreChat** | Member-facing chat interface | chat.inference.coop |
|
||||
| **LiteLLM** | AI gateway — keys, metering, model routing | gateway.inference.coop |
|
||||
| **Gitea** | Git hosting (code + docs) | git.inference.coop |
|
||||
| **Loomio** | Member governance / decision-making | (forum) |
|
||||
| **Loomio** | Member governance | forum.inference.coop |
|
||||
| **Open Collective** | Membership billing + fiscal sponsorship | opencollective.com/inference-cooperative |
|
||||
|
||||
### Models
|
||||
@@ -56,15 +44,14 @@ The gateway currently exposes two models:
|
||||
|
||||
### Privacy
|
||||
|
||||
Privacy is a core value. The current backend (Ollama Cloud) is a policy-based privacy model. The roadmap is to move to **TEE-protected inference** (via Tinfoil), which provides architectural — not just policy — privacy guarantees.
|
||||
Privacy is a core value. The current LLM backend (Ollama Cloud) is a policy-based privacy model. The roadmap is to move to [TEE-protected inference (via Tinfoil)](https://tinfoil.sh/inference), which provides architectural—not just policy—privacy guarantees.
|
||||
|
||||
---
|
||||
|
||||
## Governance
|
||||
|
||||
The Inference Cooperative is fiscally sponsored by [Metagov](https://metagov.org). Members govern the project through [Loomio](https://www.loomio.com) and the Open Collective.
|
||||
Members govern the project through [Loomio](https://www.loomio.com) and the Open Collective. See the [Charter](charter.md) for the cooperative's values, membership terms, and governance structure.
|
||||
|
||||
See the [Charter](charter.md) for the cooperative's values, membership terms, and governance structure.
|
||||
During the pilot phase, Nathan Schneider serves as Managing Director and has sole final discretion on decisions.
|
||||
|
||||
---
|
||||
|
||||
|
||||
Reference in new issue
Block a user