Inference Cooperative
Private AI, governed together.
The Inference Cooperative is a member-governed project providing private AI inference. We are fiscally sponsored by Metagov, a nonprofit, and funded through our Open Collective.
- Website: https://inference.coop
- Chat: https://chat.inference.coop
- Open Collective: https://opencollective.com/inference-cooperative
- Contact: info@inference.coop
The model
The Inference Cooperative is a member-governed AI inference utility. Members contribute on a sliding scale (currently $10–20/month) and, in return, get access to private AI inference through a shared, cooperatively governed infrastructure.
Because we are legally under a nonprofit (Metagov is our fiscal sponsor), we are member-governed rather than member-owned: members direct the project through governance, while the nonprofit holds the legal and financial structure.
Membership
- Sliding scale: $10–20/month
- Governance: members participate in decisions about models, privacy, and direction
- Access: private AI inference through the cooperative's gateway
The stack
The Inference Cooperative runs a self-hosted stack on Cloudron, with all inference routed through a single gateway.
Members → LibreChat (chat.inference.coop)
↓
LiteLLM gateway (gateway.inference.coop)
↓
Inference backend (Ollama Cloud today; TEE-protected Tinfoil planned)
Components
| Component | Purpose | URL |
|---|---|---|
| LibreChat | Member-facing chat interface | chat.inference.coop |
| LiteLLM | AI gateway — keys, metering, model routing | gateway.inference.coop |
| Gitea | Git hosting (code + docs) | git.inference.coop |
| Loomio | Member governance / decision-making | (forum) |
| Open Collective | Membership billing + fiscal sponsorship | opencollective.com/inference-cooperative |
Models
The gateway currently exposes two models:
- DeepSeek V4 Flash — default model, best for agentic tasks
- GPT-OSS 120B — lightweight fallback
Privacy
Privacy is a core value. The current backend (Ollama Cloud) is a policy-based privacy model. The roadmap is to move to TEE-protected inference (via Tinfoil), which provides architectural — not just policy — privacy guarantees.
Governance
The Inference Cooperative is fiscally sponsored by Metagov. Members govern the project through Loomio and the Open Collective.
See the Charter for the cooperative's values, membership terms, and governance structure.
This documentation lives in a public git repository. Contributions welcome.