Compare commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
3c346e420f | ||
|
|
7313f821e3 | ||
|
|
d8bd033f05 | ||
|
|
c022a0b52e | ||
|
|
85f5723357 | ||
|
|
a647284170 | ||
|
|
888ac8c299 | ||
|
|
dcdde204b0 | ||
|
|
0a79c80483 | ||
|
|
d2e90c6dc3 | ||
|
|
7e2fa8c0a3 | ||
|
|
85a6045389 |
No files matched your search
@@ -20,6 +20,7 @@ funded through our [Open Collective](https://opencollective.com/inference-cooper
|
|||||||
|
|
||||||
- **Website:** https://inference.coop
|
- **Website:** https://inference.coop
|
||||||
- **AI Chat:** https://chat.inference.coop
|
- **AI Chat:** https://chat.inference.coop
|
||||||
|
- **Matrix chat:** https://matrix.inference.coop
|
||||||
- **Member Dashboard:** https://dashboard.inference.coop
|
- **Member Dashboard:** https://dashboard.inference.coop
|
||||||
- **Governance forum:** https://forum.inference.coop
|
- **Governance forum:** https://forum.inference.coop
|
||||||
- **Source code:** https://git.inference.coop
|
- **Source code:** https://git.inference.coop
|
||||||
|
|||||||
+2
-3
@@ -57,7 +57,7 @@ endpoint configuration:
|
|||||||
- **API type / protocol:** "OpenAI compatible" (or `openai-completions` where a
|
- **API type / protocol:** "OpenAI compatible" (or `openai-completions` where a
|
||||||
protocol string must be named) — not "Ollama", "Anthropic", or "Responses"
|
protocol string must be named) — not "Ollama", "Anthropic", or "Responses"
|
||||||
- **API key:** your member key (the `sk-…` string)
|
- **API key:** your member key (the `sk-…` string)
|
||||||
- **Model:** one from the [model list](models.md), e.g. `tinfoil/deepseek-v4-1-flash` or `greenpt/green-r`
|
- **Model:** one from the [model list](models.md), e.g. `tinfoil/deepseek-v4-1-flash` or `greenpt/glm-5.3-flash`
|
||||||
|
|
||||||
A typical provider entry looks like:
|
A typical provider entry looks like:
|
||||||
|
|
||||||
@@ -72,8 +72,7 @@ A typical provider entry looks like:
|
|||||||
{ "id": "tinfoil/deepseek-v4-1-flash" },
|
{ "id": "tinfoil/deepseek-v4-1-flash" },
|
||||||
{ "id": "tinfoil/gpt-oss-120b" },
|
{ "id": "tinfoil/gpt-oss-120b" },
|
||||||
{ "id": "tinfoil/glm-5-3-flash" },
|
{ "id": "tinfoil/glm-5-3-flash" },
|
||||||
{ "id": "greenpt/green-r" },
|
{ "id": "greenpt/glm-5.3-flash" }
|
||||||
{ "id": "greenpt/green-l" }
|
|
||||||
]
|
]
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -55,6 +55,30 @@ You don't just use the co-op; you help run it. Decisions about models, pricing,
|
|||||||
privacy, and direction happen on our **Loomio forum**:
|
privacy, and direction happen on our **Loomio forum**:
|
||||||
|
|
||||||
- **[forum.inference.coop](https://forum.inference.coop)** — where members discuss and decide.
|
- **[forum.inference.coop](https://forum.inference.coop)** — where members discuss and decide.
|
||||||
|
- **[matrix.inference.coop](https://matrix.inference.coop)** — our Matrix chat server. Log in
|
||||||
|
with your co-op account (Cloudron SSO); your Matrix ID is `@username:inference.coop`.
|
||||||
|
Every member is invited to the **Inference Cooperative** space automatically — check your
|
||||||
|
invites on first login.
|
||||||
|
|
||||||
|
**Using it from any Matrix client** — the server speaks the standard Matrix protocol,
|
||||||
|
so you can connect from any client:
|
||||||
|
|
||||||
|
- **Element** (web, desktop, iOS, Android): on the sign-in screen, click *Edit* next to
|
||||||
|
"Homeserver" and enter `https://matrix.inference.coop`, then sign in with your co-op
|
||||||
|
account. (On [app.element.io](https://app.element.io) or the desktop/mobile apps alike.)
|
||||||
|
- **FluffyChat, Cinny, SchildiChat** or any other client: look for the "custom homeserver"
|
||||||
|
/ "other server" option in the client's login screen and enter the same address.
|
||||||
|
- Your co-op account and your existing Matrix account on another server (e.g.
|
||||||
|
matrix.org or a personal homeserver) are separate identities. If you'd
|
||||||
|
rather use an existing account for co-op rooms, set it on your
|
||||||
|
[dashboard](https://dashboard.inference.coop) under **Matrix chat** (one
|
||||||
|
extra account) — invitations will go there instead. Both work either way.
|
||||||
|
|
||||||
|
**Members-only, readable history.** The space is invite-only and unencrypted
|
||||||
|
so every member can read the full history (including messages from before
|
||||||
|
they joined). Invites are restricted to admins — so while any member is
|
||||||
|
welcome to bring a collaborator or guest, an admin sends the invite rather
|
||||||
|
than members handing the space to outsiders directly.
|
||||||
- See the [Charter](charter.md) for how governance is structured.
|
- See the [Charter](charter.md) for how governance is structured.
|
||||||
- See [Open questions](open-questions.md) for the decisions currently on the table.
|
- See [Open questions](open-questions.md) for the decisions currently on the table.
|
||||||
|
|
||||||
|
|||||||
@@ -32,6 +32,7 @@ single sign-on, and per-app isolation.
|
|||||||
| **Admin Panel** | Admin-only member overview, spend, balance management | panel.inference.coop | [code/admin-panel](https://git.inference.coop/code/admin-panel) |
|
| **Admin Panel** | Admin-only member overview, spend, balance management | panel.inference.coop | [code/admin-panel](https://git.inference.coop/code/admin-panel) |
|
||||||
| **SearXNG** | Self-hosted web search (feeds the chat's search) | search.inference.coop | — |
|
| **SearXNG** | Self-hosted web search (feeds the chat's search) | search.inference.coop | — |
|
||||||
| **Loomio** | Member governance | forum.inference.coop | — |
|
| **Loomio** | Member governance | forum.inference.coop | — |
|
||||||
|
| **Matrix (Synapse)** | Member chat server (federated; SSO login via Cloudron) | matrix.inference.coop | — |
|
||||||
| **Gitea** | Git hosting (code + docs) | git.inference.coop | — |
|
| **Gitea** | Git hosting (code + docs) | git.inference.coop | — |
|
||||||
| **Surfer** | Static hosting (landing page, thanks page) | inference.coop | [co-op/website](https://git.inference.coop/co-op/website) |
|
| **Surfer** | Static hosting (landing page, thanks page) | inference.coop | [co-op/website](https://git.inference.coop/co-op/website) |
|
||||||
| **Listmonk** | Member newsletter (auto-synced from membership) | newsletter.inference.coop | — |
|
| **Listmonk** | Member newsletter (auto-synced from membership) | newsletter.inference.coop | — |
|
||||||
@@ -41,6 +42,21 @@ single sign-on, and per-app isolation.
|
|||||||
Open Collective (billing and fiscal sponsorship) is the one external service in
|
Open Collective (billing and fiscal sponsorship) is the one external service in
|
||||||
the flow — see [opencollective.com/inference-cooperative](https://opencollective.com/inference-cooperative).
|
the flow — see [opencollective.com/inference-cooperative](https://opencollective.com/inference-cooperative).
|
||||||
|
|
||||||
|
## Matrix
|
||||||
|
|
||||||
|
Members get a federated Matrix account on our self-hosted Synapse
|
||||||
|
(matrix.inference.coop, user IDs `@username:inference.coop`) using their
|
||||||
|
Cloudron SSO login. The portal invites every active member — and Nathan's
|
||||||
|
federated account — to the private **Inference Cooperative** Space (with a
|
||||||
|
**General** room) on every membership sync, so new members land in the space
|
||||||
|
automatically. Invites honor rate limits; external/federated members can be
|
||||||
|
added via the portal's `MATRIX_EXTRA_MXIDS` env.
|
||||||
|
|
||||||
|
Federation is enabled (delegated via `.well-known/matrix/server` on the bare
|
||||||
|
domain, port 443), so members can also join from any homeserver they already
|
||||||
|
use. The `@inference-bot:inference.coop` admin account (used by the portal
|
||||||
|
for invites) has no password — token lives in the portal env.
|
||||||
|
|
||||||
## How membership is wired
|
## How membership is wired
|
||||||
|
|
||||||
Membership flows through the member portal, which is the single source of truth
|
Membership flows through the member portal, which is the single source of truth
|
||||||
|
|||||||
@@ -37,12 +37,15 @@ that **you choose** which axis matters more for a given task.
|
|||||||
|
|
||||||
**How to pick, quick guide:**
|
**How to pick, quick guide:**
|
||||||
|
|
||||||
- **Everyday chat and drafting** → a fast model: `tinfoil/glm-5-3-flash`,
|
- **Default** → `greenpt/deepseek-v4.1-flash`: DeepSeek's efficient multimodal
|
||||||
`greenpt/glm-5.3-flash`, or `greenpt/green-l`. These handle the bulk of what
|
reasoning model on renewable energy, and the model the chat starts on. For the
|
||||||
people use chat for, at a fraction of flagship cost.
|
TEE-protected (private) version of the same model, use `tinfoil/deepseek-v4-1-flash`.
|
||||||
- **Hard reasoning, coding, agentic work** → a flagship: `tinfoil/glm-5-3` or
|
- **Everyday chat and drafting** → a fast model: `tinfoil/glm-5-3-flash` or
|
||||||
`greenpt/glm-5.3` (same underlying model, different provider trade-off),
|
`greenpt/glm-5.3-flash`. These handle the bulk of what people use chat for,
|
||||||
or `tinfoil/deepseek-v4-1-flash` for long documents and tool-driven tasks.
|
at a fraction of flagship cost.
|
||||||
|
- **Hard reasoning, coding, agentic work** → a flagship: `greenpt/glm-5.3`
|
||||||
|
(the GLM flagship), or `tinfoil/deepseek-v4-1-flash` for long documents and
|
||||||
|
tool-driven tasks.
|
||||||
- **Images in, text out (vision)** → `tinfoil/glm-5-3-flash`,
|
- **Images in, text out (vision)** → `tinfoil/glm-5-3-flash`,
|
||||||
`tinfoil/deepseek-v4-1-flash`, or the Apertus models — see the ✅ in the
|
`tinfoil/deepseek-v4-1-flash`, or the Apertus models — see the ✅ in the
|
||||||
table below.
|
table below.
|
||||||
@@ -52,36 +55,40 @@ that **you choose** which axis matters more for a given task.
|
|||||||
|
|
||||||
## Current models
|
## Current models
|
||||||
|
|
||||||
Pricing is per 1 million tokens, input / output (what the co-op pays the
|
Pricing is per 1 million tokens, input / output / **cached input** (what the
|
||||||
provider — your own cost is your monthly allowance, not per-token billing).
|
co-op pays the provider — your own cost is your monthly allowance, not
|
||||||
**Vision** means the model accepts images as input (screenshots, photos,
|
per-token billing). The cached-input rate applies when a model reuses a
|
||||||
documents to reason about) — all models output text. None of our current
|
shared prompt prefix (multi-turn conversations, agent loops); most providers
|
||||||
models generate images.
|
charge a steep discount for it. Models with `—` don't offer a distinct
|
||||||
|
cache-read price. **Vision** means the model accepts images as input
|
||||||
|
(screenshots, photos, documents to reason about) — all models output text.
|
||||||
|
None of our current models generate images.
|
||||||
|
|
||||||
| Model | Provider | Privacy | Green | Vision | Context | Pricing (in / out) | Notes |
|
The emoji in the model name marks its **value tier** (the same icons used in the chat picker):
|
||||||
|
|
||||||
|
- 🔒 **Private** — Tinfoil: architecturally private (TEE enclaves)
|
||||||
|
- 🌱 **Green** — GreenPT: 100% renewable energy
|
||||||
|
- 📖 **Public** — PublicAI: publicly developed, sovereign open models
|
||||||
|
|
||||||
|
| Model | Provider | Privacy | Green | Vision | Context | Pricing (in / out / cached) | Notes |
|
||||||
|---|---|---|---|---|---|---|---|
|
|---|---|---|---|---|---|---|---|
|
||||||
| `tinfoil/glm-5-3-flash` | Tinfoil | architectural | undisclosed | ✅ | 1M | $0.40 / $1.25 | Fast multimodal MoE; great everyday default with image input. |
|
| `🌱 greenpt/deepseek-v4.1-flash` | GreenPT | policy | 100% renewable | ✅ | 1M | $0.22 / $1.10 / $0.011 | **Default.** DeepSeek's multimodal reasoning model, renewable energy; TEE twin below. |
|
||||||
| `tinfoil/glm-5-3` | Tinfoil | architectural | undisclosed | — | 1M | $1.80 / $5.75 | GLM flagship; strongest agentic model, private tier. |
|
| `🔒 tinfoil/deepseek-v4-1-flash` | Tinfoil | architectural | undisclosed | ✅ | 1M | $0.65 / $1.45 / $0.13 | TEE-protected version of the default; image input, tool calling, long docs/agents. |
|
||||||
| `tinfoil/deepseek-v4-1-flash` | Tinfoil | architectural | undisclosed | ✅ | 1M | $0.65 / $1.45 | Efficient MoE, image input, tool calling; great for long docs and agents. |
|
| `🔒 tinfoil/glm-5-3-flash` | Tinfoil | architectural | undisclosed | ✅ | 1M | $0.40 / $1.25 / $0.10 | Fast multimodal MoE; great everyday default with image input. |
|
||||||
| `tinfoil/gpt-oss-120b` | Tinfoil | architectural | undisclosed | — | 131K | $0.15 / $0.60 | Lightweight open-weight reasoning; cheapest private tier. |
|
| `🔒 tinfoil/gpt-oss-120b` | Tinfoil | architectural | undisclosed | — | 131K | $0.15 / $0.60 / — | Lightweight open-weight reasoning; cheapest private tier. |
|
||||||
| `tinfoil/kimi-k3` | Tinfoil | architectural | undisclosed | ✅ (image + video) | 262K | $4.00 / $20.00 | Moonshot's flagship multimodal MoE; premium tier. |
|
| `🌱 greenpt/glm-5.3-flash` | GreenPT | policy | 100% renewable | — | 1M | $0.11 / $0.44 / $0.022 | Fast GLM model, renewable energy. |
|
||||||
| `greenpt/green-r` | GreenPT | policy | 100% renewable | — | 128K | $0.35 / $0.95 | Reasoning-focused, renewable energy. |
|
| `🌱 greenpt/glm-5.3` | GreenPT | policy | 100% renewable | — | 1M | $1.10 / $4.40 / $0.275 | GLM flagship — strongest agentic model in the green tier. |
|
||||||
| `greenpt/green-l` | GreenPT | policy | 100% renewable | — | 128K | $0.25 / $0.80 | Lightweight, renewable energy. |
|
| `📖 publicai/apertus-v1.5-8b` | PublicAI | policy | undisclosed | ✅ | 262K | $0.10 / $0.20 / — | Fully open sovereign model, small/fast, image understanding. |
|
||||||
| `greenpt/glm-5.3-flash` | GreenPT | policy | 100% renewable | — | 1M | $0.11 / $0.44 | Fast GLM model, renewable energy. |
|
| `📖 publicai/apertus-v1.5-70b` | PublicAI | policy | undisclosed | ✅ | 262K | $0.82 / $2.92 / — | Fully open sovereign model, large/capable, image understanding. |
|
||||||
| `greenpt/glm-5.3` | GreenPT | policy | 100% renewable | — | 1M | $1.10 / $4.40 | GLM flagship — strongest agentic model in the green tier. |
|
|
||||||
| `publicai/apertus-v1.5-8b` | PublicAI | policy | undisclosed | ✅ | 262K | $0.10 / $0.20 | Fully open sovereign model, small/fast, image understanding. |
|
|
||||||
| `publicai/apertus-v1.5-70b` | PublicAI | policy | undisclosed | ✅ | 262K | $0.82 / $2.92 | Fully open sovereign model, large/capable, image understanding. |
|
|
||||||
|
|
||||||
Vision is verified working through the co-op gateway (base64 image input via
|
Vision is verified working through the co-op gateway (base64 image input via
|
||||||
`/v1/chat/completions`, standard OpenAI format). In the chat UI, just attach
|
`/v1/chat/completions`, standard OpenAI format). In the chat UI, just attach
|
||||||
an image to your message while using a ✅ model.
|
an image to your message while using a ✅ model.
|
||||||
|
|
||||||
**Same model, two providers:** `glm-5-3` (Tinfoil) and `glm-5.3` (GreenPT)
|
**Same model, two providers:** `glm-5.3` (GreenPT) is the Z.ai GLM flagship
|
||||||
are the same Z.ai model offered by two providers — Tinfoil's is
|
offered on 100% renewable energy at $1.10/$4.40. We don't currently serve the
|
||||||
architecturally private at $1.80/$5.75; GreenPT's is 100% renewable at
|
Tinfoil (TEE) version of the full GLM-5.3 — for private-tier GLM, use the
|
||||||
$1.10/$4.40. That price/privacy trade-off in a single comparison is the
|
`tinfoil/glm-5-3-flash` light model instead.
|
||||||
co-op's whole idea in miniature: you pick which axis matters for the task
|
|
||||||
at hand.
|
|
||||||
|
|
||||||
### Audio models
|
### Audio models
|
||||||
|
|
||||||
@@ -92,8 +99,8 @@ model picker to avoid confusion.
|
|||||||
|
|
||||||
| Model | Provider | Use | Pricing |
|
| Model | Provider | Use | Pricing |
|
||||||
|---|---|---|---|
|
|---|---|---|---|
|
||||||
| `tinfoil/whisper-large-v3-turbo` | Tinfoil | Speech-to-text | $0.05 / 1M input tokens |
|
| `🔒 tinfoil/whisper-large-v3-turbo` | Tinfoil | Speech-to-text | $0.05 / 1M input tokens |
|
||||||
| `tinfoil/voxtral-tts` | Tinfoil | Text-to-speech | listed $0 (verify on invoice) |
|
| `🔒 tinfoil/voxtral-tts` | Tinfoil | Text-to-speech | listed $0 (verify on invoice) |
|
||||||
|
|
||||||
Both run inside Tinfoil's enclaves, so voice data gets the same architectural
|
Both run inside Tinfoil's enclaves, so voice data gets the same architectural
|
||||||
privacy as the private chat models. TTS voices available: `neutral_female`,
|
privacy as the private chat models. TTS voices available: `neutral_female`,
|
||||||
@@ -147,6 +154,9 @@ window, improved tool use, and instruction-following. It's the *publicly
|
|||||||
developed* counterpart to the private (Tinfoil) and renewable (GreenPT)
|
developed* counterpart to the private (Tinfoil) and renewable (GreenPT)
|
||||||
offerings — sovereignty as a third axis of member choice.
|
offerings — sovereignty as a third axis of member choice.
|
||||||
|
|
||||||
|
For more information on open-source AI and the Apertus models, see the
|
||||||
|
[European Open Source AI Index](https://osai-index.eu/database/).
|
||||||
|
|
||||||
*Source: [apertus-ai.org](https://www.apertus-ai.org/) and the
|
*Source: [apertus-ai.org](https://www.apertus-ai.org/) and the
|
||||||
[Swiss AI Hugging Face](https://huggingface.co/swiss-ai) model cards.*
|
[Swiss AI Hugging Face](https://huggingface.co/swiss-ai) model cards.*
|
||||||
|
|
||||||
|
|||||||
Reference in new issue
Block a user