Compare commits
10
Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
8c5b60da5e | ||
|
|
039cfc0ac5 | ||
|
|
48174ae2a6 | ||
|
|
2f8657c015 | ||
|
|
7202aaa17c | ||
|
|
d3c3c8f8f7 | ||
|
|
884340427f | ||
|
|
9699ff08cc | ||
|
|
0d4a62a2da | ||
|
|
72cc256e3f |
No files matched your search
+31
-16
@@ -1,35 +1,50 @@
|
|||||||
# Inference Cooperative Charter
|
# Inference Cooperative Charter
|
||||||
|
|
||||||
A cooperative for AI resources, governed by members.
|
## Preamble
|
||||||
|
|
||||||
|
The Inference Cooperative exists to enable the people who use its AI infrastructure to co-govern it. We came together to build and run an alternative to extractive, profit-driven AI—a service owned and directed by its members, committed to pursuing ethical practices, and governed cooperatively. This charter is our core governing document. It sets out how we make decisions together.
|
||||||
|
|
||||||
## Values
|
## Values
|
||||||
|
|
||||||
The Inference Cooperative seeks to advance accountable AI grounded in democracy, privacy, and sustainability.
|
In addition to the international [cooperative principles](https://www.ica.coop/en/cooperatives/cooperative-identity/), we share these basic commitments:
|
||||||
|
|
||||||
## Code of Conduct
|
- **Participation.** Our service is accountable to the people who use it, and they both can and should have an active role in shaping it.
|
||||||
|
- **Experimentation.** In order to learn together, we will maintain a spirit of exploration and experimentation, and be respectful of all members' levels of knowledge and expertise.
|
||||||
|
- **Sustainability.** We commit, wherever possible, to minimizing harm to natural ecologies and to promoting environmental justice.
|
||||||
|
- **Trustworthiness.** We seek to provide reliable service to one another and protect each other's privacy, in contrast to an industry widely characterized by surveillance.
|
||||||
|
- **Transparency.** The co-op should make its operations and decisions as available as possible to members, and to share our learnings with the wider world.
|
||||||
|
|
||||||
Members must adhere to the [Contributor Covenant](https://git.inference.coop/co-op/docs/src/branch/main/code-of-conduct.md).
|
## Roles
|
||||||
|
|
||||||
## Membership
|
- **Members** are the heart of the co-op. All account holders currently [contributing monthly dues](https://opencollective.com/inference-cooperative) are considered members and may participate in decision-making and working groups. Members may be sanctioned or removed for violating co-op rules by the GM or a designated working group.
|
||||||
|
- A **general manager** oversees day-to-day operations and implements member decisions, through their own actions or additional roles that they delegate. The GM is accountable to members and may be replaced by them through a policy decision.
|
||||||
|
- **Working groups** make and carry out operational decisions within their own purview. They should be formally established, modified, and disbanded through a policy decision, and they are obligated, at minimum, to publish to members their membership, meeting schedule, and major activities.
|
||||||
|
- A **spokescouncil** coordinates across working groups, and all working groups are responsible for ensuring that at least one member consistently participates. The spokescouncil meets monthly, and meetings are open to all members.
|
||||||
|
|
||||||
Members are dues-paying users of the service. Join at [opencollective.com/inference-cooperative](https://opencollective.com/inference-cooperative).
|
## Decisions
|
||||||
|
|
||||||
### Deliberation
|
The co-op operates through the practice of modified [policy governance](https://en.wikipedia.org/wiki/Policy_Governance). Member decisions should seek to instill responsibility and trust in role-holders, while guiding them only through goal-setting and necessary constraints. Role-holders should act on the basis of their expertise and the co-op's values, as well as through consultation with members.
|
||||||
|
|
||||||
Members can participate in deliberation about co-op business on Loomio at [forum.inference.coop](https://forum.inference.coop). Decisions are not currently binding, but in the future they will be.
|
**Policy.** Any member may propose a policy in the co-op's [forum](https://forum.inference.coop/). A proposal requires at least one vote from another member and stays open for 7 days. It passes by consent as long as it receives support from at least 60% of voting members. If a member raises a block—a reasoned objection that the proposal would seriously harm the cooperative—it requires 75% support. The proposal's author is always encouraged to revise the proposal based on feedback from other members and restart the process.
|
||||||
|
|
||||||
### Removal
|
**Charter.** Changes to this charter require a proposal open for **14 days**, along with approval by 75% of voting members, regardless of blocks. Policy decisions must not contradict the charter.
|
||||||
|
|
||||||
Members may be removed by the General Manager for violations of the Code of Conduct or failure to contribute dues.
|
This governance design is oriented around a relatively small community. Upon reaching 250 members, we commit to revising this charter with a larger community in mind.
|
||||||
|
|
||||||
## General Manager
|
## Disputes
|
||||||
|
|
||||||
The General Manager, initially Nathan Schneider, temporarily has full governance responsibilities over the cooperative.
|
We regard disputes as an opportunity to learn and grow. Members should try to work things out directly with each other first. When necessary, disputes either among members or between a member and the co-op should be brought to the disputes working group—or, if one does not exist, the GM. Disputes that cannot be adequately addressed within the co-op may be escalated to the parent legal entity, which may in turn forward them to the relevant legal jurisdiction.
|
||||||
|
|
||||||
## Evolution
|
## Agreements
|
||||||
|
|
||||||
The current governance model will evolve into a true member-governed cooperative upon or before reaching 50 members. The General Manager is responsible for ensuring the transition occurs within two weeks of that milestone. If it does not, the General Manager must resign and transfer the role to someone who does commit to that deadline, or the co-op is dissolved.
|
This charter is the core governing document. Members are also bound by the following agreements:
|
||||||
|
|
||||||
---
|
* [Code of Conduct](https://git.inference.coop/co-op/docs/src/branch/main/code-of-conduct.md)
|
||||||
|
* [Terms of Service](https://git.inference.coop/co-op/docs/src/branch/main/terms-of-service.md)
|
||||||
|
* [Privacy Policy](https://git.inference.coop/co-op/docs/src/branch/main/privacy-policy.md)
|
||||||
|
|
||||||
*Created by the [Inference Cooperative](https://inference.coop/).*
|
## Legal entity
|
||||||
|
|
||||||
|
The Inference Cooperative operates under the fiscal sponsorship of [Metagov](https://metagov.org/), and our governance is subject to [Metagov's fiscal sponsorship policy](https://metagov.pubpub.org/pub/7bj5ia5g/release/1). We commit to honor that agreement and to operate in a spirit that avoids causing harm to our fiscal host. Metagov may rescind a decision it deems at odds with its policies.
|
||||||
|
|
||||||
|
If that commitment is ever at odds with the cooperative's evolution, the cooperative may move to a different fiscal host. Changing fiscal hosts should occur through a revision of this Charter.
|
||||||
@@ -16,20 +16,18 @@ provider today is best on both.
|
|||||||
|---|---|---|---|---|
|
|---|---|---|---|---|
|
||||||
| **Tinfoil** | *private* | **Strongest — architectural** | Not a green claim | Runs in hardware enclaves (TEEs) with end-to-end encryption (EHBP), verifiable via remote attestation. Neither we nor Tinfoil can read your prompts or responses at inference time. Energy mix is not disclosed. |
|
| **Tinfoil** | *private* | **Strongest — architectural** | Not a green claim | Runs in hardware enclaves (TEEs) with end-to-end encryption (EHBP), verifiable via remote attestation. Neither we nor Tinfoil can read your prompts or responses at inference time. Energy mix is not disclosed. |
|
||||||
| **GreenPT** | *green* | **Policy-based** | **Strongest — 100% renewable** | Standard (non-enclave) hosting in the EU; privacy rests on GreenPT's commitments and EU data rules, not on cryptography. Compute runs on 100% renewable energy. |
|
| **GreenPT** | *green* | **Policy-based** | **Strongest — 100% renewable** | Standard (non-enclave) hosting in the EU; privacy rests on GreenPT's commitments and EU data rules, not on cryptography. Compute runs on 100% renewable energy. |
|
||||||
| **PublicAI** | *public* | Policy-based | Undisclosed | A gateway for **publicly developed, sovereign models** — open-weight models built by national/public programs rather than private labs. Privacy is policy-based (no enclave); energy mix is not disclosed. |
|
| **Regolo** | *green* | Policy-based — **zero data retention** | **100% renewable** | EU-hosted (Italy, Seeweb) with a stated zero-data-retention policy: prompts are not stored or reused. Compute runs on 100% renewable energy. |
|
||||||
|
|
||||||
**Reading the gradations:**
|
**Reading the gradations:**
|
||||||
|
|
||||||
- **Privacy:** *architectural* (Tinfoil) beats *policy-based* (GreenPT, PublicAI). An
|
- **Privacy:** *architectural* (Tinfoil) beats *policy-based* (GreenPT,
|
||||||
enclave protects you even if the provider is compromised; a policy protects
|
Regolo). An enclave protects you even if the provider is compromised; a
|
||||||
you only as far as the provider keeps its word. Both are better than a
|
policy protects you only as far as the provider keeps its word. Both are
|
||||||
provider with neither.
|
better than a provider with neither — and Regolo adds a written
|
||||||
- **Green energy:** *100% renewable* (GreenPT) beats *undisclosed* (Tinfoil,
|
zero-data-retention commitment on top of its policy.
|
||||||
PublicAI). GreenPT reports its energy mix; the others do not, so we can't
|
- **Green energy:** *100% renewable* (GreenPT, Regolo) beats *undisclosed*
|
||||||
claim greenness for them.
|
(Tinfoil). GreenPT and Regolo both run on 100% renewable energy; Tinfoil's
|
||||||
- **Sovereignty:** *publicly developed* (PublicAI) is its own value — the models
|
mix is not disclosed.
|
||||||
come from public/national AI programs, built as public goods rather than
|
|
||||||
proprietary products. It's a third axis, independent of privacy and energy.
|
|
||||||
|
|
||||||
Trade-offs are real: the most private option (Tinfoil) isn't the greenest, and
|
Trade-offs are real: the most private option (Tinfoil) isn't the greenest, and
|
||||||
the greenest option (GreenPT) isn't the most private. The point of the co-op is
|
the greenest option (GreenPT) isn't the most private. The point of the co-op is
|
||||||
@@ -61,30 +59,39 @@ per-token billing). The cached-input rate applies when a model reuses a
|
|||||||
shared prompt prefix (multi-turn conversations, agent loops); most providers
|
shared prompt prefix (multi-turn conversations, agent loops); most providers
|
||||||
charge a steep discount for it. Models with `—` don't offer a distinct
|
charge a steep discount for it. Models with `—` don't offer a distinct
|
||||||
cache-read price. **Vision** means the model accepts images as input
|
cache-read price. **Vision** means the model accepts images as input
|
||||||
(screenshots, photos, documents to reason about) — all models output text.
|
(screenshots, photos, documents to reason about). **Image generation** is
|
||||||
None of our current models generate images.
|
available via the chat's image feature (the 🎨 button) using
|
||||||
|
`regolo/qwen-image`.
|
||||||
|
|
||||||
The emoji in the model name marks its **value tier** (the same icons used in the chat picker):
|
The emoji in the model name marks its **value tier** (the same icons used in the chat picker):
|
||||||
|
|
||||||
- 🔒 **Private** — Tinfoil: architecturally private (TEE enclaves)
|
- 🔒 **Private** — Tinfoil: architecturally private (TEE enclaves)
|
||||||
- 🌱 **Green** — GreenPT: 100% renewable energy
|
- 🌱 **Green** — GreenPT and Regolo: renewable-powered EU hosts (Regolo adds
|
||||||
- 📖 **Public** — PublicAI: publicly developed, sovereign open models
|
a zero-data-retention commitment). The 🌱 emoji marks renewable-powered
|
||||||
|
providers, not a specific company.
|
||||||
|
|
||||||
| Model | Provider | Privacy | Green | Vision | Context | Pricing (in / out / cached) | Notes |
|
| Model | Provider | Privacy | Green | Vision | Context | Pricing (in / out / cached) | Notes |
|
||||||
|---|---|---|---|---|---|---|---|
|
|---|---|---|---|---|---|---|---|
|
||||||
| `🌱 greenpt/deepseek-v4.1-flash` | GreenPT | policy | 100% renewable | ✅ | 1M | $0.22 / $1.10 / $0.011 | **Default.** DeepSeek's multimodal reasoning model, renewable energy; TEE twin below. |
|
| `🌱 greenpt/deepseek-v4.1-flash` | GreenPT | policy | ✅ 100% renewable | ✅ | 1M | $0.22 / $1.10 / $0.011 | **Default.** DeepSeek's multimodal reasoning model, renewable energy; TEE twin below. |
|
||||||
| `🔒 tinfoil/deepseek-v4-1-flash` | Tinfoil | architectural | undisclosed | ✅ | 1M | $0.65 / $1.45 / $0.13 | TEE-protected version of the default; image input, tool calling, long docs/agents. |
|
| `🔒 tinfoil/deepseek-v4-1-flash` | Tinfoil | architectural | undisclosed | ✅ | 1M | $0.65 / $1.45 / $0.13 | TEE-protected version of the default; image input, tool calling, long docs/agents. |
|
||||||
| `🔒 tinfoil/glm-5.3` | Tinfoil | architectural | undisclosed | — | 1M | $1.80 / $5.75 / $0.45 | GLM flagship, TEE-protected; strongest private-tier model for agentic coding and long-horizon tasks. |
|
| `🔒 tinfoil/glm-5.3` | Tinfoil | architectural | undisclosed | — | 1M | $1.80 / $5.75 / $0.45 | GLM flagship, TEE-protected; strongest private-tier model for agentic coding and long-horizon tasks. |
|
||||||
| `🔒 tinfoil/gpt-oss-120b` | Tinfoil | architectural | undisclosed | — | 131K | $0.15 / $0.60 / — | Lightweight open-weight reasoning; cheapest private tier. |
|
| `🔒 tinfoil/gpt-oss-120b` | Tinfoil | architectural | undisclosed | — | 131K | $0.15 / $0.60 / — | Lightweight open-weight reasoning; cheapest private tier. |
|
||||||
| `🌱 greenpt/glm-5.3-flash` | GreenPT | policy | 100% renewable | — | 1M | $0.11 / $0.44 / $0.022 | Fast GLM model, renewable energy. |
|
| `🌱 greenpt/glm-5.3-flash` | GreenPT | policy | ✅ 100% renewable | — | 1M | $0.11 / $0.44 / $0.022 | Fast GLM model, renewable energy. |
|
||||||
| `🌱 greenpt/glm-5.3` | GreenPT | policy | 100% renewable | — | 1M | $1.10 / $4.40 / $0.275 | GLM flagship — strongest agentic model in the green tier. |
|
| `🌱 greenpt/glm-5.3` | GreenPT | policy | ✅ 100% renewable | — | 1M | $1.10 / $4.40 / $0.275 | GLM flagship — strongest agentic model in the green tier. |
|
||||||
| `📖 publicai/apertus-v1.5-8b` | PublicAI | policy | undisclosed | ✅ | 262K | $0.10 / $0.20 / — | Fully open sovereign model, small/fast, image understanding. |
|
| `🌱 regolo/apertus-70b` | Regolo | policy + ZDR | ✅ 100% renewable | ✅ | 65K | $0.46 / $2.44 / — | Fully open sovereign model (Apache-2.0), large/capable, image understanding. |
|
||||||
| `📖 publicai/apertus-v1.5-70b` | PublicAI | policy | undisclosed | ✅ | 262K | $0.82 / $2.92 / — | Fully open sovereign model, large/capable, image understanding. |
|
| `🌱 regolo/qwen3.5-122b` | Regolo | policy + ZDR | ✅ 100% renewable | ✅ | 262K | $1.16 / $4.87 / — | Large vision+reasoning MoE (Qwen 3.5, 122B-A10B); biggest context in the roster. |
|
||||||
|
|
||||||
Vision is verified working through the co-op gateway (base64 image input via
|
Vision is verified working through the co-op gateway (base64 image input via
|
||||||
`/v1/chat/completions`, standard OpenAI format). In the chat UI, just attach
|
`/v1/chat/completions`, standard OpenAI format). In the chat UI, just attach
|
||||||
an image to your message while using a ✅ model.
|
an image to your message while using a ✅ model.
|
||||||
|
|
||||||
|
**Reading the Privacy column:** *architectural* means the protection is built
|
||||||
|
into the infrastructure (TEE enclaves) — even the provider can't read your
|
||||||
|
prompts. *Policy* means the provider commits, by contract and policy, not to
|
||||||
|
store or reuse your data. *ZDR* (zero data retention) is a stronger policy:
|
||||||
|
the provider keeps no copy of prompts or outputs at all after the response is
|
||||||
|
delivered.
|
||||||
|
|
||||||
**Same model, two providers:** `glm-5.3` (Z.ai's GLM flagship) is offered both
|
**Same model, two providers:** `glm-5.3` (Z.ai's GLM flagship) is offered both
|
||||||
on GreenPT (renewable, $1.10/$4.40) and on Tinfoil (TEE-protected, $1.80/$5.75)
|
on GreenPT (renewable, $1.10/$4.40) and on Tinfoil (TEE-protected, $1.80/$5.75)
|
||||||
— pick the axis that matters to you. The fast `glm-5.3-flash` variant is
|
— pick the axis that matters to you. The fast `glm-5.3-flash` variant is
|
||||||
@@ -131,6 +138,22 @@ curl https://gateway.inference.coop/v1/chat/completions \
|
|||||||
]}]}'
|
]}]}'
|
||||||
```
|
```
|
||||||
|
|
||||||
|
### Image generation
|
||||||
|
|
||||||
|
`🌱 regolo/qwen-image` (Regolo, EU-hosted, zero data retention) generates
|
||||||
|
images from a text prompt. In the chat, press the **Integrations** button
|
||||||
|
below the message box, choose **Image**, and describe what you want — the
|
||||||
|
generated image appears in the conversation. Via the API:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
curl https://gateway.inference.coop/v1/images/generations \
|
||||||
|
-H "Authorization: Bearer ***" \
|
||||||
|
-H "Content-Type: application/json" \
|
||||||
|
-d '{"model": "regolo/qwen-image", "prompt": "a watercolor painting of a mountain lake", "n": 1, "size": "512x512"}'
|
||||||
|
```
|
||||||
|
|
||||||
|
The response returns base64-encoded JPEG(s). Billed per pixel generated.
|
||||||
|
|
||||||
### About the Apertus models
|
### About the Apertus models
|
||||||
|
|
||||||
Apertus is the **Swiss AI Initiative's** open foundation model, built by a
|
Apertus is the **Swiss AI Initiative's** open foundation model, built by a
|
||||||
|
|||||||
Reference in new issue
Block a user