inference-bot e0732af1fd models: apertus-70b is 262K context, not 65K — measured, not copied
The provider's published catalog says this model takes 30K input and has no
vision support. Both of those are wrong. Sent through our own gateway:

- an image returns the right answer ("Red" for a solid red PNG)
- prompts of 32K, 70K, 130K and 262K input tokens are all accepted, with
  Regolo's own usage accounting reporting prompt_tokens=262021

Our own description of the v1.5 generation — image understanding and a 262K
context window — matches what the model demonstrably does, which is why the
figure goes to 262K. The old 65K undersold the model by roughly 4x.

Regolo's meta-model for qwen3.5-122b says 120K; it processed 262,023 tokens and
still followed the instruction at the end, so that row's 262K is confirmed as
written and is left alone.

Adds a line under the table recording that context figures here are measured
through the gateway rather than copied from provider catalogs, because that
difference is exactly what caused a member to report this as an error.
2026-10-29 17:11:17 +00:00
2026-10-23 18:09:11 +00:00
2026-10-15 18:05:59 +00:00

Inference Cooperative

AI, governed together.

The Inference Cooperative is a member-governed project providing private AI inference. Members pay dues on a sliding scale and, in return, get private AI chat and API access through shared, cooperatively governed infrastructure. We are fiscally sponsored by Metagov, a nonprofit, and funded through our Open Collective.

Start here

  • New here? → Getting started — join, use the chat, and get involved in governance.
  • Why does this exist? → Background — a one-page summary of the mission and history.
  • Which models can I use? → Models — the full catalog of providers and models.
  • Want API access? → API access — use our models programmatically.
  • Want community chat? → Getting started · Matrix — our federated Matrix server, including how to connect from any client and how to use an existing Matrix account.
  • Curious how it works? → Infrastructure — a map of the stack and the codebase.
  • Need help or have an idea? → Support & feature requests — open an issue.

This documentation lives in a public git repository. Contributions welcome.

S
Description
Public documentation for the Inference Cooperative
Readme
919 KiB
0 Stars 1 Watchers 0 Forks
Languages
Markdown 100%