docs/models.md

Models

The co-op serves models from multiple providers. This is the single list — both the chat and the API draw from it, so it's the one place to look (and the one place to update).

Providers

Models are named provider/model-name, so you can choose not just which model but where it runs. Providers differ along two independent axes: privacy (how protected your prompts and responses are) and green energy (how the compute is powered). These are gradations, not binary switches — and no provider today is best on both.

Provider	Value	Privacy	Green energy	What that means
Tinfoil	private	Strongest — architectural	Not a green claim	Runs in hardware enclaves (TEEs) with end-to-end encryption (EHBP), verifiable via remote attestation. Neither we nor Tinfoil can read your prompts or responses at inference time. Energy mix is not disclosed.
GreenPT	green	Policy-based	Strongest — 100% renewable	Standard (non-enclave) hosting in the EU; privacy rests on GreenPT's commitments and EU data rules, not on cryptography. Compute runs on 100% renewable energy.
PublicAI	public	Policy-based	Undisclosed	A gateway for publicly developed, sovereign models — open-weight models built by national/public programs rather than private labs. Privacy is policy-based (no enclave); energy mix is not disclosed.

Reading the gradations:

• Privacy: architectural (Tinfoil) beats policy-based (GreenPT, PublicAI). An enclave protects you even if the provider is compromised; a policy protects you only as far as the provider keeps its word. Both are better than a provider with neither.
• Green energy: 100% renewable (GreenPT) beats undisclosed (Tinfoil, PublicAI). GreenPT reports its energy mix; the others do not, so we can't claim greenness for them.
• Sovereignty: publicly developed (PublicAI) is its own value — the models come from public/national AI programs, built as public goods rather than proprietary products. It's a third axis, independent of privacy and energy.

Trade-offs are real: the most private option (Tinfoil) isn't the greenest, and the greenest option (GreenPT) isn't the most private. The point of the co-op is that you choose which axis matters more for a given task.

Current models

Pricing is per 1 million tokens, input / output (what the co-op pays the provider — your own cost is your monthly allowance, not per-token billing).

Model	Provider	Privacy	Green energy	Pricing (in / out)	Notes
tinfoil/deepseek-v4-1-flash	Tinfoil	architectural	undisclosed	$0.65 / $1.45	Default; best for agentic tasks (1M context, tool calling).
tinfoil/gpt-oss-120b	Tinfoil	architectural	undisclosed	$0.15 / $0.60	Lightweight fallback.
tinfoil/glm-5-3-flash	Tinfoil	architectural	undisclosed	$0.40 / $1.25	Fast, efficient MoE model.
greenpt/green-r	GreenPT	policy	100% renewable	$0.35 / $0.95	Reasoning, renewable energy.
greenpt/green-l	GreenPT	policy	100% renewable	$0.25 / $0.80	Lightweight, renewable energy.
greenpt/glm-5.3-flash	GreenPT	policy	100% renewable	$0.11 / $0.44	Fast GLM model, renewable energy.
greenpt/glm-5.3	GreenPT	policy	100% renewable	$1.10 / $4.40	GLM flagship — strongest agentic model in the green tier, 1M context.
publicai/apertus-v1.5-8b	PublicAI	policy	undisclosed	$0.10 / $0.20	Fully open sovereign model, small/fast.
publicai/apertus-v1.5-70b	PublicAI	policy	undisclosed	$0.82 / $2.92	Fully open sovereign model, large/capable.

Audio models

These are not chat models — they power the chat's voice mode (dictation and spoken replies) and are available through the API on /v1/audio/* routes for members building speech into their own tools. They're hidden from the chat model picker to avoid confusion.

Model	Provider	Use	Pricing
tinfoil/whisper-large-v3-turbo	Tinfoil	Speech-to-text	$0.05 / 1M input tokens
tinfoil/voxtral-tts	Tinfoil	Text-to-speech	listed $0 (verify on invoice)

Both run inside Tinfoil's enclaves, so voice data gets the same architectural privacy as the private chat models. TTS voices available: neutral_female, neutral_male, casual_female/male, cheerful_female, plus French, German, Spanish, Italian, Portuguese, Dutch, and Hindi variants.

# Speech-to-text
curl https://gateway.inference.coop/v1/audio/transcriptions \
  -H "Authorization: Bearer sk-your-key" \
  -F file=@your-audio.mp3 \
  -F model=tinfoil/whisper-large-v3-turbo

# Text-to-speech (returns WAV audio)
curl https://gateway.inference.coop/v1/audio/speech \
  -H "Authorization: Bearer sk-your-key" \
  -H "Content-Type: application/json" \
  -d '{"model": "tinfoil/voxtral-tts", "input": "Hello from the co-op", "voice": "neutral_female"}' \
  --output speech.wav

About the Apertus models

Apertus is the Swiss AI Initiative's open foundation model, built by a public collaboration between EPFL, ETH Zurich, and the Swiss National Supercomputing Centre (CSCS). It's "fully open" in the strict sense — not just downloadable weights:

• Open weights & code — released under the Apache-2.0 license, so anyone can use, modify, and redistribute it, commercially or not.
• Open training data — trained only on fully open data (unlike most proprietary models, which keep their training set secret). The data, code, methods, and alignment principles are all published and reproducible.
• Open values — governed by a public Apertus Charter that documents the model's values and principles rather than leaving them implicit.
• Sovereign & public-good — designed to European data-protection norms (GDPR, EU AI Act, Swiss law) as an example of "AI as a public good," not a proprietary product. Trained across 1,500+ languages (40% non-English).

The v1.5 generation adds image understanding, a longer 262K-token context window, improved tool use, and instruction-following. It's the publicly developed counterpart to the private (Tinfoil) and renewable (GreenPT) offerings — sovereignty as a third axis of member choice.

Source: apertus-ai.org and the Swiss AI Hugging Face model cards.

Some models also have a discounted cached-input rate (when a prompt is reused and doesn't need to be re-read) — see the code/litellm config for the exact numbers. Pricing here mirrors the model_info in the LiteLLM config (code/litellm/config.yaml), which is the authoritative source — the two are kept in sync.

Limitations on privacy

Only Tinfoil offers architectural privacy. The other providers are chosen for their value (renewable energy, public models) but do not run in enclaves — prompts and responses pass through them in the ordinary way. Your chat history is also stored on our server so you can revisit it, and that stored history is not encrypted in a way that prevents us from technically reading it — we commit not to. The full distinction — what's architecturally private versus what's a policy commitment — is in the Privacy Policy.