inference-bot 9798a41745 fix: abort in-flight chat requests on cancellation
Cancellation was only checked at POST time; once the SSE stream was
open the reader loop never looked at the token again, so a stopped
chat kept generating server-side (and billing) until the response
ended.

Wire an AbortController to token.onCancellationRequested, pass its
signal to fetch, and check token.isCancellationRequested at the top
of the reader loop so the connection closes as soon as the user
stops the request. AbortError is swallowed (a stop is not a
failure); real HTTP errors still surface, and the cancellation
listener is disposed in a finally.
2026-11-07 00:40:40 +00:00
2026-11-06 12:43:42 -05:00
2026-11-06 14:01:56 -05:00
2026-11-06 12:47:59 -05:00
2026-11-06 12:47:59 -05:00
2026-11-06 14:02:02 -05:00
2026-11-06 14:02:02 -05:00
2026-11-06 13:39:14 -05:00

Inference Coop for Copilot Chat (unofficial)

Community-built model provider for inference.coop, usable in GitHub Copilot Chat. Not affiliated with or endorsed by the Inference Cooperative.

Requirements

  • VS Code 1.145 or newer
  • GitHub Copilot Chat, installed and signed in
  • A co-op membership and API key

Copilot Business/Enterprise: your administrator must leave "Bring Your Own Language Model Key" enabled, or these models will not appear.

Setup

  1. Run Inference Coop: Set API Key from the Command Palette and paste your co-op key. It is stored in VS Code's secret storage, not in settings.
  2. Open Copilot Chat, click the model name, and pick an inference-coop/… model. Tool calling works, so agent mode is usable.

To use a different gateway, set inferenceCoop.baseUrl. To sign out, run Inference Coop: Sign Out.

Limitations

  • No image input; models are advertised as text-and-tools only.
  • Token counts are estimated rather than computed with a real tokenizer, so context budgeting is approximate.
  • No inline code completions. Copilot does not support third-party providers for completions; this extension only adds chat models.
  • Unofficial client. Report extension bugs here, not to the co-op.

License

Apache-2.0. See LICENSE and NOTICE.

S
Description
VSCode plugin to add inference.coop models to the CoPilot chat
Readme Apache-2.0
657 KiB
0 Stars 2 Watchers 0 Forks
Languages
TypeScript 87%
JavaScript 13%