From d08295716701f5f8a7c7491c27f7cffc6681a362 Mon Sep 17 00:00:00 2001 From: Inferencebot Date: Mon, 12 Oct 2026 19:33:18 -0600 Subject: [PATCH] README: document the audio keep-alive scheduled task --- README.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/README.md b/README.md index 1664efa..7391afa 100644 --- a/README.md +++ b/README.md @@ -188,3 +188,16 @@ Open WebUI does **not** talk to this gateway directly — it routes through the - `co-op/website` — the public landing page - `co-op/docs` — documentation, including the member-facing model list - `co-op/design-assets` — logos, fonts, brand materials + +## Scheduled tasks (scheduler addon) + +The gateway pings the Tinfoil audio models every 10 minutes (`audio_keepalive.py`, +declared in `CloudronManifest.json` → `addons.scheduler`) to keep the TEE audio +enclave warm — voice mode then skips the ~24s cold-start after idle. TTS-only: +an STT ping would cost $0.01/request (~$52/mo at 6/hr) versus $0.002 for TTS. + +The script reads the master key from `/app/data/.master_key` (written by +`start.sh`); the `LITELLM_MASTER_KEY` env var is only exported into the litellm +process, not scheduler tasks. Verify after deploys: `cloudron exec --app +-- python3 /app/code/audio_keepalive.py` should exit 0 silently, and the deploy +log must show `setupAddons: ... scheduler ... audio_keepalive`.