diff --git a/README.md b/README.md index 1664efa..7391afa 100644 --- a/README.md +++ b/README.md @@ -188,3 +188,16 @@ Open WebUI does **not** talk to this gateway directly — it routes through the - `co-op/website` — the public landing page - `co-op/docs` — documentation, including the member-facing model list - `co-op/design-assets` — logos, fonts, brand materials + +## Scheduled tasks (scheduler addon) + +The gateway pings the Tinfoil audio models every 10 minutes (`audio_keepalive.py`, +declared in `CloudronManifest.json` → `addons.scheduler`) to keep the TEE audio +enclave warm — voice mode then skips the ~24s cold-start after idle. TTS-only: +an STT ping would cost $0.01/request (~$52/mo at 6/hr) versus $0.002 for TTS. + +The script reads the master key from `/app/data/.master_key` (written by +`start.sh`); the `LITELLM_MASTER_KEY` env var is only exported into the litellm +process, not scheduler tasks. Verify after deploys: `cloudron exec --app +-- python3 /app/code/audio_keepalive.py` should exit 0 silently, and the deploy +log must show `setupAddons: ... scheduler ... audio_keepalive`.