README: document the audio keep-alive scheduled task
This commit is contained in:
1 parent
0d73c80562
commit
d082957167
1 file changed
+13
@@ -188,3 +188,16 @@ Open WebUI does **not** talk to this gateway directly — it routes through the
|
||||
- `co-op/website` — the public landing page
|
||||
- `co-op/docs` — documentation, including the member-facing model list
|
||||
- `co-op/design-assets` — logos, fonts, brand materials
|
||||
|
||||
## Scheduled tasks (scheduler addon)
|
||||
|
||||
The gateway pings the Tinfoil audio models every 10 minutes (`audio_keepalive.py`,
|
||||
declared in `CloudronManifest.json` → `addons.scheduler`) to keep the TEE audio
|
||||
enclave warm — voice mode then skips the ~24s cold-start after idle. TTS-only:
|
||||
an STT ping would cost $0.01/request (~$52/mo at 6/hr) versus $0.002 for TTS.
|
||||
|
||||
The script reads the master key from `/app/data/.master_key` (written by
|
||||
`start.sh`); the `LITELLM_MASTER_KEY` env var is only exported into the litellm
|
||||
process, not scheduler tasks. Verify after deploys: `cloudron exec --app <id>
|
||||
-- python3 /app/code/audio_keepalive.py` should exit 0 silently, and the deploy
|
||||
log must show `setupAddons: ... scheduler ... audio_keepalive`.
|
||||
Reference in new issue
Block a user