alignatt: enable model sharing by removing hooks and centralizing session state. Solves #282

Co-authored-by: Emmanuel Schmidbauer <eschmidbauer@gmail.com>
This commit is contained in:
Quentin Fuxa
2025-11-25 23:07:42 +01:00
parent 4e9f951551
commit 7faa21f95f
9 changed files with 525 additions and 373 deletions

View File

@@ -185,7 +185,6 @@ async def websocket_endpoint(websocket: WebSocket):
| `--init-prompt` | Initial prompt for the model | `None` |
| `--static-init-prompt` | Static prompt that doesn't scroll | `None` |
| `--max-context-tokens` | Maximum context tokens | `None` |
| `--preload-model-count` | Optional. Number of models to preload in memory to speed up loading (set up to the expected number of concurrent users) | `1` |