LLM/docling-serve
1
0
Fork 0
mirror of https://github.com/docling-project/docling-serve.git synced 2025-11-30 00:53:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: avoid exploding options cache using lru and expose size parameter (#101)

Browse Source 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
This commit is contained in:
Michele Dolfi
2025-03-17 08:52:29 +01:00
committed by GitHub
parent 07c48edd5d
commit ea090288d3
3 changed files with 36 additions and 41 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
docling_serve/settings.py
View File

@@ -30,6 +30,7 @@ class DoclingServeSettings(BaseSettings):
enable_ui: bool = False
artifacts_path: Optional[Path] = None
options_cache_size: int = 2
eng_kind: AsyncEngine = AsyncEngine.LOCAL
eng_loc_num_workers: int = 2