LLM/docling-serve
1
0
Fork 0
mirror of https://github.com/docling-project/docling-serve.git synced 2025-11-29 00:23:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
205 Commits 4 Branches 37 Tags
main
Commit Graph

15 Commits

Author SHA1 Message Date
Michele Dolfi
0427f71ef4 chore: allow to change the container runtime (#412) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2025-10-20 14:13:51 +02:00
Rui Dias Gomes
fd1b987e8d feat: add rocm image build support and fix cuda (#292) 
Signed-off-by: rmdg88 <rmdg88@gmail.com>
Signed-off-by: Rui-Dias-Gomes <rui.dias.gomes@ibm.com>
Co-authored-by: Rui-Dias-Gomes <rui.dias.gomes@ibm.com>
 2025-07-31 14:22:42 +02:00
Michele Dolfi
30aca92298 feat: package updates and more cuda images (#229) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2025-06-24 16:59:05 +02:00
Michele Dolfi
35c2630c61 fix: add flash-attn for cuda images (#161) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2025-04-29 16:58:33 +02:00
Michele Dolfi
c1ce4719c9 fix: fix permissions in docker image (#136) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2025-04-17 14:27:43 +02:00
Michele Dolfi
fd8e40a008 docs: simplify README and move details to docs (#102) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2025-03-17 13:40:12 +01:00
Michele Dolfi
7994b19b9f chore: move to docling-project gh org (#95) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2025-03-14 14:04:31 +01:00
Michele Dolfi
7e6d9cdef3 feat: New container images (#68) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2025-02-26 12:49:20 +01:00
Michele Dolfi
ec33a61faa feat: Add new docling-serve cli (#50) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2025-02-19 20:54:13 +01:00
Eugene
663e03303a chore: use uv in start_server.sh and update docs (#49) 
Signed-off-by: Eugene <fogaprod@gmail.com>
 2025-02-19 19:25:00 +01:00
archas
de42baf8dc chore(makefile): add docker run targets (#32) 
* chore(makefile): add docker run targets

Signed-off-by: archasek <2247211+archasek@users.noreply.github.com>

* chore(makefile): modify run tasks

Signed-off-by: archasek <2247211+archasek@users.noreply.github.com>

* chore(makefile): modify run tasks

Signed-off-by: archasek <2247211+archasek@users.noreply.github.com>

---------

Signed-off-by: archasek <2247211+archasek@users.noreply.github.com>
 2025-02-11 09:52:07 +01:00
Guillaume Moutier
c6539c42de api v1alpha1 (#17) 
* api v1alpha1

Signed-off-by: Guillaume Moutier <gmoutier@redhat.com>
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* use actual types in request models and refactor

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* make gradio optional and update README

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* Run workflow jobs sequentially to avoid disk space outage (#19)

Github Action runners are running out of the space while
building both the images in parallel.

This change will build the image sequentially and also
clean up the cpu images before start building gpu image.

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* Add github job to build image (and not publish) on PR creation (#20)

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add start_server script for local dev

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix 3.12-only syntax

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix more py3.10-11 compatibility

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* rework output format and background tasks

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* speficy return schemas for openapi

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add processing time and update REDAME

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* lint markdown

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add MD033 to config

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* use port 5000

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* use port 5001 as default

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* update deps

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* refactor input request

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* return docling document

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* update new payload in README

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add base64 example

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* wrap example in <details>

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* rename /url in /source

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* move main execution to __main__

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Guillaume Moutier <gmoutier@redhat.com>
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>
Co-authored-by: Michele Dolfi <dol@zurich.ibm.com>
Co-authored-by: Anil Vishnoi <vishnoianil@gmail.com>
 2025-02-03 11:00:54 +01:00
Anil Vishnoi
ac3518c34c Add python, markdown and github action linter (#5) 
to ensure the code maintenance. Thanks to docling
project- took some good bits around python linting
from the project.

These checks are also added in the markdown, so that
user can run these checks locally to recreate the
errors.

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>
 2024-09-13 14:26:32 +02:00
Anil Vishnoi
fc11dc2540 Enable concurrent running of the image generation jobs (#4) 
Group GPU image generate for GHCR and QUAY in one job,
and similarly group CPU only image generation for GHCR
and QUAY in another job. These two jobs can now run
concurrently.

By grouping the jobs for the same image type, it can
use the docker layer cache to run the second job faster.
If we separately build these images in four diffent and
concurrent jobs, they won't be able to use the cache.

If this still takes significantly long, we probably
have to generate image in it's own job, so that they can run
concurrently, without leveraging cache of docker layers.

Also added make file target to lint the github workflows.

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>
 2024-09-13 10:31:06 +02:00
Anil Vishnoi
a91ee83c61 Publish docling-serve images to ghcr and quay container repositories (#1) 
* Publish docling-serve images to ghcr and quay container repositories

This commit:
- Creates container file to build the image for cpu only
and default "with gpu" images
- Adds workflow jobs to publish the images to ghcr.io and quay.io
- Makefile to build these images locally for linux/amd64 platform.

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>

* make cpu-only version with poetry

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* Rename cpu/gpu image names and also update the supported platforms

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>

---------

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
Co-authored-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-09-12 22:02:42 +02:00