mirror of
https://github.com/docling-project/docling-serve.git
synced 2025-11-29 00:23:36 +00:00
123 lines
4.6 KiB
Markdown
123 lines
4.6 KiB
Markdown
<p align="center">
|
|
<a href="https://github.com/docling-project/docling-serve">
|
|
<img loading="lazy" alt="Docling" src="https://github.com/docling-project/docling-serve/raw/main/docs/assets/docling-serve-pic.png" width="30%"/>
|
|
</a>
|
|
</p>
|
|
|
|
# Docling Serve
|
|
|
|
Running [Docling](https://github.com/docling-project/docling) as an API service.
|
|
|
|
📚 [Docling Serve documentation](./docs/README.md)
|
|
|
|
- Learning how to [configure the webserver](./docs/configuration.md)
|
|
- Get to know all [runtime options](./docs/usage.md) of the API
|
|
- Explore useful [deployment examples](./docs/deployment.md)
|
|
- And more
|
|
|
|
> [!NOTE]
|
|
> **Migration to the `v1` API.** Docling Serve now has a stable v1 API. Read more on the [migration to v1](./docs/v1_migration.md).
|
|
|
|
## Getting started
|
|
|
|
Install the `docling-serve` package and run the server.
|
|
|
|
```bash
|
|
# Using the python package
|
|
pip install "docling-serve[ui]"
|
|
docling-serve run --enable-ui
|
|
|
|
# Using container images, e.g. with Podman
|
|
podman run -p 5001:5001 -e DOCLING_SERVE_ENABLE_UI=1 quay.io/docling-project/docling-serve
|
|
```
|
|
|
|
The server is available at
|
|
|
|
- API <http://127.0.0.1:5001>
|
|
- API documentation <http://127.0.0.1:5001/docs>
|
|
- UI playground <http://127.0.0.1:5001/ui>
|
|
|
|
|
|
|
|
Try it out with a simple conversion:
|
|
|
|
```bash
|
|
curl -X 'POST' \
|
|
'http://localhost:5001/v1/convert/source' \
|
|
-H 'accept: application/json' \
|
|
-H 'Content-Type: application/json' \
|
|
-d '{
|
|
"sources": [{"kind": "http", "url": "https://arxiv.org/pdf/2501.17887"}]
|
|
}'
|
|
```
|
|
|
|
### Container Images
|
|
|
|
The following container images are available for running **Docling Serve** with different hardware and PyTorch configurations:
|
|
|
|
#### 📦 Distributed Images
|
|
|
|
| Image | Description | Architectures | Size |
|
|
|-------|-------------|----------------|------|
|
|
| [`ghcr.io/docling-project/docling-serve`](https://github.com/docling-project/docling-serve/pkgs/container/docling-serve) <br> [`quay.io/docling-project/docling-serve`](https://quay.io/repository/docling-project/docling-serve) | Base image with all packages installed from the official PyPI index. | `linux/amd64`, `linux/arm64` | 4.4 GB (arm64) <br> 8.7 GB (amd64) |
|
|
| [`ghcr.io/docling-project/docling-serve-cpu`](https://github.com/docling-project/docling-serve/pkgs/container/docling-serve-cpu) <br> [`quay.io/docling-project/docling-serve-cpu`](https://quay.io/repository/docling-project/docling-serve-cpu) | CPU-only variant, using `torch` from the PyTorch CPU index. | `linux/amd64`, `linux/arm64` | 4.4 GB |
|
|
| [`ghcr.io/docling-project/docling-serve-cu126`](https://github.com/docling-project/docling-serve/pkgs/container/docling-serve-cu126) <br> [`quay.io/docling-project/docling-serve-cu126`](https://quay.io/repository/docling-project/docling-serve-cu126) | CUDA 12.6 build with `torch` from the cu126 index. | `linux/amd64` | 10.0 GB |
|
|
| [`ghcr.io/docling-project/docling-serve-cu128`](https://github.com/docling-project/docling-serve/pkgs/container/docling-serve-cu128) <br> [`quay.io/docling-project/docling-serve-cu128`](https://quay.io/repository/docling-project/docling-serve-cu128) | CUDA 12.8 build with `torch` from the cu128 index. | `linux/amd64` | 11.4 GB |
|
|
|
|
#### 🚫 Not Distributed
|
|
|
|
An image for AMD ROCm 6.3 (`docling-serve-rocm`) is supported but **not published** due to its large size.
|
|
|
|
To build it locally:
|
|
|
|
```bash
|
|
git clone --branch main git@github.com:docling-project/docling-serve.git
|
|
cd docling-serve/
|
|
make docling-serve-rocm-image
|
|
```
|
|
|
|
For deployment using Docker Compose, see [docs/deployment.md](docs/deployment.md).
|
|
|
|
Coming soon: `docling-serve-slim` images will reduce the size by skipping the model weights download.
|
|
|
|
### Demonstration UI
|
|
|
|
An easy to use UI is available at the `/ui` endpoint.
|
|
|
|
|
|
|
|
|
|
|
|
## Get help and support
|
|
|
|
Please feel free to connect with us using the [discussion section](https://github.com/docling-project/docling/discussions).
|
|
|
|
## Contributing
|
|
|
|
Please read [Contributing to Docling Serve](https://github.com/docling-project/docling-serve/blob/main/CONTRIBUTING.md) for details.
|
|
|
|
## References
|
|
|
|
If you use Docling in your projects, please consider citing the following:
|
|
|
|
```bib
|
|
@techreport{Docling,
|
|
author = {Docling Contributors},
|
|
month = {1},
|
|
title = {Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversion},
|
|
url = {https://arxiv.org/abs/2501.17887},
|
|
eprint = {2501.17887},
|
|
doi = {10.48550/arXiv.2501.17887},
|
|
version = {2.0.0},
|
|
year = {2025}
|
|
}
|
|
```
|
|
|
|
## License
|
|
|
|
The Docling Serve codebase is under MIT license.
|
|
|
|
## IBM ❤️ Open Source AI
|
|
|
|
Docling has been brought to you by IBM.
|