mirror of
https://github.com/docling-project/docling-serve.git
synced 2026-03-20 07:51:36 +00:00
Add poetry install shell cmd to the readme (#7)
* Add poetry install shell cmd to the readme Signed-off-by: Brent Salisbury <bsalisbu@redhat.com> * Add GPU support instructions - Validated on an EC2 GPU instance to work. - Closes #8 Signed-off-by: Brent Salisbury <bsalisbu@redhat.com> * Update README.md Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com> --------- Signed-off-by: Brent Salisbury <bsalisbu@redhat.com> Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com> Co-authored-by: Anil Vishnoi <vishnoianil@gmail.com>
This commit is contained in:
24
README.md
24
README.md
@@ -10,6 +10,9 @@
|
||||
Install the dependencies
|
||||
|
||||
```sh
|
||||
# Install poetry if not already available
|
||||
curl -sSL https://install.python-poetry.org | python3 -
|
||||
|
||||
# Install dependencies
|
||||
poetry install
|
||||
|
||||
@@ -30,3 +33,24 @@ curl -X 'POST' \
|
||||
}
|
||||
}'
|
||||
```
|
||||
|
||||
### Cuda GPU Support
|
||||
|
||||
For GPU support try the following:
|
||||
|
||||
```sh
|
||||
# Create a virtual env
|
||||
python3 -m venv venv
|
||||
|
||||
# Activate the venv
|
||||
source venv/bin/active
|
||||
|
||||
# Install torch with the special index
|
||||
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124
|
||||
|
||||
# Install the package
|
||||
pip install -e .
|
||||
|
||||
# Run the server
|
||||
poetry run uvicorn docling_serve.app:app --reload
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user