Add poetry install shell cmd to the readme (#7)

* Add poetry install shell cmd to the readme

Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>

* Add GPU support instructions

- Validated on an EC2 GPU instance to work.
- Closes #8

Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>

* Update README.md

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>

---------

Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>
Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>
Co-authored-by: Anil Vishnoi <vishnoianil@gmail.com>
This commit is contained in:
Brent Salisbury
2024-10-11 02:41:50 -04:00
committed by GitHub
parent ac3518c34c
commit 3824aa6b2f

View File

@@ -10,6 +10,9 @@
Install the dependencies
```sh
# Install poetry if not already available
curl -sSL https://install.python-poetry.org | python3 -
# Install dependencies
poetry install
@@ -30,3 +33,24 @@ curl -X 'POST' \
}
}'
```
### Cuda GPU Support
For GPU support try the following:
```sh
# Create a virtual env
python3 -m venv venv
# Activate the venv
source venv/bin/active
# Install torch with the special index
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124
# Install the package
pip install -e .
# Run the server
poetry run uvicorn docling_serve.app:app --reload
```