Merge branch 'main' of github.com:lyogavin/airllm

This commit is contained in:
Yu Li
2024-07-30 22:30:22 -05:00
2 changed files with 0 additions and 8 deletions

View File

@@ -63,10 +63,6 @@ First, install the airllm pip package.
pip install airllm
```
```bash
pip install -i https://pypi.org/simple/ airllm
```
### 2. Inference
Then, initialize AirLLMLlama2, pass in the huggingface repo ID of the model being used, or the local path, and inference can be performed similar to a regular transformer model.

View File

@@ -63,10 +63,6 @@ First, install the airllm pip package.
pip install airllm
```
```bash
pip install -i https://pypi.org/simple/ airllm
```
### 2. Inference
Then, initialize AirLLMLlama2, pass in the huggingface repo ID of the model being used, or the local path, and inference can be performed similar to a regular transformer model.