LLM/airllm
1
0
Fork 0
mirror of https://github.com/0xSojalSec/airllm.git synced 2026-03-07 22:33:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

update readme

Browse Source
This commit is contained in:
Yu Li
2023-12-01 21:21:50 -06:00
parent bb62d8d62c
commit 953490ed81
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
air_llm/README.md
View File

@@ -92,9 +92,9 @@ We just added model compression based on block-wise quantization based model com
* Step 3. when initialize the model, passing the argument compression ('4bit' or '8bit'):
```python
model = AirLLMLlama2("garage-bAInd/Platypus2-70B-instruct"
compression='4bit' # specify '8bit' for 8-bit block-wise quantization
)
model = AirLLMLlama2("garage-bAInd/Platypus2-70B-instruct",
compression='4bit' # specify '8bit' for 8-bit block-wise quantization
)
```
### 4. All supported configurations