LLM/airllm
1
0
Fork 0
mirror of https://github.com/0xSojalSec/airllm.git synced 2026-03-07 22:33:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

update readme

Browse Source
This commit is contained in:
Yu Li
2023-12-01 21:22:56 -06:00
parent 2bacae2b71
commit 16e0942e2e
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
air_llm/README.md
View File

@@ -93,7 +93,7 @@ We just added model compression based on block-wise quantization based model com
```python
model = AirLLMLlama2("garage-bAInd/Platypus2-70B-instruct",
compression='4bit' # specify '8bit' for 8-bit block-wise quantization
compression='4bit' # specify '8bit' for 8-bit block-wise quantization
)
```