LLM/airllm
1
0
Fork 0
mirror of https://github.com/0xSojalSec/airllm.git synced 2026-03-07 22:33:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md, increase max_new_tokens

Browse Source
This commit is contained in:
Gavin Li
2023-11-29 20:14:41 -06:00
committed by GitHub
parent 456e4f09b5
commit 04da4fcfe9
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
air_llm/README.md
View File

@@ -54,7 +54,7 @@ input_tokens = model.tokenizer(input_text,
generation_output = model.generate(
input_tokens['input_ids'].cuda(),
max_new_tokens=2,
max_new_tokens=20,
use_cache=True,
return_dict_in_generate=True)