LLM/airllm
1
0
Fork 0
mirror of https://github.com/0xSojalSec/airllm.git synced 2026-03-07 22:33:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge branch 'main' of github.com:lyogavin/Anima into main

Browse Source
This commit is contained in:
Yu Li
2023-11-30 09:12:45 -06:00
parent a1325e77c5 04da4fcfe9
commit a450d1ffb2
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
air_llm/README.md
View File

@@ -54,7 +54,7 @@ input_tokens = model.tokenizer(input_text,
generation_output = model.generate(
input_tokens['input_ids'].cuda(),
max_new_tokens=2,
max_new_tokens=20,
use_cache=True,
return_dict_in_generate=True)