diff --git a/air_llm/README.md b/air_llm/README.md index c1a104b..61a4480 100644 --- a/air_llm/README.md +++ b/air_llm/README.md @@ -293,6 +293,20 @@ Some models are gated models, needs huggingface api token. You can provide hf_to model = AirLLMLlama2("meta-llama/Llama-2-7b-hf", #hf_token='HF_API_TOKEN') ``` +### 4. ValueError: Asking to pad but the tokenizer does not have a padding token. + +Some model's tokenizer doesn't have padding token, so you can set a padding token or simply turn the padding config off: + + ```python +input_tokens = model.tokenizer(input_text, + return_tensors="pt", + return_attention_mask=False, + truncation=True, + max_length=MAX_LENGTH, + padding=False #<----------- turn off padding +) +``` + ## Contribution diff --git a/assets/wechat_group.png b/assets/wechat_group.png index 424efee..bb47c2a 100644 Binary files a/assets/wechat_group.png and b/assets/wechat_group.png differ