From 8c114cae95cf0a4e25ea1040ce3dd262cd53a0e5 Mon Sep 17 00:00:00 2001 From: Alex Date: Wed, 8 Nov 2023 14:33:11 +0000 Subject: [PATCH] Update How-to-use-different-LLM.md --- docs/pages/Guides/How-to-use-different-LLM.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/docs/pages/Guides/How-to-use-different-LLM.md b/docs/pages/Guides/How-to-use-different-LLM.md index f514cbb4..397b5a75 100644 --- a/docs/pages/Guides/How-to-use-different-LLM.md +++ b/docs/pages/Guides/How-to-use-different-LLM.md @@ -36,7 +36,9 @@ Note: for huggingface you can choose any model inside application/llm/huggingfac - huggingface_hkunlp/instructor-large - cohere_medium -If using Llama, set `EMBEDDINGS_NAME` to `huggingface_sentence-transformers/all-mpnet-base-v2`. Download the required model and place it in the `models/` folder. +If you want to be completely local, set `EMBEDDINGS_NAME` to `huggingface_sentence-transformers/all-mpnet-base-v2`. + +For llama.cpp Download the required model and place it in the `models/` folder. Alternatively, for local Llama setup, run `setup.sh` and choose option 1. The script handles the DocsGPT model addition.