52 Commits

Author	SHA1	Message	Date
Pavel	7140f2cd70	Backend ... I have removed the hardcoded part for the all-mpnet-base-v2 and substituted it with a separate EMBEDDINGS_PATH variable. Now the user is able to pre-download the embeddings (similarly to the recomended way with all-mpnet-base-v2) and also leave it to sentence-transformers without needing to touch vectorstore/base.py	2025-06-21 16:19:42 +02:00
Siddhant Rai	381d737d24	fix: correct vectorstore path in get_vectorstore function	2025-06-03 15:14:00 +05:30
Siddhant Rai	773788fb32	fix: correct vectorstore path and improve file existence checks in FaissStore	2025-05-30 14:30:51 +05:30
Alex	63c6912841	lazy load elasticsearch	2025-05-14 21:45:30 +01:00
Alex	39b36b6857	Feat: Add MD gen script, enable Qdrant lazy loading	2025-05-13 14:03:05 +01:00
Alex	481df4d604	fix: enhance error logging with exception info across multiple modules	2025-05-05 13:12:39 +01:00
ManishMadan2882	0ce27f274a	(feat:storage) file indexes/faiss	2025-04-23 04:28:45 +05:30
ManishMadan2882	24c8b24b1f	Revert "(fix:indexes) look for the right path" ... This reverts commit 5ad34e2216.	2025-04-23 00:52:22 +05:30
ManishMadan2882	5ad34e2216	(fix:indexes) look for the right path	2025-04-22 17:34:25 +05:30
Siddhant Rai	3a51922650	fix: linting error	2025-02-08 15:00:02 +05:30
Siddhant Rai	0fc9718c35	feat: loading state and spinner + delete chunk option	2025-02-08 14:52:32 +05:30
Siddhant Rai	0379b81d43	feat: view and add document chunks for mongodb and faiss	2025-02-07 19:39:07 +05:30
Michele Grimaldi	2f78398914	Fixing issues #1445 (#1603) ... * Fixing issues #1445 * Fixed issue #1445	2025-02-05 08:52:18 +00:00
ChengZi	171916e1a4	fix milvus issues ... Signed-off-by: ChengZi <chen.zhang@zilliz.com>	2024-11-04 17:58:56 +08:00
Alex	fd8e277530	Merge branch 'main' into feature_n/lancedb	2024-10-19 16:22:39 +01:00
akashmangoai	a9f6a06446	lazy import & fixed other issue	2024-10-11 22:58:18 +05:30
devendra.parihar	7794129929	new: added ExcelParser(tested) to read .xlsx files	2024-10-01 22:03:10 +05:30
Siddhant Rai	3d292aa485	feat: sync remote sources through celery periodic tasks	2024-09-25 15:20:11 +05:30
akashAD98	7e75513151	added support for lacedb as vectordb	2024-09-12 18:51:29 +05:30
Alex	44d225e6ca	Merge branch 'main' into 1059-migrating-database-to-new-model	2024-09-09 23:55:25 +01:00
Alex	444d50f751	fix: faiss source name	2024-09-09 16:43:20 +01:00
Alex	2f9c72c1cf	feat: migrate store to source_id	2024-09-09 15:46:18 +01:00
Alex	a353e69648	feat: new vectors structure	2024-09-08 16:59:51 +01:00
Alex	d232229abf	feat Milvus integration	2024-09-05 23:41:51 +01:00
Jackson	6c583eedb9	Merge branch 'arc53:main' into Jackson	2024-07-30 17:45:06 +08:00
Jacksonxhx	1c4d7a6ad1	integrated milvus db	2024-07-30 17:44:27 +08:00
Alex	0f059f247d	fix: ruff lint	2024-07-16 12:28:43 +01:00
Alex	3454309cbc	chore: Refactor embeddings instantiation to use a singleton pattern	2024-06-14 12:58:35 +01:00
Alex	5c8133a810	chore: Update Docker build platforms for application and frontend and optimised embedding import	2024-05-18 12:10:24 +01:00
Anush008	75c0cadb50	feat: Qdrant vector store	2024-02-28 11:49:15 +05:30
Alex	a2418d1373	Add sentence-transformers library to requirements.txt and comment out model_name in base.py	2024-01-29 20:51:28 +00:00
Anton Larin	9e04b7796a	application folder related changes: ... * optimize content of requirements.txt * upgrade libs * fix imports	2024-01-27 16:25:19 +01:00
Alex	b3461b7134	Add MPNet model and update vector store for Hugging Face embeddings	2024-01-09 11:39:32 +00:00
Alex	4ff834de76	Refactor MongoDBVectorStore and add delete_index method	2024-01-06 17:59:01 +00:00
Alex	293b7b09a9	init tests	2024-01-05 17:16:16 +00:00
Shivanand	21ba1e3958	Merge branch 'main' into faiss_delete_index	2023-10-17 17:35:30 +05:30
asoderlind	e73636bef3	remove trailing whitespace, sort imports, remove unused arguments	2023-10-16 11:22:42 +02:00
asoderlind	0ca96130c8	remove trailing whitespace	2023-10-15 10:23:09 +02:00
asoderlind	60cd6a455a	refactor	2023-10-15 10:22:00 +02:00
asoderlind	4752ce5250	fix linting error	2023-10-15 09:12:00 +02:00
asoderlind	9b6ae46e92	raise more legible error if the embedding vector dims don't match	2023-10-12 20:24:25 +02:00
shivanandmn	ca3e549dd4	added delete index of vector store in faiss	2023-10-12 13:29:52 +05:30
Alex	17edaa0e1f	Update faiss.py	2023-10-06 16:05:10 +01:00
John Bampton	034d73a4eb	misc: fix spelling	2023-10-04 05:18:15 +10:00
Alex	6045cbbc62	Merge pull request #355 from arc53/feature/cpu-llm ... llama-cpp local	2023-10-01 17:55:26 +01:00
Alex	9bbf4044e0	script	2023-10-01 17:20:47 +01:00
Alex	d85eb83ea2	elastic search fixes	2023-09-30 15:25:31 +01:00
Alex	347cfe253f	elastic2	2023-09-29 17:17:48 +01:00
Alex	783e7f6939	working es	2023-09-29 00:32:19 +01:00
Alex	852de8bdfc	ruff linting	2023-09-27 18:01:40 +01:00