30 Commits

Author	SHA1	Message	Date
Alex	481df4d604	fix: enhance error logging with exception info across multiple modules	2025-05-05 13:12:39 +01:00
Pavel	fddee69f92	web loader fix ... Changes web loader to the correct output.	2025-01-17 19:13:23 +03:00
Pavel	13fcbe3e74	scraper with markdownify	2025-01-15 01:08:09 +03:00
Alex	2245f4690e	fix: reddit loader validation	2024-11-15 11:02:27 +00:00
devendra.parihar	d3238de8ab	fix: lint error	2024-10-18 12:23:17 +05:30
devendra.parihar	09a2705311	fix:GitHubLoader to Handle Binary Files	2024-10-18 12:08:08 +05:30
devendra.parihar	a4c0861cf4	fix:GitHubLoader to Handle Binary Files	2024-10-18 12:07:44 +05:30
Alex	6932c7e3e9	feat: add filename to the top	2024-10-05 21:56:47 +01:00
Alex	c04687fdd1	fix: github loader metadata clickable	2024-10-05 21:53:30 +01:00
Alex	7717242112	fix(lint): ruff var	2024-10-05 21:37:55 +01:00
Alex	1ad82c22d9	fix: headers	2024-10-05 21:36:04 +01:00
Alex	8fa88175c1	fix: translation + auth	2024-10-05 21:33:58 +01:00
Alex	2611550ffd		2024-10-02 23:44:29 +01:00
Alex	c49b7613e0	fix: langchain warning	2024-08-31 12:53:37 +01:00
Siddhant Rai	53e86205ad	fix: added more headers from default	2024-05-03 18:47:30 +05:30
Siddhant Rai	aa670efe3a	fix: connection aborted in WebBaseLoader	2024-05-03 18:25:01 +05:30
Siddhant Rai	e01071426f	feat: field to pass number of posts as a parameter	2024-03-27 19:20:55 +05:30
Siddhant Rai	eed1bfbe50	feat: fields to handle reddit loader + minor changes	2024-03-26 16:07:44 +05:30
Siddhant Rai	60cfea1126	feat: added reddit loader	2024-03-16 20:22:05 +05:30
Pavel	54d187a0ad	Fixing ingestion metadata grouping	2024-02-28 19:52:58 +03:00
Alex	0cb3d12d94	Refactor loader classes to accept inputs directly	2024-02-14 15:17:56 +00:00
Pavel	381a2740ee	change input	2023-10-13 21:52:56 +04:00
Pavel	024674eef3	List check	2023-10-13 11:42:42 +04:00
Pavel	b7d88b4c0f	fix wrong link	2023-10-12 19:45:36 +04:00
Pavel	719ca63ec1	fixes	2023-10-12 19:40:23 +04:00
Pavel	2cfb416fd0	Desc loader	2023-10-12 13:44:32 +04:00
Pavel	50f07f9ef5	limit crawler	2023-10-12 12:53:33 +04:00
Pavel	c517bdd2e1	Crawler + sitemap	2023-10-12 12:35:26 +04:00
Pavel	658867cb46	No crawler, no sitemap	2023-10-12 01:03:40 +04:00
Alex	8f2ad38503	tests	2023-10-11 10:13:51 +01:00