11 Commits

Author	SHA1	Message	Date
Alex	4f5e363452	sagemaker streaming	2023-10-06 01:52:29 +01:00
Archit-Kohli	7ce1dc9069	Update huggingface.py add import torch statement ... Added import torch statement	2023-10-05 14:27:15 +05:30
Archit-Kohli	5b4e517d9d	Update huggingface.py ... Added quantization support using bitsandbytes	2023-10-05 11:03:51 +05:30
Alex	9a33bf2210	script + cpu optimisations	2023-10-01 19:16:13 +01:00
Alex	9bbf4044e0	script	2023-10-01 17:20:47 +01:00
Pavel	b47ecab1a9	llama-cpp local	2023-09-30 23:38:48 +04:00
Alex	e4be38b9f7	sagemaker + llm creator class	2023-09-29 01:09:01 +01:00
Alex	852de8bdfc	ruff linting	2023-09-27 18:01:40 +01:00
Alex	e6849b85d1	Create huggingface.py	2023-09-27 17:02:47 +01:00
Alex	025549ebf8	fixes to make it work	2023-09-26 13:00:17 +01:00
Alex	e85a583f0a	testings	2023-09-26 10:03:22 +01:00