15 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Vik Paruchuri	8c1bfe277f	Set proper batch sizes v0.1.5	2025-10-21 11:43:09 -04:00
Vik Paruchuri	ad6508fbc3	Fix vllm token v0.1.4	2025-10-21 11:33:56 -04:00
Vik Paruchuri	2e455aeb2c	Fix attn impl v0.1.3	2025-10-21 11:15:29 -04:00
Vik Paruchuri	812af690ce	Fix up repo v0.1.1	2025-10-21 10:40:19 -04:00
Vik Paruchuri	234f7df4ed	Fix license and README	2025-10-21 09:27:09 -04:00
Vik Paruchuri	1c8d63fa5a	Add examples	2025-10-20 20:34:18 -04:00
Vik Paruchuri	417d210904	Cleanups	2025-10-20 16:58:52 -04:00
Vik Paruchuri	98989faae4	Initial benchmarks	2025-10-20 15:11:12 -04:00
Vik Paruchuri	313f9c71b8	Enable robustness	2025-10-18 23:08:04 -04:00
Vik Paruchuri	6d093af119	Add precommit	2025-10-16 21:21:01 -04:00
Vik Paruchuri	bb1fd39a46	Support returning token count	2025-10-16 20:19:43 -04:00
Vik Paruchuri	aa59df2996	Inference fixes	2025-10-16 13:22:32 -04:00
Vik Paruchuri	a9ffa789c6	Refactor	2025-10-15 16:06:57 -04:00
Vik Paruchuri	d511d5f9a6	Fixed docs	2025-10-08 17:37:12 -04:00
Vik Paruchuri	17b1b03bde	Initial commit	2025-10-08 17:34:01 -04:00