Popular repositories Loading

1. LLMCompiler LLMCompiler Public

   [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

   Python 1.8k 123

2. SqueezeLLM SqueezeLLM Public

   [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

   Python 710 48

3. TinyAgent TinyAgent Public

   [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!

   Python 461 71

4. KVQuant KVQuant Public

   [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

   Python 392 38

5. LLM2LLM LLM2LLM Public

   [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

   Python 191 16

6. SqueezedAttention SqueezedAttention Public

   [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference

   Python 54 8