SqueezeAILab / LLMCompiler
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
☆1,580Updated 6 months ago
Alternatives and similar repositories for LLMCompiler:
Users that are interested in LLMCompiler are comparing it to the libraries listed below
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,172Updated 4 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,654Updated 5 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,879Updated this week
- Code for Quiet-STaR☆698Updated 4 months ago
- ☆2,289Updated this week
- [ICML 2024] Official repository for "Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models"☆724Updated 5 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,812Updated last month
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,666Updated 3 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆965Updated 5 months ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,311Updated this week
- Open-source tool to visualise your RAG 🔮☆1,097Updated 2 weeks ago
- YaRN: Efficient Context Window Extension of Large Language Models☆1,398Updated 9 months ago
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆1,930Updated 7 months ago
- Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"☆2,245Updated last month
- ☆774Updated 4 months ago
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,777Updated 11 months ago
- Chat language model that can use tools and interpret the results☆1,499Updated this week
- Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.☆687Updated 4 months ago
- Training LLMs with QLoRA + FSDP☆1,436Updated 2 months ago
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,358Updated 9 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆684Updated 9 months ago
- Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhan…☆548Updated 7 months ago
- Llama-3 agents that can browse the web by following instructions and talking to you☆1,382Updated last month
- [NeurIPS'24 Spotlight] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces in…☆874Updated 2 weeks ago
- ReFT: Representation Finetuning for Language Models☆1,373Updated 2 weeks ago
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆949Updated 2 months ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆841Updated last month
- [NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge a…☆1,511Updated last week
- Tools for merging pretrained large language models.☆5,113Updated last week