SqueezeAILab / LLMCompilerLinks
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
☆1,704Updated 11 months ago
Alternatives and similar repositories for LLMCompiler
Users that are interested in LLMCompiler are comparing it to the libraries listed below
Sorting:
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,511Updated last month
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆2,113Updated last year
- Efficient Retrieval Augmentation and Generation Framework☆1,578Updated 5 months ago
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,836Updated last year
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,191Updated 3 months ago
- Open-source tool to visualise your RAG 🔮☆1,136Updated 5 months ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,821Updated 4 months ago
- YaRN: Efficient Context Window Extension of Large Language Models☆1,499Updated last year
- Training LLMs with QLoRA + FSDP☆1,487Updated 7 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,897Updated 10 months ago
- Llama-3 agents that can browse the web by following instructions and talking to you☆1,404Updated 6 months ago
- Chat language model that can use tools and interpret the results☆1,563Updated last week
- A comprehensive guide to building RAG-based LLM applications for production.☆1,798Updated 10 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,459Updated 3 weeks ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,028Updated last month
- The official implementation of Self-Play Fine-Tuning (SPIN)☆1,166Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,773Updated this week
- Reaching LLaMA2 Performance with 0.1M Dollars☆983Updated 11 months ago
- A framework for prompt tuning using Intent-based Prompt Calibration☆2,626Updated 2 months ago
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,386Updated last year
- AgentTuning: Enabling Generalized Agent Abilities for LLMs☆1,447Updated last year
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆2,627Updated 4 months ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆778Updated 3 months ago
- Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"☆2,397Updated 6 months ago
- ☆463Updated last year
- ☆900Updated 9 months ago
- Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"☆1,033Updated 4 months ago
- LLMPerf is a library for validating and benchmarking LLMs☆947Updated 6 months ago
- Customizable implementation of the self-instruct paper.☆1,045Updated last year
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,260Updated 3 months ago