lyogavin / airllm

Related projects ⓘ

Alternatives and complementary repositories for airllm

• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
  ☆7,965Updated 2 months ago
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆4,816Updated 2 weeks ago
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆6,127Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆4,653Updated this week
• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆7,261Updated this week
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆7,919Updated 6 months ago
• QwenLM / Qwen-Agent
  Agent framework and applications built upon Qwen>=2.0, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.
  ☆3,505Updated last month
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆4,669Updated this week
• InternLM / xtuner
  An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
  ☆3,977Updated last week
• deepseek-ai / DeepSeek-V2
  DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
  ☆3,597Updated last month
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,497Updated last month
• deepseek-ai / DeepSeek-Coder
  DeepSeek Coder: Let the Code Write Itself
  ☆6,842Updated 6 months ago
• turboderp / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆3,680Updated this week
• letta-ai / letta
  Letta (formerly MemGPT) is a framework for creating LLM services with memory.
  ☆12,838Updated this week
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,294Updated 7 months ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆2,846Updated 2 weeks ago
• pytorch / torchtune
  PyTorch native finetuning library
  ☆4,336Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,059Updated 5 months ago
• xlang-ai / OpenAgents
  [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild
  ☆3,996Updated this week
• bklieger-groq / g1
  g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
  ☆3,906Updated last month
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆13,971Updated this week
• dottxt-ai / outlines
  Structured Text Generation
  ☆9,487Updated this week
• agiresearch / AIOS
  AIOS: LLM Agent Operating System
  ☆3,416Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!
  ☆3,256Updated 3 months ago
• FlagOpen / FlagEmbedding
  Retrieval and Retrieval-augmented LLMs
  ☆7,613Updated this week
• mistralai / mistral-finetune
  ☆2,746Updated 2 months ago
• InternLM / InternLM
  Official release of InternLM2.5 base and chat models. 1M context support
  ☆6,482Updated this week
• hiyouga / LLaMA-Factory
  Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
  ☆34,589Updated this week
• openai / transformer-debugger
  ☆4,035Updated 5 months ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆7,930Updated this week