lyogavin / airllm

Related projects ⓘ

Alternatives and complementary repositories for airllm

• FlagOpen / FlagEmbedding
  Retrieval and Retrieval-augmented LLMs
  ☆7,487Updated this week
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆7,848Updated 6 months ago
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆5,984Updated this week
• InternLM / xtuner
  An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
  ☆3,944Updated this week
• unslothai / unsloth
  Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory
  ☆18,024Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆4,798Updated last week
• QwenLM / Qwen-Agent
  Agent framework and applications built upon Qwen>=2.0, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.
  ☆3,443Updated last month
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆4,618Updated this week
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,469Updated last month
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆10,658Updated this week
• meta-llama / llama-recipes
  Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom dataset…
  ☆15,024Updated this week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆7,875Updated this week
• OpenBMB / MiniCPM-V
  MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone
  ☆12,536Updated 3 weeks ago
• InternLM / InternLM
  Official release of InternLM2.5 base and chat models. 1M context support
  ☆6,445Updated last month
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆29,913Updated this week
• turboderp / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆3,636Updated this week
• xlang-ai / OpenAgents
  [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild
  ☆3,986Updated 4 months ago
• xorbitsai / inference
  Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you ne…
  ☆5,334Updated this week
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆5,969Updated 2 weeks ago
• QwenLM / Qwen2.5
  Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud.
  ☆9,445Updated this week
• OpenBMB / MiniCPM
  MiniCPM3-4B: An edge-side LLM that surpasses GPT-3.5-Turbo.
  ☆7,110Updated last week
• deepseek-ai / DeepSeek-LLM
  DeepSeek LLM: Let there be answers
  ☆1,439Updated 9 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,097Updated last week
• pytorch / torchtune
  PyTorch native finetuning library
  ☆4,290Updated this week
• OpenBMB / ToolBench
  [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
  ☆4,825Updated last month
• open-compass / opencompass
  OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …
  ☆4,089Updated this week
• THUDM / CogVLM
  a state-of-the-art-level open visual language model | 多模态预训练模型
  ☆6,075Updated 5 months ago
• deepseek-ai / DeepSeek-V2
  DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
  ☆3,578Updated last month
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,041Updated 5 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,026Updated this week