Alternatives and similar repositories for airllm

Users that are interested in airllm are comparing it to the libraries listed below

• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,364Updated 3 months ago
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆7,265Updated this week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,531Updated 5 months ago
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,447Updated 2 weeks ago
• InternLM / xtuner
  A Next-Generation Training Engine Built for Ultra-Large MoE Models
  ☆4,988Updated this week
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,988Updated 7 months ago
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆6,124Updated 3 weeks ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆10,798Updated this week
• meta-pytorch / torchtune
  PyTorch native post-training library
  ☆5,584Updated last week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,585Updated 3 weeks ago
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,388Updated 3 months ago
• togethercomputer / MoA
  Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
  ☆2,835Updated 10 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,927Updated last week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,201Updated this week
• FlagOpen / FlagEmbedding
  Retrieval and Retrieval-augmented LLMs
  ☆10,844Updated 3 weeks ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆7,122Updated last year
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆9,487Updated last month
• casper-hansen / AutoAWQ
  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
  ☆2,269Updated 6 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,735Updated 3 months ago
• zai-org / CogVLM
  a state-of-the-art-level open visual language model | 多模态预训练模型
  ☆6,689Updated last year
• RahulSChand / gpu_poor
  Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
  ☆1,380Updated 11 months ago
• imoneoi / openchat
  OpenChat: Advancing Open-source Language Models with Imperfect Data
  ☆5,439Updated last year
• InternLM / lagent
  A lightweight framework for building LLM-based agents
  ☆2,202Updated 3 months ago
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,952Updated 2 months ago
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,541Updated 2 weeks ago
• zai-org / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,423Updated 8 months ago
• AIDC-AI / Marco-o1
  An Open Large Reasoning Model for Real-World Solutions
  ☆1,527Updated 5 months ago
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,587Updated last week
• InternLM / InternLM
  Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
  ☆7,108Updated 2 weeks ago
• X-PLUG / mPLUG-DocOwl
  mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
  ☆2,260Updated 5 months ago