Alternatives and similar repositories for mixtral-offloading

Users that are interested in mixtral-offloading are comparing it to the libraries listed below

• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,477Updated 6 months ago
• huggingface / optimum-nvidia
  ☆961Updated 3 months ago
• myshell-ai / JetMoE
  Reaching LLaMA2 Performance with 0.1M Dollars
  ☆980Updated 9 months ago
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,948Updated last month
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,646Updated last week
• DLYuanGod / TinyGPT-V
  TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones
  ☆1,284Updated last year
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,381Updated last year
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,377Updated last week
• mistralai / megablocks-public
  ☆864Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆711Updated last year
• FasterDecoding / Medusa
  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
  ☆2,522Updated 10 months ago
• Vahe1994 / AQLM
  Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.p…
  ☆1,254Updated last week
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,111Updated 11 months ago
• MDK8888 / GPTFast
  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
  ☆683Updated 8 months ago
• openai / transformer-debugger
  ☆4,079Updated 11 months ago
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,780Updated 4 months ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,880Updated 10 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,580Updated this week
• ise-uiuc / magicoder
  [ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct
  ☆2,018Updated 6 months ago
• mistralai-sf24 / hackathon
  ☆444Updated last year
• apple / axlearn
  An Extensible Deep Learning Library
  ☆2,051Updated this week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,870Updated this week
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,553Updated 6 months ago
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,173Updated 2 weeks ago
• intel / intel-extension-for-transformers
  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…
  ☆2,171Updated 7 months ago
• mbzuai-oryx / MobiLlama
  MobiLlama : Small Language Model tailored for edge devices
  ☆636Updated last week
• facebookresearch / MobileLLM
  MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
  ☆1,295Updated 3 weeks ago
• McGill-NLP / webllama
  Llama-3 agents that can browse the web by following instructions and talking to you
  ☆1,401Updated 5 months ago
• marella / ctransformers
  Python bindings for the Transformer models implemented in C/C++ using GGML library.
  ☆1,864Updated last year
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,261Updated 2 months ago