Alternatives and similar repositories for psychic-garbanzo

Users that are interested in psychic-garbanzo are comparing it to the libraries listed below

• wjytt / bug-free-pancake
  ☆10Updated 4 months ago
• tflowdev / upgraded-happiness
  ☆10Updated 4 months ago
• nectere-sdk / congenial-goggles
  ☆10Updated 4 months ago
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆371Updated last year
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆810Updated this week
• aarnphm / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆331Updated 5 months ago
• Vahe1994 / SpQR
  ☆543Updated 5 months ago
• Cornell-RelaxML / QuIP
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"
  ☆363Updated last year
• OpenGVLab / OmniQuant
  [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
  ☆805Updated 7 months ago
• IST-DASLab / sparsegpt
  Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".
  ☆793Updated 8 months ago
• mbzuai-oryx / MobiLlama
  MobiLlama : Small Language Model tailored for edge devices
  ☆638Updated last week
• Cornell-RelaxML / quip-sharp
  ☆531Updated 6 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆698Updated last year
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆746Updated 9 months ago
• IST-DASLab / gptq
  Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
  ☆2,104Updated last year
• kyegomez / LongNet
  Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
  ☆704Updated last year
• wibowok07 / Tran
  ☆11Updated last year
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆653Updated 11 months ago
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,248Updated 2 months ago
• microsoft / MInference
  [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…
  ☆1,026Updated this week
• mistralai / megablocks-public
  ☆863Updated last year
• JohnS455 / tait
  ☆10Updated last year
• FuelLabs / fuel-core
  Rust full node implementation of the Fuel v2 protocol.
  ☆57,651Updated this week
• jondurbin / bagel
  A bagel, with everything.
  ☆320Updated last year
• mit-han-lab / TinyChatEngine
  TinyChatEngine: On-Device LLM Inference Library
  ☆848Updated 10 months ago
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆822Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆711Updated last year
• FuelLabs / fuels-rs
  Fuel Network Rust SDK
  ☆43,770Updated this week
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆725Updated 7 months ago
• RahulSChand / gpu_poor
  Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
  ☆1,304Updated 5 months ago