NolanoOrg / llama-int4-quant

Related projects ⓘ

Alternatives and complementary repositories for llama-int4-quant

• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆98Updated 11 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆15Updated 3 weeks ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• Narsil / bloomserver
  ☆36Updated 2 years ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆19Updated 4 months ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆102Updated last year
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆44Updated this week
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 8 months ago
• catid / lllm
  Latent Large Language Models
  ☆16Updated 2 months ago
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated last year
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆43Updated 5 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 7 months ago
• lachlansneff / sparsellama
  ☆40Updated last year
• NousResearch / StripedHyenaTrainer
  ☆57Updated 11 months ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• AUGMXNT / llm-experiments
  Experiments w/ ChatGPT, LangChain, local LLMs
  ☆24Updated last year
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆44Updated last year
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆44Updated 2 weeks ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆51Updated 9 months ago
• cccntu / LoRAnanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆18Updated last year
• kyegomez / SelfExtend
  Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
  ☆13Updated last week
• NolanoOrg / InstructLLaMa.cpp
  Fast inference of Instruct tuned LLaMa on your personal devices.
  ☆22Updated last year
• mrsteyk / RWKV-LM-deepspeed
  ☆42Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated 10 months ago
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• NolanoOrg / SpectraSuite
  ☆43Updated 4 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆36Updated 9 months ago