TheSeriousProgrammer / SimpleBitNet

Related projects: ⓘ

• melisa-writer / short-transformers
  Prune transformer layers
  ☆60Updated 3 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆179Updated 6 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆158Updated 2 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 5 months ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆105Updated 3 months ago
• Entropy-xcy / bitnet158
  ☆65Updated 6 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆237Updated last week
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆217Updated 6 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆149Updated 4 months ago
• huggingface / competitions
  ☆111Updated last week
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆77Updated 5 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆45Updated 3 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆38Updated 3 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆72Updated last year
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆218Updated 7 months ago
• cognitivecomputations / spectrum
  ☆75Updated 3 weeks ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆195Updated 4 months ago
• kongds / MoRA
  MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
  ☆323Updated last month
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆170Updated 5 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆284Updated last month
• huggingface / huggingface-llama-recipes
  ☆276Updated 3 weeks ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆161Updated last week
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated 2 months ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆54Updated 9 months ago
• writer / writing-in-the-margins
  ☆82Updated 3 weeks ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆89Updated last week
• isamu-isozaki / huggingface-reading-group
  This repository's goal is to precompile all past presentations of the Huggingface reading group
  ☆42Updated 3 weeks ago
• kyegomez / MambaByte
  Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta
  ☆103Updated last week
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆195Updated last month
• ariG23498 / ft-pali-gemma
  Notebooks for fine tuning pali gemma
  ☆33Updated last month