Cerebras / gigaGPTLinks
a small code base for training large models
☆301Updated last month
Alternatives and similar repositories for gigaGPT
Users that are interested in gigaGPT are comparing it to the libraries listed below
Sorting:
- Open weights language model from Google DeepMind, based on Griffin.☆641Updated 3 weeks ago
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…☆345Updated 10 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- Inference code for Persimmon-8B☆415Updated last year
- Fast bare-bones BPE for modern tokenizer training☆159Updated 2 months ago
- ☆303Updated last year
- ☆92Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆231Updated 7 months ago
- ☆864Updated last year
- Visualize the intermediate output of Mistral 7B☆367Updated 5 months ago
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆206Updated 7 months ago
- ☆415Updated last year
- The repository for the code of the UltraFastBERT paper☆516Updated last year
- run paligemma in real time☆131Updated last year
- ☆541Updated 7 months ago
- PyTorch implementation of models from the Zamba2 series.☆182Updated 5 months ago
- ☆542Updated 10 months ago
- Inference of Mamba models in pure C☆187Updated last year
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆239Updated 4 months ago
- RWKV in nanoGPT style☆191Updated last year
- Full finetuning of large language models without large memory requirements☆94Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆714Updated last year
- A repository for research on medium sized language models.☆498Updated 2 weeks ago
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆239Updated last year
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 8 months ago
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"☆370Updated last year
- Long context evaluation for large language models☆217Updated 3 months ago
- ☆199Updated last year
- Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"☆554Updated 5 months ago