CohleM / lilLMLinks
A little(lil) Language Model (LM). A tiny reproduction of LLaMA 3's model architecture.
☆55Updated 9 months ago
Alternatives and similar repositories for lilLM
Users that are interested in lilLM are comparing it to the libraries listed below
Sorting:
- ☆242Updated 4 months ago
- Testing LLM reasoning abilities with family relationship quizzes.☆63Updated last year
- ☆159Updated 9 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated last month
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆201Updated last year
- 1.58-bit LLaMa model☆82Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆180Updated last year
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆261Updated last year
- ☆112Updated 7 months ago
- Train your own small bitnet model☆77Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆110Updated 11 months ago
- REAP: Router-weighted Expert Activation Pruning for SMoE compression☆232Updated 2 months ago
- A compact LLM pretrained in 9 days by using high quality data☆339Updated 10 months ago
- ☆137Updated last year
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆112Updated 8 months ago
- AI management tool☆119Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'☆240Updated last year
- ☆109Updated 5 months ago
- Fast parallel LLM inference for MLX☆246Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆232Updated last year
- ☆142Updated 5 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆49Updated 3 months ago
- ☆135Updated 9 months ago
- Easily view and modify JSON datasets for large language models☆87Updated 8 months ago
- Inference RWKV v7 in pure C.☆44Updated 4 months ago
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆157Updated 7 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆155Updated last year
- Docs for GGUF quantization (unofficial)☆366Updated 6 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆73Updated 9 months ago