CohleM / lilLMLinks
A little(lil) Language Model (LM). A tiny reproduction of LLaMA 3's model architecture.
☆54Updated 8 months ago
Alternatives and similar repositories for lilLM
Users that are interested in lilLM are comparing it to the libraries listed below
Sorting:
- Testing LLM reasoning abilities with family relationship quizzes.☆63Updated 11 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- AI management tool☆121Updated last year
- ☆108Updated 4 months ago
- Docs for GGUF quantization (unofficial)☆343Updated 5 months ago
- ☆108Updated 6 months ago
- ☆243Updated 3 months ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆192Updated last year
- 1.58-bit LLaMa model☆83Updated last year
- ☆135Updated 8 months ago
- Train your own small bitnet model☆76Updated last year
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆259Updated last year
- Easily view and modify JSON datasets for large language models☆86Updated 7 months ago
- ☆158Updated 8 months ago
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆150Updated 6 months ago
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- A powerful 130-million-parameter model trained from scratch as part of a truly open-source stack, including a custom tokenizer, dataset, …☆68Updated 4 months ago
- 1.58 Bit LLM on Apple Silicon using MLX☆234Updated last year
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆47Updated 2 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆201Updated last year
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆104Updated 7 months ago
- A fast batching API to serve LLM models☆189Updated last year
- A compact LLM pretrained in 9 days by using high quality data☆340Updated 9 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆240Updated last year
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Updated last year
- ☆51Updated 10 months ago
- ☆137Updated last year
- Enhancing LLMs with LoRA☆204Updated 2 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated last week
- ☆20Updated last year