Nikityyy / lilleLinks
A powerful 130-million-parameter model trained from scratch as part of a truly open-source stack, including a custom tokenizer, dataset, and optimizer.
☆68Updated 4 months ago
Alternatives and similar repositories for lille
Users that are interested in lille are comparing it to the libraries listed below
Sorting:
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Updated last year
- A little(lil) Language Model (LM). A tiny reproduction of LLaMA 3's model architecture.☆54Updated 8 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆47Updated 2 months ago
- Testing LLM reasoning abilities with family relationship quizzes.☆63Updated 11 months ago
- Sparse Inferencing for transformer based LLMs☆216Updated 5 months ago
- ☆108Updated 6 months ago
- ☆137Updated last year
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- Docs for GGUF quantization (unofficial)☆347Updated 5 months ago
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆346Updated last year
- ☆334Updated 5 months ago
- look how they massacred my boy☆63Updated last year
- Easily view and modify JSON datasets for large language models☆86Updated 7 months ago
- Implementation snake game based on Diffusion model☆92Updated last year
- AI management tool☆121Updated last year
- Fast parallel LLM inference for MLX☆241Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated last week
- GRadient-INformed MoE☆264Updated last year
- Live-bending a foundation model’s output at neural network level.☆271Updated 9 months ago
- ☆62Updated 6 months ago
- Clue inspired puzzles for testing LLM deduction abilities☆45Updated 9 months ago
- ☆135Updated 8 months ago
- Exploration into the proposed architecture from Sapient Intelligence of Singapore 🇸🇬☆73Updated 4 months ago
- ☆122Updated 6 months ago
- A pipeline parallel training script for LLMs.☆165Updated 8 months ago
- A character-level language diffusion model trained on Tiny Shakespeare☆824Updated last week
- ☆34Updated 9 months ago
- An introduction to LLM Sampling☆79Updated last year
- From-scratch implementation of OpenAI's GPT-OSS model in Python. No Torch, No GPUs.☆107Updated 2 months ago
- ☆104Updated 2 months ago