Nikityyy / lilleLinks
A powerful 130-million-parameter model trained from scratch as part of a truly open-source stack, including a custom tokenizer, dataset, and optimizer.
☆67Updated 2 months ago
Alternatives and similar repositories for lille
Users that are interested in lille are comparing it to the libraries listed below
Sorting:
- A little(lil) Language Model (LM). A tiny reproduction of LLaMA 3's model architecture.☆52Updated 6 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated 3 weeks ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆145Updated 8 months ago
- Implementation snake game based on Diffusion model☆91Updated 9 months ago
- ☆104Updated 4 months ago
- AI management tool☆121Updated 11 months ago
- Testing LLM reasoning abilities with family relationship quizzes.☆62Updated 9 months ago
- ☆136Updated last year
- GRadient-INformed MoE☆264Updated last year
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆80Updated last year
- ☆118Updated 4 months ago
- smolLM with Entropix sampler on pytorch☆150Updated last year
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆326Updated last year
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- Easily view and modify JSON datasets for large language models☆83Updated 5 months ago
- Efficient non-uniform quantization with GPTQ for GGUF☆52Updated last month
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆43Updated last week
- PyTorch implementation of models from the Zamba2 series.☆185Updated 9 months ago
- ☆158Updated 6 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Updated 6 months ago
- An introduction to LLM Sampling☆79Updated 10 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆202Updated last year
- ☆135Updated 6 months ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆84Updated 2 months ago
- Fast parallel LLM inference for MLX☆224Updated last year
- Live-bending a foundation model’s output at neural network level.☆269Updated 6 months ago
- Sparse Inferencing for transformer based LLMs☆201Updated 2 months ago
- Clue inspired puzzles for testing LLM deduction abilities☆44Updated 7 months ago
- look how they massacred my boy☆63Updated last year
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated last year