Nikityyy / lilleLinks
A powerful 130-million-parameter model trained from scratch as part of a truly open-source stack, including a custom tokenizer, dataset, and optimizer.
☆68Updated 3 months ago
Alternatives and similar repositories for lille
Users that are interested in lille are comparing it to the libraries listed below
Sorting:
- ☆108Updated 5 months ago
- ☆136Updated last year
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Updated last year
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆330Updated last year
- Testing LLM reasoning abilities with family relationship quizzes.☆63Updated 10 months ago
- Live-bending a foundation model’s output at neural network level.☆271Updated 8 months ago
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- GRadient-INformed MoE☆264Updated last year
- ☆121Updated 5 months ago
- AI management tool☆121Updated last year
- look how they massacred my boy☆63Updated last year
- Editor with LLM generation tree exploration☆80Updated 10 months ago
- A little(lil) Language Model (LM). A tiny reproduction of LLaMA 3's model architecture.☆53Updated 7 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆148Updated 9 months ago
- Exploration into the proposed architecture from Sapient Intelligence of Singapore 🇸🇬☆73Updated 3 months ago
- Distributed Inference for mlx LLm☆99Updated last year
- PyTorch implementation of models from the Zamba2 series.☆186Updated 10 months ago
- Sparse Inferencing for transformer based LLMs☆215Updated 4 months ago
- The code repository of the paper: Competition and Attraction Improve Model Fusion☆167Updated 3 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Updated last year
- Implementation snake game based on Diffusion model☆91Updated 11 months ago
- Clue inspired puzzles for testing LLM deduction abilities☆45Updated 8 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆47Updated last month
- Fast parallel LLM inference for MLX☆234Updated last year
- ☆331Updated 4 months ago
- ☆158Updated 7 months ago
- smolLM with Entropix sampler on pytorch☆149Updated last year
- ☆68Updated last year
- Efficient non-uniform quantization with GPTQ for GGUF☆56Updated 2 months ago
- Enhancing LLMs with LoRA☆191Updated last month