apehex / tokunLinks
Tokun to can tokens
☆18Updated 3 weeks ago
Alternatives and similar repositories for tokun
Users that are interested in tokun are comparing it to the libraries listed below
Sorting:
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 7 months ago
- ☆63Updated 9 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆54Updated 5 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 8 months ago
- ☆134Updated 10 months ago
- Cerule - A Tiny Mighty Vision Model☆66Updated 10 months ago
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆117Updated this week
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- ☆66Updated last year
- ☆52Updated 8 months ago
- Set of scripts to finetune LLMs☆37Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆140Updated 4 months ago
- Simple GRPO scripts and configurations.☆59Updated 5 months ago
- Full finetuning of large language models without large memory requirements☆94Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆106Updated 7 months ago
- entropix style sampling + GUI☆26Updated 8 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆41Updated last year
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆81Updated last month
- Collection of autoregressive model implementation☆85Updated 2 months ago
- ☆48Updated 5 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆101Updated 4 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆64Updated last year
- Lego for GRPO☆28Updated last month
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆34Updated 4 months ago
- ☆35Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆49Updated last year
- Chat Markup Language conversation library☆55Updated last year