ahmed-moubtahij / TokenHealer
☆22Updated 11 months ago
Alternatives and similar repositories for TokenHealer:
Users that are interested in TokenHealer are comparing it to the libraries listed below
- ☆35Updated 2 years ago
- Using modal.com to process FineWeb-edu data☆20Updated last month
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆66Updated 11 months ago
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆45Updated last year
- ☆49Updated last year
- Lightweight tools for quick and easy LLM demo's☆26Updated 7 months ago
- entropix style sampling + GUI☆26Updated 6 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 11 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 4 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- ☆48Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated 8 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 3 months ago
- Full finetuning of large language models without large memory requirements☆94Updated last year
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 2 months ago
- Simple Model Similarities Analysis☆21Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆61Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆139Updated 2 months ago
- ☆73Updated last year
- ☆31Updated last year
- Chat Markup Language conversation library☆55Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- ☆48Updated 5 months ago
- ☆112Updated 4 months ago
- NLP with Rust for Python 🦀🐍☆62Updated 11 months ago
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆34Updated last year