Contextualist / lone-arenaLinks
Self-hosted LLM chatbot arena, with yourself as the only judge
☆41Updated last year
Alternatives and similar repositories for lone-arena
Users that are interested in lone-arena are comparing it to the libraries listed below
Sorting:
- ☆162Updated last month
- Low-Rank adapter extraction for fine-tuned transformers models☆178Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated last year
- ☆116Updated 9 months ago
- A fast batching API to serve LLM models☆187Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 7 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆42Updated 3 weeks ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated 2 years ago
- Let's create synthetic textbooks together :)☆75Updated last year
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆225Updated 3 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated last year
- ☆51Updated last year
- Model REVOLVER, a human in the loop model mixing system.☆33Updated 2 years ago
- Experimental LLM Inference UX to aid in creative writing☆123Updated 9 months ago
- Distributed Inference for mlx LLm☆95Updated last year
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆106Updated 2 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆93Updated 5 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆64Updated last year
- ☆67Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆107Updated last year
- Merge Transformers language models by use of gradient parameters.☆208Updated last year
- A pipeline parallel training script for LLMs.☆158Updated 5 months ago
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆75Updated 9 months ago
- One Line To Build Zero-Data Classifiers in Minutes☆58Updated last year
- A python package for developing AI applications with local LLMs.☆151Updated 9 months ago
- GPT-2 small trained on phi-like data☆67Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆118Updated last year
- A framework for evaluating function calls made by LLMs☆38Updated last year