Contextualist / lone-arena
Self-hosted LLM chatbot arena, with yourself as the only judge
☆40Updated last year
Alternatives and similar repositories for lone-arena
Users that are interested in lone-arena are comparing it to the libraries listed below
Sorting:
- ☆53Updated 11 months ago
- ☆156Updated 9 months ago
- ☆66Updated 11 months ago
- ☆24Updated 3 months ago
- Testing LLM reasoning abilities with family relationship quizzes.☆62Updated 3 months ago
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆93Updated 4 months ago
- ☆113Updated 4 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆80Updated 5 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆128Updated 2 weeks ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆81Updated last week
- Distributed Inference for mlx LLm☆91Updated 9 months ago
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆197Updated 4 months ago
- ☆22Updated 11 months ago
- ☆73Updated last year
- run ollama & gguf easily with a single command☆50Updated 11 months ago
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆173Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆139Updated 2 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 7 months ago
- entropix style sampling + GUI☆26Updated 6 months ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆41Updated 8 months ago
- Full finetuning of large language models without large memory requirements☆94Updated last year
- One Line To Build Zero-Data Classifiers in Minutes☆54Updated 7 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Let's create synthetic textbooks together :)☆74Updated last year
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated 11 months ago
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆70Updated 4 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆223Updated last year