Contextualist / lone-arena
Self-hosted LLM chatbot arena, with yourself as the only judge
☆36Updated last year
Alternatives and similar repositories for lone-arena:
Users that are interested in lone-arena are comparing it to the libraries listed below
- ☆111Updated last month
- Easy to use, High Performant Knowledge Distillation for LLMs☆45Updated last month
- ☆65Updated 8 months ago
- ☆74Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆169Updated 9 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- ☆52Updated 8 months ago
- ☆24Updated 3 weeks ago
- ☆38Updated last year
- ☆152Updated 7 months ago
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆82Updated last month
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆70Updated 2 months ago
- Let's create synthetic textbooks together :)☆73Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated 9 months ago
- Routing on Random Forest (RoRF)☆112Updated 4 months ago
- ☆30Updated 9 months ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆55Updated 2 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆129Updated last week
- One Line To Build Zero-Data Classifiers in Minutes☆36Updated 4 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆44Updated 4 months ago
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆96Updated this week
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆58Updated 5 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆82Updated this week
- run ollama & gguf easily with a single command☆49Updated 9 months ago
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆44Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆64Updated 3 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆104Updated 9 months ago