epolewski / EricLLM
A fast batching API to serve LLM models
☆183Updated 11 months ago
Alternatives and similar repositories for EricLLM:
Users that are interested in EricLLM are comparing it to the libraries listed below
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆177Updated 8 months ago
- A multimodal, function calling powered LLM webui.☆215Updated 6 months ago
- Easily view and modify JSON datasets for large language models☆71Updated 3 weeks ago
- ☆125Updated this week
- Low-Rank adapter extraction for fine-tuned transformers models☆171Updated 10 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆224Updated 10 months ago
- Experimental LLM Inference UX to aid in creative writing☆114Updated 3 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆233Updated 10 months ago
- function calling-based LLM agents☆284Updated 6 months ago
- A python package for developing AI applications with local LLMs.☆146Updated 2 months ago
- ☆83Updated 3 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆86Updated 7 months ago
- For inferring and serving local LLMs using the MLX framework☆96Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 6 months ago
- Dynamically structure language models to produce outputs that adhere to specific requirements without sacrificing their creative capabili…☆119Updated last week
- ☆152Updated 8 months ago
- A simple experiment on letting two local LLM have a conversation about anything!☆107Updated 8 months ago
- ☆111Updated 3 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆71Updated 6 months ago
- Let's create synthetic textbooks together :)☆74Updated last year
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆88Updated 2 months ago
- automatically quant GGUF models☆163Updated this week
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆136Updated last month
- ☆28Updated 5 months ago
- Web UI for ExLlamaV2☆486Updated last month
- ☆275Updated 2 months ago
- ☆197Updated last week
- A frontend for creative writing with LLMs☆122Updated 8 months ago
- An AI assistant beyond the chat box.☆322Updated last year