epolewski / EricLLM
A fast batching API to serve LLM models
☆181Updated 10 months ago
Alternatives and similar repositories for EricLLM:
Users that are interested in EricLLM are comparing it to the libraries listed below
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆224Updated 10 months ago
- A multimodal, function calling powered LLM webui.☆215Updated 5 months ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆175Updated 7 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆86Updated 6 months ago
- Experimental LLM Inference UX to aid in creative writing☆112Updated 2 months ago
- Easily view and modify JSON datasets for large language models☆71Updated last week
- ☆80Updated 2 months ago
- Low-Rank adapter extraction for fine-tuned transformers models☆171Updated 10 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆233Updated 9 months ago
- Let's create synthetic textbooks together :)☆73Updated last year
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆71Updated 5 months ago
- Web UI for ExLlamaV2☆485Updated last month
- ☆124Updated this week
- ☆46Updated 3 weeks ago
- function calling-based LLM agents☆283Updated 5 months ago
- Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…☆59Updated 7 months ago
- For inferring and serving local LLMs using the MLX framework☆96Updated 11 months ago
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆293Updated this week
- Stateful control of Large Language Models☆115Updated this week
- A python package for developing AI applications with local LLMs.☆145Updated 2 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆114Updated 4 months ago
- A simple experiment on letting two local LLM have a conversation about anything!☆106Updated 8 months ago
- ☆152Updated 7 months ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆98Updated 4 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆146Updated 9 months ago
- ☆270Updated last month
- Serving LLMs in the HF-Transformers format via a PyFlask API☆70Updated 6 months ago
- GPT-2 small trained on phi-like data☆65Updated last year
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆152Updated 10 months ago