epolewski / EricLLMLinks
A fast batching API to serve LLM models
☆183Updated last year
Alternatives and similar repositories for EricLLM
Users that are interested in EricLLM are comparing it to the libraries listed below
Sorting:
- A multimodal, function calling powered LLM webui.☆214Updated 9 months ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆185Updated 11 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- function calling-based LLM agents☆287Updated 9 months ago
- Low-Rank adapter extraction for fine-tuned transformers models☆173Updated last year
- Easily view and modify JSON datasets for large language models☆77Updated last month
- This is our own implementation of 'Layer Selective Rank Reduction'☆239Updated last year
- ☆131Updated 2 months ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- ☆95Updated 6 months ago
- A python package for developing AI applications with local LLMs.☆150Updated 6 months ago
- Experimental LLM Inference UX to aid in creative writing☆114Updated 7 months ago
- A simple experiment on letting two local LLM have a conversation about anything!☆110Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆257Updated 4 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆156Updated last year
- An AI assistant beyond the chat box.☆328Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆102Updated 8 months ago
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆160Updated last year
- ☆204Updated last month
- An OpenAI-like LLaMA inference API☆112Updated last year
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆140Updated last month
- Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…☆69Updated 10 months ago
- A frontend for creative writing with LLMs☆127Updated last year
- ☆157Updated 11 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated 2 years ago
- automatically quant GGUF models☆185Updated last week
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆78Updated 9 months ago
- Open source LLM UI, compatible with all local LLM providers.☆175Updated 9 months ago
- ☆115Updated 6 months ago
- Let's create synthetic textbooks together :)☆75Updated last year