iaalm / llama-api-serverLinks
A OpenAI API compatible REST server for llama.
☆208Updated 7 months ago
Alternatives and similar repositories for llama-api-server
Users that are interested in llama-api-server are comparing it to the libraries listed below
Sorting:
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆331Updated last year
- Harnessing the Memory Power of the Camelids☆146Updated last year
- TheBloke's Dockerfiles☆307Updated last year
- Local LLM ReAct Agent with Guidance☆158Updated 2 years ago
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆213Updated 2 years ago
- ☆275Updated 2 years ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆334Updated 11 months ago
- C++ implementation for 💫StarCoder☆457Updated 2 years ago
- 💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client☆315Updated last year
- Visual Studio Code extension for WizardCoder☆148Updated 2 years ago
- Provide a way to use the GPT-QLLama model as an API☆43Updated 2 years ago
- Run Alpaca LLM in LangChain☆217Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆89Updated 2 years ago
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆152Updated 9 months ago
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆323Updated 2 years ago
- Falcon LLM ggml framework with CPU and GPU support☆248Updated last year
- ☆39Updated 2 years ago
- Run inference on replit-3B code instruct model using CPU☆158Updated 2 years ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated 2 years ago
- Run any Large Language Model behind a unified API☆170Updated last year
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆130Updated 2 years ago
- A multimodal, function calling powered LLM webui.☆216Updated last year
- A fast batching API to serve LLM models☆187Updated last year
- A prompt/context management system☆171Updated 2 years ago
- An open source UI for OpenChat models☆287Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated last year
- Simple and fast server for GPTQ-quantized LLaMA inference☆24Updated 2 years ago
- A command-line interface to generate textual and conversational datasets with LLMs.☆297Updated 2 years ago
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆598Updated 2 years ago