iaalm / llama-api-serverLinks
A OpenAI API compatible REST server for llama.
☆208Updated 8 months ago
Alternatives and similar repositories for llama-api-server
Users that are interested in llama-api-server are comparing it to the libraries listed below
Sorting:
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- TheBloke's Dockerfiles☆306Updated last year
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆332Updated last year
- ☆275Updated 2 years ago
- Harnessing the Memory Power of the Camelids☆147Updated 2 years ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆333Updated last year
- starcoder server for huggingface-vscdoe custom endpoint☆175Updated last year
- Visual Studio Code extension for WizardCoder☆148Updated 2 years ago
- Local LLM ReAct Agent with Guidance☆158Updated 2 years ago
- C++ implementation for 💫StarCoder☆455Updated 2 years ago
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆212Updated 2 years ago
- 💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client☆315Updated last year
- AgentLLM is a PoC for browser-native autonomous agents☆444Updated 2 years ago
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆130Updated 2 years ago
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆153Updated 10 months ago
- A command-line interface to generate textual and conversational datasets with LLMs.☆298Updated 2 years ago
- An open source UI for OpenChat models☆287Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆88Updated 2 years ago
- Falcon LLM ggml framework with CPU and GPU support☆247Updated last year
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆323Updated 2 years ago
- A fast batching API to serve LLM models☆188Updated last year
- Provide a way to use the GPT-QLLama model as an API☆43Updated 2 years ago
- 👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.☆353Updated 8 months ago
- A prompt/context management system☆170Updated 2 years ago
- Run any Large Language Model behind a unified API☆170Updated last year
- ☆166Updated 2 years ago
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆598Updated 2 years ago
- Uses Auto-GPT with Llama.cpp☆387Updated last year
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆275Updated 2 years ago
- ☆137Updated 2 years ago