iaalm / llama-api-serverLinks
A OpenAI API compatible REST server for llama.
☆208Updated 6 months ago
Alternatives and similar repositories for llama-api-server
Users that are interested in llama-api-server are comparing it to the libraries listed below
Sorting:
- An OpenAI-like LLaMA inference API☆113Updated last year
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆214Updated 2 years ago
- TheBloke's Dockerfiles☆307Updated last year
- C++ implementation for 💫StarCoder☆457Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆334Updated 10 months ago
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆332Updated last year
- 💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client☆314Updated last year
- Visual Studio Code extension for WizardCoder☆149Updated 2 years ago
- Harnessing the Memory Power of the Camelids☆146Updated last year
- Run Alpaca LLM in LangChain☆217Updated last year
- ☆276Updated 2 years ago
- Run any Large Language Model behind a unified API☆171Updated last year
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆152Updated 8 months ago
- An open source UI for OpenChat models☆285Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated 2 years ago
- An AI code interpreter for sensitive data, powered by GPT-4 or Code Llama / Llama 2.☆441Updated last year
- Local LLM ReAct Agent with Guidance☆158Updated 2 years ago
- ☆39Updated 2 years ago
- A prompt/context management system☆170Updated 2 years ago
- Provide a way to use the GPT-QLLama model as an API☆44Updated 2 years ago
- A command-line interface to generate textual and conversational datasets with LLMs.☆301Updated 2 years ago
- LLaMA Cog template☆306Updated last year
- A fast batching API to serve LLM models☆185Updated last year
- AgentLLM is a PoC for browser-native autonomous agents☆436Updated 2 years ago
- starcoder server for huggingface-vscdoe custom endpoint☆173Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆110Updated 2 years ago
- An Autonomous AI Agent that works☆439Updated last year
- ☆137Updated 2 years ago
- Falcon LLM ggml framework with CPU and GPU support☆247Updated last year
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated 2 years ago