iaalm / llama-api-serverLinks
A OpenAI API compatible REST server for llama.
☆208Updated 4 months ago
Alternatives and similar repositories for llama-api-server
Users that are interested in llama-api-server are comparing it to the libraries listed below
Sorting:
- An Autonomous LLM Agent that runs on Wizcoder-15B☆335Updated 8 months ago
- An OpenAI-like LLaMA inference API☆112Updated last year
- C++ implementation for 💫StarCoder☆453Updated last year
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆213Updated 2 years ago
- Local LLM ReAct Agent with Guidance☆158Updated 2 years ago
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆331Updated 11 months ago
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆152Updated 6 months ago
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated 2 years ago
- TheBloke's Dockerfiles☆305Updated last year
- Uses Auto-GPT with Llama.cpp☆386Updated last year
- ☆276Updated 2 years ago
- 💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client☆312Updated last year
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆598Updated 2 years ago
- Python bindings for llama.cpp☆197Updated 2 years ago
- Provide a way to use the GPT-QLLama model as an API☆43Updated 2 years ago
- Harnessing the Memory Power of the Camelids☆146Updated last year
- Run any Large Language Model behind a unified API☆170Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- ☆137Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated 2 years ago
- The code we currently use to fine-tune models.☆114Updated last year
- Run Alpaca LLM in LangChain☆218Updated last year
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆71Updated 2 years ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆110Updated last year
- Visual Studio Code extension for WizardCoder☆148Updated last year
- Complex LLM Workflows from Simple JSON.☆304Updated last year
- A fast batching API to serve LLM models☆183Updated last year
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.☆78Updated last year
- Xircuits toolkit for creating and experimenting with BabyAGI/AutoGPT-style agents☆292Updated 2 weeks ago
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆325Updated 2 years ago