iaalm / llama-api-server
A OpenAI API compatible REST server for llama.
☆204Updated last week
Alternatives and similar repositories for llama-api-server:
Users that are interested in llama-api-server are comparing it to the libraries listed below
- C++ implementation for 💫StarCoder☆452Updated last year
- An OpenAI-like LLaMA inference API☆113Updated last year
- Run Alpaca LLM in LangChain☆218Updated last year
- TheBloke's Dockerfiles☆305Updated 11 months ago
- Provide a way to use the GPT-QLLama model as an API☆43Updated last year
- Local LLM ReAct Agent with Guidance☆156Updated last year
- A fast batching API to serve LLM models☆180Updated 10 months ago
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆212Updated last year
- Harnessing the Memory Power of the Camelids☆146Updated last year
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆329Updated 7 months ago
- ☆39Updated last year
- BabyAGI to run with GPT4All☆249Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆152Updated 2 months ago
- AgentLLM is a PoC for browser-native autonomous agents☆400Updated last year
- ☆136Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆336Updated 4 months ago
- An experimental open-source attempt to make GPT-4 fully autonomous.☆99Updated last year
- An Autonomous AI Agent that works☆428Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆69Updated last year
- 💻📚💡 DoctorGPT provides advanced LLM prompting for PDFs and webpages.☆245Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- A multimodal, function calling powered LLM webui.☆215Updated 5 months ago
- A command-line interface to generate textual and conversational datasets with LLMs.☆294Updated last year
- Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!☆144Updated last year
- Playground for developing ChatGPT plugins☆158Updated last year
- A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS☆92Updated last year
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆287Updated last week
- ☆276Updated last year