iaalm / llama-api-server
A OpenAI API compatible REST server for llama.
☆201Updated 5 months ago
Alternatives and similar repositories for llama-api-server:
Users that are interested in llama-api-server are comparing it to the libraries listed below
- TheBloke's Dockerfiles☆301Updated 10 months ago
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆328Updated 6 months ago
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated last year
- C++ implementation for 💫StarCoder☆450Updated last year
- Complex LLM Workflows from Simple JSON.☆290Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆338Updated 3 months ago
- An OpenAI-like LLaMA inference API☆113Updated last year
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆212Updated last year
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated last year
- Visual Studio Code extension for WizardCoder☆145Updated last year
- AgentLLM is a PoC for browser-native autonomous agents☆392Updated last year
- Run Alpaca LLM in LangChain☆218Updated last year
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆152Updated last month
- Harnessing the Memory Power of the Camelids☆146Updated last year
- Run any Large Language Model behind a unified API☆163Updated last year
- A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS☆92Updated last year
- ☆134Updated 2 years ago
- ☆39Updated last year
- 💻📚💡 DoctorGPT provides advanced LLM prompting for PDFs and webpages.☆244Updated last year
- ☆132Updated 11 months ago
- 🎸 Integrating AI plugins to LLMs☆230Updated last year
- BabyAGI to run with GPT4All☆249Updated last year
- Local LLM ReAct Agent with Guidance☆156Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated last year
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆69Updated last year
- starcoder server for huggingface-vscdoe custom endpoint☆168Updated last year
- ☆64Updated 2 months ago
- Run inference on replit-3B code instruct model using CPU☆154Updated last year
- The code we currently use to fine-tune models.☆112Updated 8 months ago
- Run MemGPT-AutoGEN-Local LLM Together☆297Updated last year