shawwn / openai-serverLinks
OpenAI API webserver
☆187Updated 3 years ago
Alternatives and similar repositories for openai-server
Users that are interested in openai-server are comparing it to the libraries listed below
Sorting:
- Inference code for LLaMA models☆188Updated 2 years ago
- Instruct-tuning LLaMA on consumer hardware☆66Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated 2 years ago
- SoTA Transformers with C-backend for fast inference on your CPU.☆309Updated last year
- ☆129Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆110Updated last year
- 💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client☆312Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆118Updated 9 months ago
- A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model load…☆115Updated 3 years ago
- Yet Another LLaMA/ALPACA Discord Bot☆70Updated 2 years ago
- ☆130Updated 3 years ago
- howdoi.ai☆255Updated 2 years ago
- A Simple Discord Bot for the Alpaca LLM☆101Updated 2 years ago
- ☆406Updated 2 years ago
- Reimplementation of the task generation part from the Alpaca paper☆119Updated 2 years ago
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆325Updated 2 years ago
- 4 bits quantization of SantaCoder using GPTQ☆51Updated 2 years ago
- ☆141Updated last year
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated 2 years ago
- Tools with GUI for GPT finetune data preparation☆23Updated 3 years ago
- A discord bot that roleplays!☆149Updated last year
- ☆84Updated last year
- Drop in replacement for OpenAI, but with Open models.☆152Updated 2 years ago
- The code we currently use to fine-tune models.☆114Updated last year
- Smol but mighty language model☆62Updated 2 years ago
- A prompt/context management system☆170Updated 2 years ago
- An HTTP serving framework by Banana☆99Updated last year
- Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.☆71Updated 2 years ago
- Prompt programming with FMs.☆443Updated 11 months ago