An OpenAI-like LLaMA inference API
☆113Sep 17, 2023Updated 3 years ago
Alternatives and similar repositories for llama-api
Users that are interested in llama-api are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Jul 23, 2023Updated 3 years ago
- StrategyQA 데이터 세트 번역☆22Apr 12, 2024Updated 2 years ago
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,945Sep 30, 2023Updated 3 years ago
- This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.☆19Apr 8, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The accompany backend for PAI app☆12Mar 24, 2025Updated last year
- A OpenAI API compatible REST server for llama.☆206Feb 24, 2025Updated last year
- vits2 backbone with multilingual-bert(한국어 지원)☆29Apr 6, 2024Updated 2 years ago
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆52Aug 18, 2024Updated 2 years ago
- The Plunder chest is virtual environment for developing and testing deployment tooling☆15Jan 8, 2021Updated 5 years ago
- Gugugo: 한국어 오픈소스 번역 모델 프로젝트☆87Apr 7, 2024Updated 2 years ago
- ☆16Dec 16, 2024Updated last year
- Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Tra…☆1,278Jan 24, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A simple extension that allows LLM to speak in any voice, literally, based on Sliero TTS which is available in oobabooga's textgen-webui …☆12Aug 26, 2023Updated 3 years ago
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated last year
- A discord bot that roleplays!☆158Sep 25, 2023Updated 3 years ago
- An omnipowerful personal assistant powered by LLMs, Zapier NLA, and custom actions.☆15Sep 13, 2024Updated 2 years ago
- VITS(Data Preprocessing + Whisper ASR + Text Preprocessing + Modification config.json + Training, Inference)☆36Feb 28, 2024Updated 2 years ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆264Mar 6, 2025Updated last year
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 3 years ago
- ☆12Apr 28, 2023Updated 3 years ago
- OpenOrca-KO dataset을 활용하여 llama2를 fine-tuning한 Korean-OpenOrca☆18Nov 1, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Korean Multi-task Instruction Tuning☆156Dec 20, 2023Updated 2 years ago
- Bring an idea. Leave with a working MVP. Lullabeast is a gated multi-agent pipeline that gets results from cheap open models. Run it with…☆16Jul 21, 2026Updated 3 months ago
- The one who calls upon functions - Function-Calling Language Model☆36Oct 2, 2023Updated 3 years ago
- Oobabooga extension for Bark TTS☆118Nov 23, 2023Updated 2 years ago
- jQuery, React and Streamlit applications written by LLMs☆16Dec 24, 2023Updated 2 years ago
- An extension to oobabooga's TextGen allowing you to receive pics generated by Automatic1111's SD API☆11May 16, 2023Updated 3 years ago
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆26Aug 16, 2024Updated 2 years ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,648Mar 4, 2026Updated 7 months ago
- Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also inc…☆17Dec 8, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🦑 - beautifhy, a Hy code autoformatter / pretty-printer / code beautifier.☆13May 29, 2026Updated 5 months ago
- A Python client for nREPL, the Clojure network REPL☆10Apr 1, 2018Updated 8 years ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆333Oct 21, 2024Updated 2 years ago
- Easily create LLM automation/agent workflows☆60Feb 13, 2024Updated 2 years ago
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆24Feb 9, 2024Updated 2 years ago
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆367Dec 9, 2023Updated 2 years ago
- Chat language model that can use tools and interpret the results☆1,593Jun 30, 2026Updated 4 months ago