Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
☆1,290Jan 24, 2024Updated 2 years ago
Alternatives and similar repositories for basaran
Users that are interested in basaran are comparing it to the libraries listed below
Sorting:
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,913Sep 30, 2023Updated 2 years ago
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆331Jul 16, 2024Updated last year
- Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU☆3,804Sep 30, 2023Updated 2 years ago
- AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across div…☆3,153Updated this week
- LLM as a Chatbot Service☆3,334Nov 20, 2023Updated 2 years ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,477Jun 7, 2025Updated 8 months ago
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,958Sep 7, 2024Updated last year
- The definitive Web UI for local AI, with powerful features and easy setup.☆46,091Feb 3, 2026Updated 3 weeks ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,414Jun 2, 2025Updated 8 months ago
- A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.☆5,747Nov 21, 2025Updated 3 months ago
- Large Language Model Text Generation Inference☆10,788Jan 8, 2026Updated last month
- 💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows☆12,210Feb 22, 2026Updated last week
- A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer☆1,630Sep 15, 2023Updated 2 years ago
- An LLM playground you can run on your laptop☆6,370Feb 6, 2026Updated 3 weeks ago
- A language for constraint-guided and efficient LLM programming.☆4,154May 22, 2025Updated 9 months ago
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-g…☆43,070Updated this week
- A guidance language for controlling large language models.☆21,319Feb 13, 2026Updated 2 weeks ago
- Go ahead and axolotl questions☆11,335Updated this week
- Chat language model that can use tools and interpret the results☆1,591Dec 3, 2025Updated 2 months ago
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,731Feb 9, 2026Updated 3 weeks ago
- 4 bits quantization of LLaMA using GPTQ☆3,074Jul 13, 2024Updated last year
- Structured Outputs☆13,456Feb 13, 2026Updated 2 weeks ago
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,533Jul 16, 2023Updated 2 years ago
- Customizable implementation of the self-instruct paper.☆1,049Mar 7, 2024Updated last year
- Universal LLM Deployment Engine with ML Compilation☆22,082Updated this week
- OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…☆37,444Aug 17, 2024Updated last year
- H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/☆4,888Feb 20, 2026Updated last week
- StableLM: Stability AI Language Models☆15,761Apr 8, 2024Updated last year
- Instruct-tune LLaMA on consumer hardware☆18,972Jul 29, 2024Updated last year
- High-performance In-browser LLM Inference Engine☆17,456Feb 18, 2026Updated last week
- Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-s…☆2,665Feb 20, 2026Updated last week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,140Updated this week
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,906Feb 24, 2024Updated 2 years ago
- ☆9,007Apr 9, 2024Updated last year
- FauxPilot - an open-source alternative to GitHub Copilot server☆14,762Apr 9, 2024Updated last year
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,383Oct 28, 2024Updated last year
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆5,026Apr 11, 2025Updated 10 months ago
- LlamaIndex is the leading document agent and OCR platform☆47,210Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,295Updated this week