tensorchord / modelz-llmLinks
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
☆275Updated last year
Alternatives and similar repositories for modelz-llm
Users that are interested in modelz-llm are comparing it to the libraries listed below
Sorting:
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆267Updated last year
- Local LLM ReAct Agent with Guidance☆158Updated 2 years ago
- 👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.☆349Updated 4 months ago
- A tool for generating function arguments and choosing what function to call with local LLMs☆427Updated last year
- ☆313Updated last year
- An open source UI for OpenChat models☆278Updated last year
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆54Updated 9 months ago
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆163Updated last year
- 🎸 Integrating AI plugins to LLMs☆230Updated last year
- An OpenAI-like LLaMA inference API☆112Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆86Updated last week
- Open Source Text Embedding Models with OpenAI Compatible API☆153Updated 10 months ago
- Subscribe to events using a callback and store them in PlantUML format to easily visualize LangChain workflow in Activity Diagram and Seq…☆74Updated 3 months ago
- Examples on how to use LangChain and Ray☆230Updated last year
- Visual Studio Code extension for WizardCoder☆147Updated last year
- ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…☆172Updated 6 months ago
- ☆275Updated 2 years ago
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆315Updated last year
- a curated collection of models ready-to-use with LocalAI☆263Updated 11 months ago
- 💻📚💡 DoctorGPT provides advanced LLM prompting for PDFs and webpages.☆246Updated last year
- Octogen is an Open-Source Code Interpreter Agent Framework☆256Updated 9 months ago
- C++ implementation for 💫StarCoder☆452Updated last year
- starcoder server for huggingface-vscdoe custom endpoint☆172Updated last year
- Prompt-Promptor is a python library for automatically generating prompts using LLMs☆75Updated last year
- Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning☆307Updated 7 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆130Updated 11 months ago
- A command-line interface to generate textual and conversational datasets with LLMs.☆295Updated last year
- syntactic sugar 🍭 for langchain☆233Updated 7 months ago
- CLARA: Code Language Assistant & Repository Analyzer☆94Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year