tensorchord / modelz-llmLinks
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
☆276Updated last year
Alternatives and similar repositories for modelz-llm
Users that are interested in modelz-llm are comparing it to the libraries listed below
Sorting:
- 👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.☆353Updated 7 months ago
- A tool for generating function arguments and choosing what function to call with local LLMs☆428Updated last year
- Open Source Text Embedding Models with OpenAI Compatible API☆160Updated last year
- Local LLM ReAct Agent with Guidance☆158Updated 2 years ago
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆167Updated 2 years ago
- starcoder server for huggingface-vscdoe custom endpoint☆175Updated last year
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆56Updated last year
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆317Updated last year
- Octogen is an Open-Source Code Interpreter Agent Framework☆259Updated last year
- ☆276Updated 2 years ago
- 🎸 Integrating AI plugins to LLMs☆229Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆273Updated last year
- Visual Studio Code extension for WizardCoder☆149Updated 2 years ago
- ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…☆177Updated 10 months ago
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- ☆416Updated last year
- ☆600Updated 2 years ago
- Python client library for improving your LLM app accuracy☆98Updated 7 months ago
- Using LlamaIndex, Redis, and OpenAI to chat with PDF documents. Supplementary material for blog post on Microsoft Developer Blog☆114Updated last year
- ☆159Updated last year
- A simple Python sandbox for helpful LLM data agents☆282Updated last year
- Build robust LLM applications with true composability 🔗☆419Updated last year
- AI for all: Build the large graph of the language models☆275Updated last year
- ☆318Updated last year
- A OpenAI API compatible REST server for llama.☆208Updated 6 months ago
- Lightweight chat AI platform featuring custom knowledge, open-source LLMs, prompt-engineering, retrieval analysis. Highly customizable. F…☆215Updated last year
- A command-line interface to generate textual and conversational datasets with LLMs.☆300Updated 2 years ago
- This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…☆594Updated last year
- Examples on how to use LangChain and Ray☆229Updated 2 years ago
- C++ implementation for 💫StarCoder☆456Updated 2 years ago