tensorchord / modelz-llmLinks
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
β275Updated 2 years ago
Alternatives and similar repositories for modelz-llm
Users that are interested in modelz-llm are comparing it to the libraries listed below
Sorting:
- πΎπ¦ CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.β364Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)β279Updated 2 years ago
- A tool for generating function arguments and choosing what function to call with local LLMsβ436Updated last year
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.β165Updated 2 years ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistantβ57Updated last year
- Local LLM ReAct Agent with Guidanceβ160Updated 2 years ago
- β595Updated 2 years ago
- Open Source Text Embedding Models with OpenAI Compatible APIβ167Updated last year
- β276Updated 2 years ago
- starcoder server for huggingface-vscdoe custom endpointβ179Updated 2 years ago
- Build robust LLM applications with true composability πβ420Updated 2 years ago
- An OpenAI-like LLaMA inference APIβ113Updated 2 years ago
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRavβ¦β318Updated 2 years ago
- Subscribe to events using a callback and store them in PlantUML format to easily visualize LangChain workflow in Activity Diagram and Seqβ¦β77Updated last year
- πΈ Integrating AI plugins to LLMsβ228Updated 2 years ago
- This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and benchβ¦β599Updated 2 years ago
- Visual Studio Code extension for WizardCoderβ149Updated 2 years ago
- ChatData π π brings RAG to real applications with FREEβ¨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milliβ¦β177Updated last year
- β415Updated last year
- Finetune ALL LLMs with ALL Adapeters on ALL Platforms!β332Updated 6 months ago
- β321Updated 2 years ago
- Octogen is an Open-Source Code Interpreter Agent Frameworkβ257Updated last year
- Examples on how to use LangChain and Rayβ232Updated 2 years ago
- A command-line interface to generate textual and conversational datasets with LLMs.β299Updated 2 years ago
- Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasksβ610Updated 2 years ago
- Lightweight chat AI platform featuring custom knowledge, open-source LLMs, prompt-engineering, retrieval analysis. Highly customizable. Fβ¦β218Updated last year
- A OpenAI API compatible REST server for llama.β208Updated 11 months ago
- Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuningβ309Updated last year
- β138Updated 3 years ago
- An open source UI for OpenChat modelsβ288Updated last year