Alternatives and similar repositories for modelz-llm:

Users that are interested in modelz-llm are comparing it to the libraries listed below

• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆334Updated 3 weeks ago
• QuangBK / localLLM_guidance
  Local LLM ReAct Agent with Guidance
  ☆156Updated last year
• freddyaboulton / gradio-tools
  ☆580Updated last year
• edreisMD / plugnplai
  🎸 Integrating AI plugins to LLMs
  ☆229Updated last year
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆251Updated last year
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆161Updated last year
• paolorechia / learn-langchain
  ☆276Updated last year
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆82Updated last week
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆113Updated last year
• cognitivecomputations / OpenChatML
  ☆152Updated 7 months ago
• NexaAI / octopus-v4
  AI for all: Build the large graph of the language models
  ☆254Updated 8 months ago
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆145Updated 7 months ago
• radi-cho / datasetGPT
  A command-line interface to generate textual and conversational datasets with LLMs.
  ☆294Updated last year
• conceptofmind / toolformer
  ☆352Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆519Updated 8 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• RCGAI / SimplyRetrieve
  Lightweight chat AI platform featuring custom knowledge, open-source LLMs, prompt-engineering, retrieval analysis. Highly customizable. F…
  ☆201Updated last year
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆584Updated last year
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆163Updated 3 months ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆130Updated 7 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆54Updated last year
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆285Updated this week
• feedox / alt-gpt
  Playground for developing ChatGPT plugins
  ☆158Updated last year
• 1b5d / langchain-llm-api
  ☆39Updated last year
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆356Updated 9 months ago
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• rizerphe / local-llm-function-calling
  A tool for generating function arguments and choosing what function to call with local LLMs
  ☆409Updated 11 months ago
• nlpxucan / evol-instruct
  ☆268Updated last year
• finic-ai / doctran
  ☆494Updated 6 months ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆145Updated last year