Alternatives and similar repositories for llm-vscode-inference-server

Users that are interested in llm-vscode-inference-server are comparing it to the libraries listed below

• LucienShui / huggingface-vscode-endpoint-server
  starcoder server for huggingface-vscdoe custom endpoint
  ☆175Updated last year
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆148Updated 2 years ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated 2 years ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆160Updated 2 years ago
• QuixiAI / OpenChatML
  ☆162Updated 2 months ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆37Updated 2 years ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• Preemo-Inc / text-generation-inference
  ☆197Updated last year
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆64Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆188Updated last year
• xhedit / quantkit
  cli tool to quantize gguf, gptq, awq, hqq and exl2 models
  ☆76Updated 10 months ago
• teknium1 / ShareGPT-Builder
  ☆116Updated 10 months ago
• remichu-ai / gallama
  ☆133Updated 6 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 9 months ago
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆112Updated 11 months ago
• itsPreto / VECTR8
  Embed anything.
  ☆27Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆53Updated 2 years ago
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆113Updated 2 years ago
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆126Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• KillianLucas / ooba
  Run language models on consumer hardware.
  ☆26Updated 2 years ago
• ParisNeo / lollms_legacy
  Lord of LLMS
  ☆294Updated last month
• Itachi-Uchiha581 / Auto-Data
  Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
  ☆102Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆119Updated last year
• mystic-ai / pipeline
  Pipeline is an open source python SDK for building AI/ML workflows
  ☆138Updated last year
• nath1295 / LLMFlex
  A python package for developing AI applications with local LLMs.
  ☆151Updated 9 months ago
• Uminosachi / open-llm-webui
  This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).
  ☆43Updated 7 months ago
• QuixiAI / kraken
  ☆67Updated last year
• Lisoveliy / StarCoderEx
  Extension for using alternative GitHub Copilot (StarCoder API) in VSCode
  ☆100Updated last year
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 4 months ago