Alternatives and similar repositories for TinyLLM

Users that are interested in TinyLLM are comparing it to the libraries listed below

• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆157Updated this week
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆273Updated last week
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆385Updated this week
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 4 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆609Updated 9 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆58Updated 2 years ago
• intentee / llmops-handbook
  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…
  ☆76Updated last year
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆245Updated last year
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆285Updated last year
• Nagi-ovo / CRAG-Ollama-Chat
  Corrective RAG demo powerd by Ollama
  ☆108Updated last year
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 9 months ago
• ngshya / easyRAG
  Build your own RAG and run it locally on your laptop: ColBERT + DSPy + Streamlit
  ☆58Updated last year
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆161Updated 6 months ago
• maudoin / ollama-voice
  plug whisper audio transcription to a local ollama server and ouput tts audio responses
  ☆360Updated last month
• AstraBert / PrAIvateSearch
  Own your AI, search the web with it🌐😎
  ☆92Updated 10 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆92Updated 8 months ago
• ibm-granite / granite-3.0-language-models
  ☆268Updated 5 months ago
• Otman404 / local-rag-llamaindex
  Local llamaindex RAG to assist researchers quickly navigate research papers
  ☆122Updated 6 months ago
• continuedev / deploy-os-code-llm
  🌉 How to deploy an open-source code LLM for your dev team
  ☆108Updated 2 years ago
• BerriAI / liteLLM-proxy
  ☆170Updated last year
• AkiRusProd / llm-agent
  LLM using long-term memory through vector database
  ☆53Updated last year
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆219Updated last week
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆44Updated last year
• unslothai / unsloth-studio
  Unsloth Studio
  ☆118Updated 7 months ago
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆621Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆236Updated last year
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆531Updated 2 weeks ago
• Vaibhavs10 / optimise-my-whisper
  ☆207Updated last year
• jjovalle99 / DSPy-Text2SQL
  DSPY on action with OpenSource LLMs.
  ☆98Updated last year