Alternatives and similar repositories for TinyLLM

Users that are interested in TinyLLM are comparing it to the libraries listed below

• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 4 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆153Updated this week
• unslothai / unsloth-studio
  Unsloth Studio
  ☆113Updated 6 months ago
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆375Updated this week
• apeatling / simple-guide-to-mlx-finetuning
  Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.
  ☆96Updated last year
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆79Updated this week
• mark-lord / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆122Updated 11 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆159Updated 5 months ago
• intentee / llmops-handbook
  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…
  ☆75Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆57Updated 2 years ago
• lamini-ai / lamini-examples
  ☆163Updated 8 months ago
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆217Updated 2 months ago
• synw / agent-smith
  Local first human friendly agents toolkit for the browser and Nodejs
  ☆44Updated last week
• ngshya / easyRAG
  Build your own RAG and run it locally on your laptop: ColBERT + DSPy + Streamlit
  ☆58Updated last year
• severian42 / Vodalus-Expert-LLM-Forge
  Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …
  ☆188Updated last year
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆601Updated 8 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆119Updated last year
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆515Updated 2 weeks ago
• Itachi-Uchiha581 / Auto-Data
  Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
  ☆102Updated last year
• matteoserva / GraphLLM
  ☆206Updated last month
• mtybadger / chromaviz
  A package for visualising Chroma vector collections in 3D
  ☆108Updated last year
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆278Updated 4 months ago
• QuixiAI / OpenChatML
  ☆162Updated 2 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆160Updated 6 months ago
• iaalm / llama-api-server
  A OpenAI API compatible REST server for llama.
  ☆208Updated 8 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆188Updated last year
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆118Updated last year
• DevXT-LLC / ezlocalai
  ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.
  ☆88Updated last month
• ddh0 / easy-llama
  Python package wrapping llama.cpp for on-device LLM inference
  ☆92Updated 2 weeks ago