Alternatives and similar repositories for TinyLLM

Users that are interested in TinyLLM are comparing it to the libraries listed below

• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆278Updated last week
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 7 months ago
• intentee / llmops-handbook
  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…
  ☆78Updated last year
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆326Updated 2 weeks ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆168Updated last week
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆393Updated last week
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆83Updated 2 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆242Updated last year
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆103Updated 5 months ago
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆629Updated last year
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆575Updated last week
• ngshya / easyRAG
  Build your own RAG and run it locally on your laptop: ColBERT + DSPy + Streamlit
  ☆60Updated last year
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆227Updated 2 months ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆285Updated last year
• ibm-granite / granite-3.0-language-models
  ☆269Updated 7 months ago
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆172Updated last month
• neuml / rag
  🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.
  ☆438Updated 2 months ago
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆246Updated 2 years ago
• Not-Diamond / notdiamond-python
  Not Diamond Python SDK
  ☆90Updated last month
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated last year
• ddh0 / easy-llama
  Python package wrapping llama.cpp for on-device LLM inference
  ☆100Updated 3 months ago
• matteoserva / GraphLLM
  ☆209Updated 3 weeks ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆188Updated last year
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆612Updated 11 months ago
• PromtEngineer / Agent-0
  This project is a **proof of concept** that aims to replicate the reasoning capabilities of OpenAI's newly released O1 model.
  ☆90Updated last year
• SqueezeAILab / TinyAgent
  [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!
  ☆467Updated last year
• pseudotensor / open-strawberry
  Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://hugging…
  ☆188Updated last year
• BassAzayda / ollama-function-calling
  ☆69Updated last year