Alternatives and similar repositories for llm-mlc:

Users that are interested in llm-mlc are comparing it to the libraries listed below

• simonw / llm-llama-cpp
  LLM plugin for running models using llama.cpp
  ☆142Updated last year
• simonw / llm-mistral
  LLM plugin providing access to Mistral models using the Mistral API
  ☆169Updated this week
• saulpw / aipl
  Array-Inspired Pipeline Language
  ☆119Updated last year
• taketwo / llm-ollama
  LLM plugin providing access to models running on an Ollama server
  ☆246Updated this week
• simonw / llm-claude-3
  LLM plugin for interacting with the Claude 3 family of models
  ☆289Updated last month
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆331Updated 3 months ago
• simonw / ospeak
  CLI tool for running text through OpenAI Text to speech
  ☆163Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆58Updated last year
• abacaj / openhermes-function-calling
  ☆136Updated last year
• simonw / ttok
  Count and truncate text based on tokens
  ☆299Updated 10 months ago
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆247Updated 7 months ago
• remixer-dec / llama-mps
  Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2
  ☆86Updated last year
• jiggy-ai / hnsqlite
  hnsqlite integrates hnswlib and sqlite for simple text embedding search
  ☆158Updated last year
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆448Updated 11 months ago
• AnswerDotAI / claudette
  Claudette is Claude's friend
  ☆220Updated this week
• modal-labs / doppel-bot
  Train a language model to answer Slack messages as you.
  ☆240Updated last month
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆137Updated last year
• modal-labs / devlooper
  A program synthesis agent that autonomously fixes its output by running tests!
  ☆449Updated 5 months ago
• irthomasthomas / llm-consortium
  llm-consortium orchestrates mulitple LLMs, iteratively refines & achieves consensus.
  ☆177Updated last week
• MF-FOOM / wikivec2text
  Simple embedding -> text model trained on a small subset of Wikipedia sentences.
  ☆153Updated last year
• simonw / openai-to-sqlite
  Save OpenAI API results to a SQLite database
  ☆232Updated 10 months ago
• arc53 / llm-price-compass
  This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …
  ☆218Updated 2 months ago
• simonw / llm-gpt4all
  Plugin for LLM adding support for the GPT4All collection of models
  ☆243Updated 9 months ago
• thiggle / api
  Structured LLM APIs
  ☆155Updated last year
• newhouseb / clownfish
  Constrained Decoding for LLMs against JSON Schema
  ☆325Updated last year
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆205Updated 2 weeks ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• jasonjmcghee / portable-hnsw
  What if an HNSW index was just a file, and you could serve it from a CDN, and search it directly in the browser?
  ☆94Updated 9 months ago
• knowsuchagency / llmo
  Your friendly terminal-based AI pair programmer
  ☆42Updated last year