Alternatives and similar repositories for bunny-llama:

Users that are interested in bunny-llama are comparing it to the libraries listed below

• distantmagic / structured
  Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp
  ☆45Updated 11 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆149Updated last year
• rahuldshetty / starcoder.js
  Web browser version of StarCoder.cpp
  ☆45Updated last year
• okuvshynov / llama_duo
  asynchronous/distributed speculative evaluation for llama3
  ☆39Updated 8 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• cjpais / whisperfile
  ☆54Updated 8 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆66Updated 2 months ago
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 6 months ago
• bachittle / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆32Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 9 months ago
• EricLBuehler / zig_ml
  Tensor library for Zig
  ☆12Updated 5 months ago
• xenova / model-explorer
  Browse, search, and visualize ONNX models.
  ☆24Updated this week
• tairov / lamatune
  LLama implementations benchmarking framework
  ☆12Updated last year
• adrienbrault / json-schema-to-gbnf
  Converts JSON-Schema to GBNF grammar to use with llama.cpp
  ☆52Updated last year
• FL33TW00D / wattkit
  ☆14Updated 5 months ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆88Updated last year
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• ahmed-moubtahij / TokenHealer
  ☆22Updated 11 months ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆44Updated last month
• huggingface / ember
  ANE accelerated embedding models!
  ☆16Updated 4 months ago
• deepgrove-ai / Bonsai
  ☆20Updated last month
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• ggerganov / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆30Updated last year
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆180Updated last year
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• remyxai / LocalMentor
  Local Startup Advisor Chatbot
  ☆31Updated last year