mlc-ai / binary-mlc-llm-libs

Related projects ⓘ

Alternatives and complementary repositories for binary-mlc-llm-libs

• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆291Updated 9 months ago
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆76Updated 3 months ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• cognitivecomputations / OpenChatML
  ☆148Updated 3 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆137Updated this week
• abetlen / ggml-python
  Python bindings for ggml
  ☆132Updated 2 months ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆111Updated last year
• nerve-sparks / iris_android
  Local LLM App
  ☆134Updated last month
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆244Updated 9 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆445Updated last year
• mbzuai-oryx / MobiLlama
  MobiLlama : Small Language Model tailored for edge devices
  ☆593Updated 8 months ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆144Updated last year
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆222Updated last month
• mlc-ai / web-llm-chat
  Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
  ☆311Updated this week
• dbpunk-labs / octogen
  Octogen is an Open-Source Code Interpreter Agent Framework
  ☆252Updated 3 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆112Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆79Updated 7 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆205Updated last month
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆177Updated last year
• cfahlgren1 / webllm-playground
  Run LLMs in the Browser with MLC / WebLLM ✨
  ☆81Updated last month
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆348Updated 2 months ago
• teknium1 / ShareGPT-Builder
  ☆103Updated 7 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 2 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 2 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆143Updated last year
• Cornell-RelaxML / quip-sharp
  ☆501Updated last week
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ, and export to onnx/onnx-runtime easily.
  ☆148Updated last month
• lee-b / kobold_assistant
  Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 …
  ☆136Updated 2 months ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆208Updated 3 months ago