Alternatives and similar repositories for vicuna-7b

Users that are interested in vicuna-7b are comparing it to the libraries listed below

• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆160Updated 2 years ago
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆156Updated 2 years ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆76Updated 11 months ago
• deep-diver / gradio-chat
  HuggingChat like UI in Gradio
  ☆70Updated 2 years ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆180Updated last year
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆102Updated 2 years ago
• sshh12 / llm-chat-web-ui
  LLM Chat is an open-source serverless alternative to ChatGPT.
  ☆35Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• vcskaushik / LLMzip
  ☆62Updated 10 months ago
• kyegomez / Andromeda
  An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
  ☆150Updated last year
• NolanoOrg / SpectraSuite
  ☆52Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated last month
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆74Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆93Updated last year
• mithril-security / blind_llama_client
  Zero-trust AI APIs for easy and private consumption of open-source LLMs
  ☆40Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• glaive-ai / function-calling-server
  ☆36Updated last year
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆182Updated 7 months ago
• qnguyen3 / hermes-llava
  ☆53Updated last year
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆208Updated last year
• kyegomez / Ocean
  Ultra Fast Multi-Modality Vector Database
  ☆17Updated last year
• AIAnytime / GGUF-Quantization-of-any-LLM
  GGUF Quantization of any LLM.
  ☆41Updated last year
• jina-ai / jerboa
  LLM finetuning
  ☆41Updated 2 years ago
• Macaronlin / LLaMA3-Quantization
  A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..
  ☆196Updated 10 months ago
• evintunador / minGemma
  a simplified version of Google's Gemma model to be used for learning
  ☆26Updated last year
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆90Updated 2 years ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆67Updated last year