jorahn / llama-int8

Related projects ⓘ

Alternatives and complementary repositories for llama-int8

• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• AlpinDale / LLM-Shearing
  Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆28Updated 9 months ago
• NolanoOrg / llama-int4-quant
  ☆26Updated last year
• ahmed-moubtahij / TokenHealer
  ☆21Updated 5 months ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆51Updated 9 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated 10 months ago
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆42Updated 8 months ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆56Updated 10 months ago
• mattneary / colorspace
  assign color hues to a collection of text fragments based on embeddings
  ☆20Updated 5 months ago
• Birch-san / k-diffusion
  Karras et al. (2022) diffusion models for PyTorch
  ☆19Updated 5 months ago
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆75Updated last year
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated last year
• Netwrck / stable-diffusion-server
  Image Generation API Server - Similar to https://text-generator.io but for images
  ☆47Updated 2 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆45Updated this week
• LeonEricsson / llmcontext
  Pressure testing the context window of open LLMs
  ☆22Updated 2 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 7 months ago
• joey00072 / TinyLora
  Low-Rank Adaptation of Large Language Models clean implementation
  ☆9Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆102Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆66Updated last year
• Birch-san / llama-play
  Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations
  ☆33Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆22Updated 9 months ago
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• abetlen / program-constrained-language-model-sampling
  ☆34Updated last year
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated 8 months ago
• mrcolo / longboii
  ☆19Updated last year