jorahn / llama-int8

Related projects ⓘ

Alternatives and complementary repositories for llama-int8

• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• AlpinDale / LLM-Shearing
  Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆28Updated 9 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆51Updated 8 months ago
• dvruette / concept-guidance
  Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…
  ☆16Updated 8 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆17Updated 5 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• NolanoOrg / llama-int4-quant
  ☆26Updated last year
• ahmed-moubtahij / TokenHealer
  ☆21Updated 5 months ago
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆75Updated last year
• minimaxir / pokemon-embeddings
  Jupyter Notebooks and an R Notebook for encoding Pokémon embeddings and creating data visualizations.
  ☆16Updated 4 months ago
• abetlen / program-constrained-language-model-sampling
  ☆34Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆43Updated this week
• mrcolo / longboii
  ☆19Updated last year
• Netwrck / stable-diffusion-server
  Image Generation API Server - Similar to https://text-generator.io but for images
  ☆46Updated 2 months ago
• euclaise / supertrainer2000
  ☆49Updated 8 months ago
• catid / lllm
  Latent Large Language Models
  ☆16Updated 2 months ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆15Updated 2 weeks ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆15Updated 2 weeks ago
• shawwn / jaxnotes
  ☆20Updated 3 years ago
• kyegomez / FastFF
  Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"
  ☆15Updated this week
• skeskinen / llama-lite
  Embeddings focused small version of Llama NLP model
  ☆102Updated last year
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated last year
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆25Updated last year
• IsaacRe / Syntactically-Constrained-Sampling
  LLM sampling method for enforcing syntax adherence in generated output
  ☆21Updated last year
• wbrown / gpt_bpe
  GPT2 Byte Pair Encoding implementation in Golang
  ☆24Updated last week