jorahn / llama-int8Links
Quantized inference code for LLaMA models
☆13Updated 2 years ago
Alternatives and similar repositories for llama-int8
Users that are interested in llama-int8 are comparing it to the libraries listed below
Sorting:
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Trying to deconstruct RWKV in understandable terms☆14Updated 2 years ago
- ☆27Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.☆56Updated 3 years ago
- Command-line script for inferencing from models such as falcon-7b-instruct☆75Updated 2 years ago
- Image Generation API Server - Similar to https://text-generator.io but for images☆50Updated last week
- A curve-editor for Stable Diffusion prompt interpolation☆21Updated 2 years ago
- Experimental sampler to make LLMs more creative☆31Updated last year
- ☆40Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- GPT-jax based on the official huggingface library☆13Updated 4 years ago
- Mistral7B playing DOOM☆28Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- ☆28Updated last year
- BIG: Back In the Game of Creative AI☆27Updated 2 years ago
- ☆19Updated 2 years ago
- Train Llama Loras Easily☆31Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆64Updated last year
- Frontend (and soon also midleware and backend) for a new, opensource image generation platform.☆14Updated 2 years ago
- ☆22Updated last year
- Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆28Updated last year
- ☆50Updated last year
- Floral Diffusion is a custom diffusion model trained by jags using a DD 5.6 version☆26Updated 2 years ago
- Repository with which to explore k-diffusion and diffusers, and within which changes to said packages may be tested.☆53Updated last year
- ☆32Updated 2 years ago
- Simple LLM inference server☆20Updated last year
- Use Datasette to explore LAION improved_aesthetics_6plus training data used by Stable DIffusion☆58Updated last year
- ☆49Updated last week
- ☆1Updated 4 months ago