jploski / ggmlLinks
Falcon7B + Falcon40B support - in branch falcon40b. Now all good and working. But main action now in https://github.com/cmp-nct/ggllm.cpp
☆11Updated last year
Alternatives and similar repositories for ggml
Users that are interested in ggml are comparing it to the libraries listed below
Sorting:
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated 2 years ago
- The code we currently use to fine-tune models.☆114Updated last year
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- ☆31Updated last year
- GPT-2 small trained on phi-like data☆66Updated last year
- A Qt GUI for large language models☆43Updated last year
- Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.☆70Updated 2 years ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆171Updated last year
- Command-line script for inferencing from models such as falcon-7b-instruct☆75Updated 2 years ago
- ☆27Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- ☆73Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year
- Makes llama.cpp easy to use.☆12Updated 3 weeks ago
- Instruct-tuning LLaMA on consumer hardware☆66Updated 2 years ago
- Simple and fast server for GPTQ-quantized LLaMA inference☆24Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆109Updated 7 months ago
- A Simple Discord Bot for the Alpaca LLM☆101Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- Harnessing the Memory Power of the Camelids☆146Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- 4 bits quantization of LLaMa using GPTQ☆129Updated 2 years ago
- Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.☆35Updated last year
- Experimental sampler to make LLMs more creative☆31Updated last year
- ☆157Updated 10 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆116Updated 9 months ago