Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
☆123Jun 16, 2023Updated 3 years ago
Alternatives and similar repositories for landmark-attention-qlora
Users that are interested in landmark-attention-qlora are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆427Dec 20, 2023Updated 2 years ago
- Simple and fast server for GPTQ-quantized LLaMA inference☆24May 18, 2023Updated 3 years ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Jun 13, 2023Updated 3 years ago
- ☆28Aug 30, 2023Updated 3 years ago
- Customizable implementation of the self-instruct paper.☆1,053Mar 7, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A plugin for Oobabooga TextUI that allows you to search multiple search engines. Initially we're using Google API or DuckDuckGo.☆17Jun 4, 2023Updated 3 years ago
- ☆165Jun 1, 2023Updated 3 years ago
- BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui☆86May 6, 2023Updated 3 years ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆142Oct 17, 2023Updated 3 years ago
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- BabyAGI to run with GPT4All☆246May 14, 2023Updated 3 years ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆36May 14, 2024Updated 2 years ago
- [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization☆724Aug 13, 2024Updated 2 years ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,946Sep 30, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- GoldFinch and other hybrid transformer components☆47Jul 20, 2024Updated 2 years ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Jul 29, 2023Updated 3 years ago
- Buzz AI, aka gt-chat, is a fast and intuitive question-answering chatbot for Georgia Tech. Powered by Next.js, FastAPI, and OpenAI, it so…☆30Apr 13, 2023Updated 3 years ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆32May 25, 2023Updated 3 years ago
- ☆23Dec 26, 2023Updated 2 years ago
- Tune any FALCON in 4-bit☆461Sep 1, 2023Updated 3 years ago
- Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA☆80Dec 15, 2023Updated 2 years ago
- Discord chatbot interface to train an LLM on user message history☆27Jun 9, 2023Updated 3 years ago
- A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda☆21Mar 27, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆533Dec 1, 2023Updated 2 years ago
- Patch for MPT-7B which allows using and training a LoRA☆57May 20, 2023Updated 3 years ago
- Compile docker images into a single self-contained binary☆21Apr 30, 2026Updated 6 months ago
- The fingerprinting library for Rust☆15Mar 30, 2026Updated 7 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Jun 21, 2023Updated 3 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,590Mar 23, 2025Updated last year
- ☆415Nov 2, 2023Updated 3 years ago
- A repository to perform self-instruct with a model on HF Hub☆32Sep 29, 2023Updated 3 years ago
- Easily create LLM automation/agent workflows☆60Feb 13, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆11Feb 20, 2025Updated last year
- Open Source Memory Layer for Your AI☆14Oct 18, 2025Updated last year
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 3 years ago
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 3 years ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated last year
- Ungreedy subword tokenizer and vocabulary trainer for Python, Go, C++ & Javascript☆625Jul 10, 2026Updated 3 months ago
- Finetune any model on HF in less than 30 seconds☆59Oct 26, 2026Updated last week