Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
☆123Jun 16, 2023Updated 3 years ago
Alternatives and similar repositories for landmark-attention-qlora
Users that are interested in landmark-attention-qlora are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆427Dec 20, 2023Updated 2 years ago
- ☆28Aug 30, 2023Updated 3 years ago
- A plugin for Oobabooga TextUI that allows you to search multiple search engines. Initially we're using Google API or DuckDuckGo.☆17Jun 4, 2023Updated 3 years ago
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- Customizable implementation of the self-instruct paper.☆1,053Mar 7, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Jun 13, 2023Updated 3 years ago
- Simple and fast server for GPTQ-quantized LLaMA inference☆24May 18, 2023Updated 3 years ago
- BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui☆86May 6, 2023Updated 3 years ago
- ☆165Jun 1, 2023Updated 3 years ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,943Sep 30, 2023Updated 3 years ago
- [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization☆724Aug 13, 2024Updated 2 years ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆36May 14, 2024Updated 2 years ago
- BabyAGI to run with GPT4All☆246May 14, 2023Updated 3 years ago
- Buzz AI, aka gt-chat, is a fast and intuitive question-answering chatbot for Georgia Tech. Powered by Next.js, FastAPI, and OpenAI, it so…☆30Apr 13, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆142Oct 17, 2023Updated 3 years ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Jul 29, 2023Updated 3 years ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆32May 25, 2023Updated 3 years ago
- Tune any FALCON in 4-bit☆460Sep 1, 2023Updated 3 years ago
- A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda☆21Mar 27, 2023Updated 3 years ago
- Patch for MPT-7B which allows using and training a LoRA☆57May 20, 2023Updated 3 years ago
- Compile docker images into a single self-contained binary☆21Apr 30, 2026Updated 5 months ago
- The fingerprinting library for Rust☆14Mar 30, 2026Updated 6 months ago
- Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA☆80Dec 15, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆533Dec 1, 2023Updated 2 years ago
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 3 years ago
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 3 years ago
- Tokun to can tokens☆17Jun 19, 2025Updated last year
- Train Llama Loras Easily☆30Aug 3, 2023Updated 3 years ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆19Aug 30, 2024Updated 2 years ago
- Provides pipeAsync and traversePromises functions that play well with the rest of Ramda ecosystem.☆12Jan 30, 2024Updated 2 years ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆70Nov 17, 2025Updated 11 months ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆333Oct 21, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Implementation of "Generative Agents: Interactive Simulacra of Human Behavior" paper with Guidance and Langchain. Full features and work …☆282Sep 4, 2023Updated 3 years ago
- An extension for text-generation-webui by oobabooga. Adds options to keep tabs on page and to move extensions into a sidebar.☆23Sep 24, 2023Updated 3 years ago
- Experimental sampler to make LLMs more creative☆31Aug 2, 2023Updated 3 years ago
- Self-evaluating interview for AI coders☆597Jun 21, 2025Updated last year
- Discord chatbot interface to train an LLM on user message history☆27Jun 9, 2023Updated 3 years ago
- Local LLM ReAct Agent with Guidance☆156May 23, 2023Updated 3 years ago
- A program to automate testing open source LLMs for their political compass scores☆11Aug 24, 2026Updated last month