lunabrain-ai / dolly-v2-12b-8bit-exampleLinks
This repo loads the Dolly V2 12b model (databricks/dolly-v2-12b) using the `transformers` library. The code loads it in 8-bit quantized mode.
☆26Updated 2 years ago
Alternatives and similar repositories for dolly-v2-12b-8bit-example
Users that are interested in dolly-v2-12b-8bit-example are comparing it to the libraries listed below
Sorting:
- PromptMate is your AI partner to develop code.☆91Updated 2 years ago
- ☆39Updated 2 years ago
- Run Alpaca LLM in LangChain☆215Updated last year
- AI functions for Typescript☆79Updated 2 years ago
- 🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code☆254Updated 2 years ago
- Local LLaMAs/Models in VSCode☆54Updated 2 years ago
- CodeSpin.AI Code Generation Tools☆60Updated 9 months ago
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆212Updated 2 years ago
- AI Agent Visualization and Runner written in Pure TS☆78Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆333Updated last year
- GPT in your browser☆90Updated 2 years ago
- Visual Studio Code extension for WizardCoder☆148Updated 2 years ago
- ☆144Updated 2 years ago
- An engine for generating recursive documentation and using it to work on a project with ChatGPT☆42Updated last year
- A ChatGPT UI for young readers, written by ChatGPT☆69Updated 2 years ago
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆332Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆140Updated last year
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated last year
- JS tokenizer for LLaMA 1 and 2☆360Updated last year
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆70Updated 2 years ago
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆323Updated 2 years ago
- Access the latest AI models like ChatGPT, LLaMA, Deepseek, Diffusion, Hugging face, and beyond through a unified prompt layer and perform…☆266Updated last week
- OpenAI-compatible Python client that can call any LLM☆372Updated 2 years ago
- ☆10Updated last year
- The library for character-driven AI experiences.☆88Updated last year
- Provide a way to use the GPT-QLLama model as an API☆43Updated 2 years ago
- A simple library to send, receive and verify structured data (JSON) to OpenAI and other LLMs.☆39Updated 2 years ago
- A prompt/context management system☆170Updated 2 years ago
- ☆53Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated 2 years ago