lunabrain-ai / dolly-v2-12b-8bit-example
This repo loads the Dolly V2 12b model (databricks/dolly-v2-12b) using the `transformers` library. The code loads it in 8-bit quantized mode.
☆26Updated last year
Alternatives and similar repositories for dolly-v2-12b-8bit-example:
Users that are interested in dolly-v2-12b-8bit-example are comparing it to the libraries listed below
- ☆19Updated 10 months ago
- A Datasette plugin that turns a Datasette instance into a ChatGPT plugin☆67Updated 11 months ago
- ☆64Updated last year
- Local LLaMAs/Models in VSCode☆52Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated last year
- Powered by SideGuide and GPT-3☆12Updated last year
- ✨ Make your LLM prompts executable and version controlled. ✨☆75Updated last year
- An Infr app that automates data collection from your PC, macOS or Linux client.☆11Updated last year
- ☆38Updated last year
- 🌸 The open framework for question answering fine-tuning LLMs on private data☆69Updated last year
- A LLama agent that builds startup ideas from your intutions (generates react codebases)☆56Updated last year
- JavaScript implementation of LiteLLM.☆108Updated last week
- A number of experiments using GPT-3, delivered in a web app☆48Updated last year
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU☆102Updated last year
- A backend API to perform search over Wikipedia using LangChain, Cohere and Weaviate☆105Updated last year
- Embedding models from Jina AI☆57Updated last year
- ☆55Updated last year
- GoalChain for goal-orientated LLM conversation flows☆67Updated last month
- This repo guides you through building a chatbot on your own data with self hosted LLM☆90Updated last year
- ☆24Updated last year
- A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS☆92Updated last year
- A web-app to explore topics using LLM (less typing and more clicks)☆66Updated last year
- ☆114Updated 7 months ago
- ☆29Updated last year
- Visual Studio Code extension for WizardCoder☆145Updated last year
- Code examples from the ChatGPT plugin documentation.☆56Updated last year
- Run Large-Language Models (LLMs) 🚀 directly in your browser!☆175Updated 4 months ago
- a nextjs app to implement reading documents using openai (embeddings and chat model), pinecone for vectors store and langchain.☆51Updated last year
- ☆10Updated 9 months ago
- Experimental AI chat app☆24Updated 3 weeks ago