lunabrain-ai / dolly-v2-12b-8bit-example
This repo loads the Dolly V2 12b model (databricks/dolly-v2-12b) using the `transformers` library. The code loads it in 8-bit quantized mode.
☆26Updated last year
Related projects ⓘ
Alternatives and complementary repositories for dolly-v2-12b-8bit-example
- ☆39Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated last year
- Embedding models from Jina AI☆56Updated 10 months ago
- A Python program leveraging OpenAI's language models to generate, analyze, and select the best answer to a given question.☆44Updated last year
- CLI to monitor your program's OpenAI API token usage.☆57Updated last year
- ☆38Updated last month
- A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS☆92Updated last year
- ☆55Updated last year
- An engine for generating recursive documentation and using it to work on a project with ChatGPT☆43Updated 10 months ago
- GPT / Human collaboration mindmap tool, using OpenAI ChatGPT API☆99Updated last year
- PromptMate is your AI partner to develop code.☆90Updated last year
- A LLama agent that builds startup ideas from your intutions (generates react codebases)☆56Updated last year
- Powered by SideGuide and GPT-3☆12Updated last year
- Code examples from the ChatGPT plugin documentation.☆56Updated last year
- An auto generated wiki.☆21Updated last year
- A simple library to send, receive and verify structured data (JSON) to OpenAI and other LLMs.☆38Updated last year
- A minimalist Docker project to help people getting started with Node, WizardCoder, CTransformers, Python, Express and TypeScript. Ready t…☆14Updated last year
- A number of experiments using GPT-3, delivered in a web app☆48Updated last year
- A collection of character cards for use in AI Roleplaying☆84Updated last year
- Local LLaMAs/Models in VSCode☆54Updated last year
- ☆38Updated last year
- Using embeddings to create memory.☆31Updated last year
- LLM chatbot server with ChatGPT plugins☆38Updated last year
- JSON parser for streaming objects live from an LLM's output☆27Updated 9 months ago
- ☆144Updated last year
- ☆56Updated last year
- ☆29Updated last year
- ☆19Updated last year
- A backend API to perform search over Wikipedia using LangChain, Cohere and Weaviate☆105Updated last year