ggerganov / llama.cpp
LLM inference in C/C++
☆64,973Updated this week
Related projects: ⓘ
- Inference code for Llama models☆55,482Updated last month
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆69,175Updated this week
- OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…☆36,945Updated last month
- Port of OpenAI's Whisper model in C/C++☆34,415Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆36,446Updated this week
- A Gradio web UI for Large Language Models.☆39,557Updated this week
- Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.☆89,278Updated this week
- 🦜🔗 Build context-aware reasoning applications☆92,335Updated this week
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆29,346Updated 2 months ago
- Robust Speech Recognition via Large-Scale Weak Supervision☆67,539Updated last week
- Making large AI models cheaper, faster and more accessible☆38,614Updated this week
- Interact with your documents using the power of GPT, 100% privately, no data leaks☆53,578Updated this week
- LlamaIndex is a data framework for your LLM applications☆35,450Updated this week
- 🔊 Text-Prompted Generative Audio Model☆35,297Updated last month
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆36,216Updated last month
- Universal LLM Deployment Engine with ML Compilation☆18,642Updated this week
- JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf☆23,547Updated 4 months ago
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆32,206Updated this week
- ☆34,515Updated 8 months ago
- User-friendly WebUI for LLMs (Formerly Ollama WebUI)☆39,197Updated this week
- A natural language interface for computers☆52,216Updated this week
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…☆23,347Updated this week
- Examples and guides for using the OpenAI API☆58,567Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆34,719Updated this week
- AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus o…☆166,540Updated this week
- Instruct-tune LLaMA on consumer hardware☆18,537Updated last month
- Inference code for CodeLlama models☆15,861Updated last month
- 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.☆31,358Updated this week
- A latent text-to-image diffusion model☆67,534Updated 3 months ago
- 🐙 Guides, papers, lecture, notebooks and resources for prompt engineering☆47,705Updated last week