ggerganov / llama2.c
Inference Llama 2 in one file of pure C
☆29Updated last year
Related projects: ⓘ
- GRDN.AI app for garden optimization☆68Updated 7 months ago
- Drop in replacement for OpenAI, but with Open models.☆154Updated last year
- Port of Microsoft's BioGPT in C/C++ using ggml☆87Updated 7 months ago
- Hugging Face's Zapier Integration 🤗⚡️☆47Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆117Updated 8 months ago
- Instruct-tuning LLaMA on consumer hardware☆66Updated last year
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆154Updated 11 months ago
- An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast☆131Updated 2 weeks ago
- Web browser version of StarCoder.cpp☆43Updated last year
- Inference of Large Multimodal Models in C/C++. LLaVA and others☆46Updated 11 months ago
- inference code for mixtral-8x7b-32kseqlen☆97Updated 9 months ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆25Updated 11 months ago
- Falcon40B and 7B (Instruct) with streaming, top-k, and beam search☆39Updated last year
- GGML implementation of BERT model with Python bindings and quantization.☆25Updated 7 months ago
- manage histories of LLM applied applications☆86Updated 10 months ago
- Python bindings for ggml☆125Updated 2 weeks ago
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆37Updated 10 months ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆217Updated 6 months ago
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆109Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆102Updated last year
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆161Updated 8 months ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆34Updated last year
- Embeddings focused small version of Llama NLP model☆101Updated last year
- [WIP] A 🔥 interface for running code in the cloud☆86Updated last year
- ☆64Updated 3 months ago
- ☆32Updated 7 months ago
- The Next Generation Multi-Modality Superintelligence☆69Updated 2 weeks ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 2 weeks ago
- Collection of recipes aiding Gen AI model development☆78Updated 3 weeks ago