Inference on CPU code for LLaMA models
☆136Mar 19, 2023Updated 3 years ago
Alternatives and similar repositories for llama-cpu
Users that are interested in llama-cpu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Chat with Meta's LLaMA models at home made easy☆839Apr 2, 2023Updated 3 years ago
- Fork of Facebooks LLaMa model to run on CPU☆766Mar 6, 2023Updated 3 years ago
- LLaMA implementation for HuggingFace Transformers☆38Mar 17, 2023Updated 3 years ago
- Unofficial pytorch implementation of 'SelectiveNet: A Deep Neural Network with an Integrated Reject Option' [Geifman+, ICML2019]☆20Oct 5, 2021Updated 5 years ago
- ☆16Jun 6, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Dec 29, 2021Updated 4 years ago
- ☆453Oct 15, 2023Updated 3 years ago
- 4 bits quantization of LLaMA using GPTQ☆3,069Jul 13, 2024Updated 2 years ago
- Example of Alpaca-LoRA with llama index.☆31Mar 30, 2023Updated 3 years ago
- A variant of Ahash written in C++.☆10Mar 20, 2023Updated 3 years ago
- Quantized inference code for LLaMA models☆1,034Mar 17, 2023Updated 3 years ago
- ☆10Jul 14, 2019Updated 7 years ago
- A simple package for leveraging Falcon 180B and the HF ecosystem's tools, including training/inference scripts, safetensors, integrations…☆12Mar 11, 2024Updated 2 years ago
- High-speed download of LLaMA, Facebook's 65B parameter GPT model☆4,105Jun 28, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆26Mar 5, 2023Updated 3 years ago
- Python wrapper for the CWB to extract concordances and score frequency lists☆22Oct 8, 2026Updated 3 weeks ago
- A repository dedicated to exploring and analyzing the latest developments in Generative AI☆27Apr 1, 2025Updated last year
- ☆17Jan 5, 2023Updated 3 years ago
- Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.☆19Feb 12, 2025Updated last year
- A simple extension that uses Bark Text-to-Speech for audio output☆10Nov 20, 2023Updated 2 years ago
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆41Aug 29, 2025Updated last year
- This project is based on the original code of the inteoryx / twitter-video-dl project, which allows users to download Twitter videos as M…☆14Updated this week
- Open LLaMA Eyes to See the World☆175Apr 16, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Dec 2, 2022Updated 3 years ago
- Keyword spaCy is a spaCy pipeline component for extracting keywords from text using cosine similarity.☆14Dec 7, 2023Updated 2 years ago
- A simple Discord bot for doing AI stuff with☆10Jul 9, 2026Updated 3 months ago
- llmon-py is a multimodal webui for Llama 3-8B.☆16Jul 1, 2024Updated 2 years ago
- Multi-layer perceptron, Autoencoder, and Restricted Boltzmann Machine☆10Sep 15, 2018Updated 8 years ago
- ☆10Dec 12, 2023Updated 2 years ago
- Obsidian community plugin: your vault as a private, self-hosted NotebookLM alternative. A built-in manager downloads and runs local AI mo…☆11Updated this week
- A rust mlx server, ui, and model router for fast, dependency free inference on apple architecture☆34Updated this week
- Quillan-Ronin - a sovereign mini Software 3.0 runtime on Universal BitNet 1.58-bit logic and a 9B EGGROLL Swarm. v5.4.0-oni features a 34…☆27Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- EMNLP 2025 "LLMs are Better Than You Think: Label-Guided In-Context Learning for Named Entity Recognition"☆16Nov 4, 2025Updated 11 months ago
- This repository provides German documentation relating to the text recognition and transcription platform eScriptorium. The documentation…☆17Oct 5, 2026Updated 3 weeks ago
- Rust task graph library☆14Mar 24, 2015Updated 11 years ago
- A lightweight macOS app for LLM API proxying — automatic format translation (Anthropic ↔ OpenAI), parameter injection, model mapping, and…☆10Jul 24, 2026Updated 3 months ago
- Rust for Embedded Deep Learning Model☆13Mar 23, 2020Updated 6 years ago
- A Streamlit application to visualize sentence embeddings☆17Dec 21, 2022Updated 3 years ago
- Generating Labeled Image Datasets using Stable Diffusion Models☆28Aug 24, 2025Updated last year