Inference on CPU code for LLaMA models
☆136Mar 19, 2023Updated 3 years ago
Alternatives and similar repositories for llama-cpu
Users that are interested in llama-cpu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Chat with Meta's LLaMA models at home made easy☆842Apr 2, 2023Updated 2 years ago
- Inference code for LLaMA models☆46Mar 5, 2023Updated 3 years ago
- LLaMA implementation for HuggingFace Transformers☆38Mar 17, 2023Updated 3 years ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Dec 2, 2024Updated last year
- ☆457Oct 15, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆17Jan 5, 2023Updated 3 years ago
- Open ChatGLM Eyes to See the World☆13Mar 30, 2023Updated 2 years ago
- Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.☆19Feb 12, 2025Updated last year
- ☆14Jun 4, 2025Updated 9 months ago
- The zhong [|] Chinese grammars☆15Mar 13, 2026Updated 2 weeks ago
- NLP-helper for OCR-ed pages in PAGE XML format☆10Dec 6, 2024Updated last year
- To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …☆11Jun 18, 2024Updated last year
- A simple package for leveraging Falcon 180B and the HF ecosystem's tools, including training/inference scripts, safetensors, integrations…☆12Mar 11, 2024Updated 2 years ago
- 4 bits quantization of LLaMA using GPTQ☆3,073Jul 13, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- An MCP tool server that provides stateful, TUI-compatible terminal sessions.☆14Feb 3, 2025Updated last year
- This project is based on the original code of the inteoryx / twitter-video-dl project, which allows users to download Twitter videos as M…☆13Nov 13, 2025Updated 4 months ago
- This repository provides German documentation relating to the text recognition and transcription platform eScriptorium. The documentation…☆14Dec 6, 2025Updated 3 months ago
- Digital Research Toolkit for Linguists course materials☆12Jul 23, 2025Updated 8 months ago
- A specification for DID create/update/deactivate operations.☆11Jan 3, 2025Updated last year
- llmon-py is a multimodal webui for Llama 3-8B.☆16Jul 1, 2024Updated last year
- Quantized inference code for LLaMA models☆1,042Mar 17, 2023Updated 3 years ago
- Telegram user console client and archiver☆35Feb 26, 2026Updated last month
- The Indox Ecosystem offers integrated AI tools for data workflows. Our four components (IndoxArcg, IndoxMiner, IndoxJudge, and IndoxGen) …☆19Feb 5, 2026Updated last month
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- A Streamlit application to visualize sentence embeddings☆18Dec 21, 2022Updated 3 years ago
- Automated Semantic Analysis of Discourse Markers☆11May 30, 2022Updated 3 years ago
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Jan 5, 2026Updated 2 months ago
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆33Mar 2, 2025Updated last year
- Waffer-thin FlaskGPT on Vercel.☆12Jun 1, 2023Updated 2 years ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆67Nov 5, 2024Updated last year
- Synthèses vocale piper oobabooga☆14Feb 24, 2024Updated 2 years ago
- Open-source Verifiable Data Structures Server implementation☆13Aug 12, 2025Updated 7 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Wikibase extension that allows defining RDF mappings for Wikibase Entities☆16Feb 2, 2026Updated last month
- Molecule QEMU driver for testing Ansible roles☆13Oct 28, 2024Updated last year
- Support for language highlighting of KECC(KAIST Educational C Compiler) IR☆12May 17, 2022Updated 3 years ago
- ☆14Feb 2, 2019Updated 7 years ago
- This repository hosts the dataset for the paper Computer Science Named Entity Recognition in the Open Research Knowledge Graph☆21Jan 8, 2024Updated 2 years ago
- Ready-to-use examples of dkpro-core components and pipelines.☆35Dec 16, 2023Updated 2 years ago
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆23Jul 27, 2024Updated last year