Inference on CPU code for LLaMA models
☆136Mar 19, 2023Updated 3 years ago
Alternatives and similar repositories for llama-cpu
Users that are interested in llama-cpu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Chat with Meta's LLaMA models at home made easy☆839Apr 2, 2023Updated 3 years ago
- Fork of Facebooks LLaMa model to run on CPU☆766Mar 6, 2023Updated 3 years ago
- LLaMA implementation for HuggingFace Transformers☆38Mar 17, 2023Updated 3 years ago
- ☆16Jun 6, 2023Updated 3 years ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Dec 2, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆457Oct 15, 2023Updated 2 years ago
- Example of Alpaca-LoRA with llama index.☆31Mar 30, 2023Updated 3 years ago
- A repository dedicated to exploring and analyzing the latest developments in Generative AI☆26Apr 1, 2025Updated last year
- ☆26Mar 5, 2023Updated 3 years ago
- ☆17Jan 5, 2023Updated 3 years ago
- Open ChatGLM Eyes to See the World☆13Mar 30, 2023Updated 3 years ago
- Corpus Annotation Graph builder (CAG) is an architectural framework that employs the build-and-annotate pattern for creating a graph.☆14Dec 7, 2023Updated 2 years ago
- Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.☆19Feb 12, 2025Updated last year
- Python wrapper for the CWB to extract concordances and score frequency lists☆22May 11, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A simple package for leveraging Falcon 180B and the HF ecosystem's tools, including training/inference scripts, safetensors, integrations…☆12Mar 11, 2024Updated 2 years ago
- Connect to a GitHub Action runner via SSH through an ngrok tunnel.☆15Dec 5, 2024Updated last year
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆39Aug 29, 2025Updated 10 months ago
- A simple extension that uses Bark Text-to-Speech for audio output☆10Nov 20, 2023Updated 2 years ago
- 4 bits quantization of LLaMA using GPTQ☆3,073Jul 13, 2024Updated last year
- An MCP tool server that provides stateful, TUI-compatible terminal sessions.☆15Feb 3, 2025Updated last year
- ☆10Jul 14, 2019Updated 6 years ago
- Digital Research Toolkit for Linguists course materials☆12Jul 23, 2025Updated 11 months ago
- llmon-py is a multimodal webui for Llama 3-8B.☆16Jul 1, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Quantized inference code for LLaMA models☆1,038Mar 17, 2023Updated 3 years ago
- A Streamlit application to visualize sentence embeddings☆18Dec 21, 2022Updated 3 years ago
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- This is a Kotlin Multiplatform (KMM) app, a movies catalogue that runs seamlessly on both iOS and Android using Compose Multiplatform (CM…☆14Jun 19, 2025Updated last year
- Script for Debian based systems to easily install Matrix-Synapse☆14Oct 14, 2024Updated last year
- code for our paper "Understanding by Understanding Not: Modeling Negation in Language Models"☆16Aug 15, 2022Updated 3 years ago
- Synthèses vocale piper oobabooga☆14Feb 24, 2024Updated 2 years ago
- Data and code for APPDIA: A Discourse-aware Transformer-based Style Transfer Model for Offensive Social Media Conversations (COLING 2022)…☆13Sep 8, 2022Updated 3 years ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆67Nov 5, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ComfyUI node to create SVG vector using Potrace☆25May 8, 2025Updated last year
- Discord archive tool☆27Aug 8, 2022Updated 3 years ago
- Support for language highlighting of KECC(KAIST Educational C Compiler) IR☆12May 17, 2022Updated 4 years ago
- The page with all info about SOTA text detoxification models and datasets.☆14Apr 2, 2025Updated last year
- Implementation of some algorithms for text clustering☆14Sep 5, 2018Updated 7 years ago
- ☆13Jan 14, 2026Updated 5 months ago
- ☆21Dec 14, 2024Updated last year