Inference on CPU code for LLaMA models
☆136Mar 19, 2023Updated 3 years ago
Alternatives and similar repositories for llama-cpu
Users that are interested in llama-cpu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Chat with Meta's LLaMA models at home made easy☆841Apr 2, 2023Updated 3 years ago
- Fork of Facebooks LLaMa model to run on CPU☆766Mar 6, 2023Updated 3 years ago
- LLaMA implementation for HuggingFace Transformers☆38Mar 17, 2023Updated 3 years ago
- ☆16Jun 6, 2023Updated 3 years ago
- Inference code for LLaMA models with Gradio Interface and rolling generation like ChatGPT☆48Mar 15, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Example of Alpaca-LoRA with llama index.☆31Mar 30, 2023Updated 3 years ago
- The zhong [|] Chinese grammars☆15Jul 24, 2026Updated 2 weeks ago
- ☆26Mar 5, 2023Updated 3 years ago
- A simple package for leveraging Falcon 180B and the HF ecosystem's tools, including training/inference scripts, safetensors, integrations…☆12Mar 11, 2024Updated 2 years ago
- Connect to a GitHub Action runner via SSH through an ngrok tunnel.☆15Dec 5, 2024Updated last year
- [COLM 2025] Official code for "When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoni…☆15Oct 31, 2025Updated 9 months ago
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆39Aug 29, 2025Updated 11 months ago
- 4 bits quantization of LLaMA using GPTQ☆3,071Jul 13, 2024Updated 2 years ago
- Keyword spaCy is a spaCy pipeline component for extracting keywords from text using cosine similarity.☆14Dec 7, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆12Mar 19, 2021Updated 5 years ago
- Easy to use hybrid index for semantic + keyword search.☆17Jul 19, 2023Updated 3 years ago
- llmon-py is a multimodal webui for Llama 3-8B.☆16Jul 1, 2024Updated 2 years ago
- Quantized inference code for LLaMA models☆1,037Mar 17, 2023Updated 3 years ago
- This repository keep my research materials about Named Entity Recognition using Transfer Learning☆10Oct 15, 2020Updated 5 years ago
- Quillan-Ronin - an attempt at a mini Software 3.0 runtime on Universal BitNet 1.58-bit logic and a 9B EGGROLL Swarm. v6.0.3 Quantum featu…☆26Updated this week
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Explainability of Deep RL algorithms using graph networks and layer-wise relevance propagation.☆12Aug 20, 2024Updated last year
- Waffer-thin FlaskGPT on Vercel.☆12Jun 1, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Data and code for APPDIA: A Discourse-aware Transformer-based Style Transfer Model for Offensive Social Media Conversations (COLING 2022)…☆13Sep 8, 2022Updated 3 years ago
- 🔬 💾 📟 | Microprocessor Course CEIT@AUT☆11Aug 16, 2019Updated 6 years ago
- Python package for Geometric / Clifford Algebra with Pytorch.☆16Jun 2, 2026Updated 2 months ago
- The page with all info about SOTA text detoxification models and datasets.☆14Apr 2, 2025Updated last year
- A specification for DID create/update/deactivate operations.☆11Jan 3, 2025Updated last year
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆33Mar 2, 2025Updated last year
- Implementation of some algorithms for text clustering☆14Sep 5, 2018Updated 7 years ago
- For converting LLM datasets from one format into another.☆22Nov 12, 2025Updated 8 months ago
- Fine-Tuning and Evaluating a Falcon 7B Model for generating HTML code from input prompts.☆11Jan 6, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repository hosts the dataset for the paper Computer Science Named Entity Recognition in the Open Research Knowledge Graph☆21Jan 8, 2024Updated 2 years ago
- ☆21Dec 14, 2024Updated last year
- ☆17Jul 29, 2024Updated 2 years ago
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆22Jul 27, 2024Updated 2 years ago
- ☆12Mar 14, 2024Updated 2 years ago
- Inference code for facebook LLaMA models with Wrapyfi support☆128Mar 16, 2023Updated 3 years ago
- 一个关于血色衣冠的对话机器人， 基于 Rasa, 可语音与机器人对话☆27Jun 18, 2022Updated 4 years ago