anordin95 / run-llama-locallyLinks
Run and explore Llama models locally with minimal dependencies on CPU
☆191Updated 8 months ago
Alternatives and similar repositories for run-llama-locally
Users that are interested in run-llama-locally are comparing it to the libraries listed below
Sorting:
- Docker-based inference engine for AMD GPUs☆231Updated 8 months ago
- A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transpar…☆192Updated last week
- ai for jq☆242Updated 9 months ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆236Updated 2 years ago
- Fully neural approach for text chunking☆357Updated last month
- CLI based packet reader in Python.☆109Updated last week
- LLM plugin for pulling content from Hacker News☆109Updated last month
- Dead Simple LLM Abliteration☆219Updated 4 months ago
- ☆279Updated 2 weeks ago
- Financial instrument definitions built with Python and Pydantic☆195Updated 4 months ago
- A lightweight protocol-aware packet analyzer and behavioral exporter. Created as a personal response to global academic freedom challenge…☆294Updated 2 weeks ago
- ☆196Updated last month
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆221Updated 6 months ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆252Updated last year
- When AI Fails is a project dedicated to documenting the funny, interesting, and sometimes outright stupid ways in which AI can fail.☆61Updated 2 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆285Updated 3 weeks ago
- ☆121Updated last month
- ☆163Updated 3 months ago
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated last year
- R.L. methods and techniques.☆190Updated 7 months ago
- ☆96Updated 8 months ago
- ☆163Updated 11 months ago
- Generate Cool-Looking Mazes and Animations Illustrating the A* Pathfinding Algorithm☆177Updated 3 months ago
- A CLI to manage install and configure llama inference implemenation in multiple languages☆67Updated last year
- Applying the ideas of Deepseek R1 to computer use☆214Updated 4 months ago
- Animating R1's thoughts.☆382Updated 4 months ago
- A monitoring station for carnivorous flora.☆128Updated last month
- A command-line interface for LLMs written in Bash.☆437Updated 4 months ago
- This is a numpy implementation of the Skip-gram algorithm described in Mikolov et al's Word2Vec paper. It is intended for didactic purpos…☆36Updated 2 years ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆351Updated last month