recmo / cria
Tiny inference-only implementation of LLaMA
☆92Updated last year
Alternatives and similar repositories for cria:
Users that are interested in cria are comparing it to the libraries listed below
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆153Updated last year
- ☆155Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated 10 months ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆30Updated last year
- ☆163Updated 10 months ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆40Updated last year
- WebGPU LLM inference tuned by hand☆149Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆159Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated 8 months ago
- ☆143Updated 2 years ago
- Chat Markup Language conversation library☆55Updated last year
- ☆38Updated last year
- ☆106Updated last year
- An implementation of bucketMul LLM inference☆216Updated 9 months ago
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆18Updated last week
- What if an HNSW index was just a file, and you could serve it from a CDN, and search it directly in the browser?☆98Updated this week
- Full finetuning of large language models without large memory requirements☆93Updated last year
- Run GGML models with Kubernetes.☆174Updated last year
- ☆10Updated last year
- ☆135Updated last year
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆281Updated last month
- [Added T5 support to TRLX] A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆47Updated 2 years ago
- Praetor is a lightweight finetuning data and prompt management tool☆68Updated 4 months ago
- Using modal.com to process FineWeb-edu data☆20Updated last week
- Array-Inspired Pipeline Language☆119Updated last year
- Private inference over your sensitive data with off-the-shelf models☆34Updated last year
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year