recmo / cria
Tiny inference-only implementation of LLaMA
☆92Updated 11 months ago
Alternatives and similar repositories for cria:
Users that are interested in cria are comparing it to the libraries listed below
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Chat Markup Language conversation library☆55Updated last year
- An implementation of bucketMul LLM inference☆215Updated 8 months ago
- ☆153Updated 2 years ago
- ☆38Updated last year
- ☆163Updated 9 months ago
- utilities for loading and running text embeddings with onnx☆44Updated 7 months ago
- Full finetuning of large language models without large memory requirements☆93Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆153Updated last year
- Run GGML models with Kubernetes.☆174Updated last year
- WebGPU LLM inference tuned by hand☆149Updated last year
- A miniature version of Modal☆20Updated 9 months ago
- Mistral7B playing DOOM☆130Updated 7 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- ☆106Updated last year
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆279Updated 3 weeks ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated 9 months ago
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆158Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated last week
- Command-line script for inferencing from models such as falcon-7b-instruct☆76Updated last year
- ☆136Updated last year
- Revealing example of self-attention, the building block of transformer AI models☆130Updated last year
- Sparse autoencoders for Contra text embedding models☆25Updated 10 months ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- Logging and caching superpowers for the openai sdk☆102Updated 11 months ago
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆186Updated 10 months ago
- A star for organising blocks and playing with transformers.☆23Updated 10 months ago
- ☆48Updated last year