recmo / criaLinks
Tiny inference-only implementation of LLaMA
☆93Updated last year
Alternatives and similar repositories for cria
Users that are interested in cria are comparing it to the libraries listed below
Sorting:
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- ☆155Updated 2 years ago
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- WebGPU LLM inference tuned by hand☆150Updated last year
- Mistral7B playing DOOM☆131Updated 10 months ago
- Chat Markup Language conversation library☆55Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆151Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- Prototyping a question and answer bot over PDFs☆39Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆159Updated last year
- [Added T5 support to TRLX] A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆47Updated 2 years ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆40Updated 2 years ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated last year
- Codebase topic modeling using GNNs(Node aggregation and clustering)☆60Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated last year
- ☆143Updated 2 years ago
- ☆163Updated last year
- Simplex Random Feature attention, in PyTorch☆73Updated last year
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆187Updated last year
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- An HTTP serving framework by Banana☆99Updated last year
- ☆48Updated last year
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆32Updated last month
- Private inference over your sensitive data with off-the-shelf models☆34Updated 2 years ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆30Updated 2 years ago
- The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.☆388Updated 3 months ago
- ☆38Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated 9 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year