recmo / criaLinks
Tiny inference-only implementation of LLaMA
☆92Updated last year
Alternatives and similar repositories for cria
Users that are interested in cria are comparing it to the libraries listed below
Sorting:
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆158Updated 2 years ago
- An implementation of bucketMul LLM inference☆224Updated last year
- ☆157Updated 2 years ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- utilities for loading and running text embeddings with onnx☆45Updated 5 months ago
- Simplex Random Feature attention, in PyTorch☆75Updated 2 years ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆288Updated 3 weeks ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.☆424Updated 11 months ago
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆160Updated 2 years ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆198Updated last year
- Run GGML models with Kubernetes.☆175Updated 2 years ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆65Updated 2 years ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆42Updated 2 years ago
- ☆144Updated 2 years ago
- Chat Markup Language conversation library☆55Updated 2 years ago
- inference code for mixtral-8x7b-32kseqlen☆105Updated 2 years ago
- Sparse autoencoders for Contra text embedding models☆25Updated last year
- Run inference on replit-3B code instruct model using CPU☆160Updated 2 years ago
- ☆135Updated 2 years ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆31Updated 2 years ago
- An HTTP serving framework by Banana☆101Updated 2 years ago
- GPT-3 on your command line☆131Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆94Updated 4 months ago
- ☆45Updated 2 years ago
- A strongly typed Python DSL for developing message passing multi agent systems☆53Updated last year
- Prototyping a question and answer bot over PDFs☆39Updated 2 years ago
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago