garrisonhess / llama2.cLinks
Inference Llama 2 in one file of pure C
☆14Updated 2 years ago
Alternatives and similar repositories for llama2.c
Users that are interested in llama2.c are comparing it to the libraries listed below
Sorting:
- Semantic Indexer☆53Updated last year
- ☆166Updated last year
- Official Rust Implementation of Model2Vec☆152Updated last week
- Inference engine for GLiNER models, in Rust☆90Updated last month
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- ☆157Updated 2 years ago
- Tiny inference-only implementation of LLaMA☆92Updated last year
- ☆35Updated 2 years ago
- Rust framework for LLM orchestration☆203Updated last year
- OpenAI compatible API for serving LLAMA-2 model☆218Updated 2 years ago
- Neural search for web-sites, docs, articles - online!☆146Updated 6 months ago
- The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.☆425Updated 11 months ago
- ☆58Updated 2 years ago
- Fast approximate nearest neighbor searching in Rust, based on HNSW index☆343Updated last month
- ☆140Updated last year
- ☆135Updated last year
- utilities for loading and running text embeddings with onnx☆45Updated 5 months ago
- LLM plugin for clustering embeddings☆82Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆160Updated 2 years ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆80Updated 2 years ago
- A library for working with GBNF files☆27Updated 3 months ago
- a curated list of data for reasoning ai☆141Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated 2 years ago
- HNSW implementation in Rust. Reference: https://arxiv.org/ftp/arxiv/papers/1603/1603.09320.pdf☆243Updated last year
- Code repo for "Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio" at the (CAI2) wor…☆214Updated 2 years ago
- Rust client for txtai☆113Updated 3 weeks ago
- Inference Llama 2 in one file of pure Rust 🦀☆235Updated 2 years ago
- Use context-free grammars with an LLM☆174Updated last year
- Locality Sensitive Hashing☆78Updated 2 years ago
- A high-performance constrained decoding engine based on context free grammar in Rust☆58Updated 8 months ago