rustformers / llm

Related projects ⓘ

Alternatives and complementary repositories for llm

• huggingface / candle
  Minimalist ML framework for Rust
  ☆15,803Updated this week
• guillaume-be / rust-bert
  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
  ☆2,642Updated last month
• tracel-ai / burn
  Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability…
  ☆8,874Updated this week
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆4,316Updated last week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,224Updated 2 months ago
• ggerganov / ggml
  Tensor library for machine learning
  ☆11,172Updated this week
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,384Updated last year
• rust-ml / linfa
  A Rust machine learning framework.
  ☆3,754Updated 2 months ago
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,638Updated 3 months ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,634Updated 3 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,258Updated 3 months ago
• Rust-GPU / Rust-CUDA
  Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
  ☆3,138Updated last year
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,831Updated 7 months ago
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,250Updated last year
• qdrant / qdrant
  Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…
  ☆20,495Updated this week
• bigcode-project / starcoder
  Home of StarCoder: fine-tuning & inference!
  ☆7,312Updated 8 months ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,036Updated 4 months ago
• coreylowman / dfdx
  Deep learning in Rust, with shape checked tensors and neural networks
  ☆1,732Updated 3 months ago
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆13,567Updated this week
• togethercomputer / RedPajama-Data
  The RedPajama-Data repository contains code for preparing large datasets for training large language models.
  ☆4,568Updated 3 weeks ago
• BloopAI / bloop
  bloop is a fast code search engine written in Rust.
  ☆9,433Updated 3 weeks ago
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆15,276Updated this week
• mlc-ai / web-stable-diffusion
  Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
  ☆3,590Updated 7 months ago
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,015Updated 11 months ago
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆5,988Updated 2 months ago
• ravenscroftj / turbopilot
  Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
  ☆3,828Updated last year
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,683Updated 5 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,072Updated this week
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,212Updated last month