Alternatives and similar repositories for llm-rs-python

Users that are interested in llm-rs-python are comparing it to the libraries listed below

• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆67Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated last year
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆238Updated last year
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆27Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated last year
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆116Updated last year
• bigcode-project / jupytercoder
  ☆141Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 11 months ago
• QuixiAI / kraken
  ☆67Updated last year
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆65Updated last year
• mobarski / alpaca-libre
  Reimplementation of the task generation part from the Alpaca paper
  ☆119Updated 2 years ago
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆152Updated 2 years ago
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆115Updated last month
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 10 months ago
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆240Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆176Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• kyegomez / Andromeda
  An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
  ☆152Updated last year
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 3 weeks ago
• llmco / llamaapi-python
  ☆93Updated last year
• Narsil / fast_gpt2
  ☆156Updated 2 years ago
• mzbac / mlx-lora
  ☆38Updated last year
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago