Alternatives and similar repositories for llm-rs-python

Users that are interested in llm-rs-python are comparing it to the libraries listed below

• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆170Updated last year
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated 2 years ago
• lightonai / pylate-rs
  PyLate efficient inference engine
  ☆68Updated 3 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆46Updated last year
• bigcode-project / jupytercoder
  ☆142Updated 2 years ago
• advanced-stack / py-llm-core
  A pythonic library providing light-weighted interface with LLMs
  ☆131Updated 7 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆238Updated 2 years ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆180Updated last year
• QuixiAI / kraken
  ☆68Updated last year
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• weaviate / t2v-transformers-models
  This is the repo for the container that holds the models for the text2vec-transformers module
  ☆58Updated last month
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆67Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated 2 years ago
• rgbkrk / chatlab
  ⚡️🧪 Fast LLM Tool Calling Experimentation, big and smol
  ☆152Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆240Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆65Updated 2 years ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆71Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 3 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• Vaibhavs10 / fast-llm.rs
  ☆140Updated last year
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆119Updated last week
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated 2 years ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆139Updated last year
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆117Updated last year