LLukas22 / llm-rs-python
Unofficial python bindings for the rust llm library. 🐍❤️🦀
☆75Updated last year
Alternatives and similar repositories for llm-rs-python:
Users that are interested in llm-rs-python are comparing it to the libraries listed below
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆159Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆59Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 6 months ago
- ☆66Updated 10 months ago
- QLoRA with Enhanced Multi GPU Support☆37Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 7 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- GPT-2 small trained on phi-like data☆66Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 4 months ago
- An OpenAI Completions API compatible server for NLP transformers models☆65Updated last year
- Let's create synthetic textbooks together :)☆74Updated last year
- ☆199Updated last year
- ☆112Updated last week
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'☆234Updated 10 months ago
- Full finetuning of large language models without large memory requirements☆93Updated last year
- Python bindings for llama.cpp☆65Updated last year
- LLM finetuning☆42Updated last year
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆167Updated last year
- Reimplementation of the task generation part from the Alpaca paper☆119Updated 2 years ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- The code we currently use to fine-tune models.☆114Updated 11 months ago
- ☆22Updated 10 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 5 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆86Updated last month
- Plug n Play GBNF Compiler for llama.cpp☆24Updated last year
- ☆153Updated 9 months ago
- ☆31Updated last year