jquesnelle / transformers-openai-apiLinks
An OpenAI Completions API compatible server for NLP transformers models
☆66Updated 2 years ago
Alternatives and similar repositories for transformers-openai-api
Users that are interested in transformers-openai-api are comparing it to the libraries listed below
Sorting:
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆47Updated last year
- ☆198Updated last year
- ☆165Updated 4 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated 3 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆161Updated 2 years ago
- Low-Rank adapter extraction for fine-tuned transformers models☆180Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- Let's create synthetic textbooks together :)☆75Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated last year
- ☆68Updated last year
- ☆119Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆79Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated 2 years ago
- ⚡️🧪 Fast LLM Tool Calling Experimentation, big and smol☆155Updated last year
- A guidance compatibility layer for llama-cpp-python☆36Updated 2 years ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆240Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago
- Efficient vector database for hundred millions of embeddings.☆211Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆111Updated last year
- ☆74Updated 2 years ago
- ☆74Updated last year
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- Chat Markup Language conversation library☆55Updated 2 years ago
- A framework for evaluating function calls made by LLMs☆39Updated last year
- ☆38Updated last year
- Merge Transformers language models by use of gradient parameters.☆211Updated last year
- Simple Graph Memory for AI applications☆89Updated 7 months ago
- entropix style sampling + GUI☆27Updated last year