Rate limiter for LLM clients
☆21Jan 30, 2025Updated last year
Alternatives and similar repositories for ratellmiter
Users that are interested in ratellmiter are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cool extensions built for the nbdev framework☆14Jun 6, 2023Updated 2 years ago
- ☆10Oct 24, 2024Updated last year
- Tiny evaluation of leading LLMs on competitive programming problems☆14Nov 28, 2024Updated last year
- Take screenshots of Mozilla applications in various UI configurations☆18May 21, 2024Updated last year
- DEPRECATED - Cross Platform Rapid Experiments "Nimbus" SDK☆15Jun 18, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Python package for extractive NLP using the OpenAI API☆17Aug 28, 2024Updated last year
- ☆17Feb 1, 2024Updated 2 years ago
- A daily benchmark to regression-test cloud LLMs☆17Aug 7, 2025Updated 7 months ago
- vscode extension to convert computationally intensive pytorch kernels to triton☆21Oct 13, 2024Updated last year
- ☆22Updated this week
- Use Hermes-2-Pro-Mistral-7B function calling with your OpenAI API compatible code.☆18May 7, 2024Updated last year
- ☆10Dec 25, 2024Updated last year
- Using modal.com to process FineWeb-edu data☆20Apr 5, 2025Updated 11 months ago
- A UI designer for constructing AI applications with OpenSearch☆16Mar 13, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- LLM evals to test open-source inference providers☆56Mar 12, 2026Updated 2 weeks ago
- Efficient Scaling laws and collaborative pretraining.☆21Sep 18, 2025Updated 6 months ago
- Add ability to interrupt own message☆14Apr 21, 2024Updated last year
- D3 implementation of tube map☆15May 11, 2017Updated 8 years ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆18Mar 14, 2025Updated last year
- ☆21Nov 28, 2023Updated 2 years ago
- Prompt Optimization☆77Mar 21, 2026Updated last week
- An OpenAI API compatible FastAPI server that sits on top of the Anemll repo. Tested with Open WebUI.☆20Jan 21, 2026Updated 2 months ago
- Official repository for Activation-Informed Merging (AIM) of Large Language Models☆22Feb 10, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Convert unstructured documentsto markdown using the Docling.☆41Jun 13, 2025Updated 9 months ago
- various experiments for scaling inference time compute with small reasoning models☆17Jan 16, 2025Updated last year
- Project code for training LLMs to write better unit tests + code☆21May 19, 2025Updated 10 months ago
- ReasonFlow is a novel framework designed to implement o1-like reasoning capabilities in large language models.☆19Feb 25, 2025Updated last year
- A graph of Reddit☆15Aug 24, 2024Updated last year
- A Ray-based LLM server compatible with OpenAI API☆12Mar 12, 2024Updated 2 years ago
- ☆20Jan 27, 2024Updated 2 years ago
- Extract a single expert from a Mixture Of Experts model using slerp interpolation.☆19May 26, 2024Updated last year
- ☆11Jul 17, 2024Updated last year
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- ☆14Mar 17, 2026Updated last week
- Generate Large Language Model text in a container.☆20Mar 24, 2023Updated 3 years ago
- Create native Ruby extensions from (almost) any ANTLR4 grammar.☆14Oct 13, 2023Updated 2 years ago
- Code from blog 'Searching by Music: Leveraging Vector Search for Music Information Retrieval'☆16Nov 16, 2023Updated 2 years ago
- Self-hosted feed reader☆13Jun 30, 2023Updated 2 years ago
- ☆20Feb 2, 2025Updated last year
- ☆22Oct 14, 2024Updated last year