twerkmeister / tokenfloodLinks
Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs
☆40Updated this week
Alternatives and similar repositories for tokenflood
Users that are interested in tokenflood are comparing it to the libraries listed below
Sorting:
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated 2 years ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆238Updated 2 years ago
- A CLI to manage install and configure llama inference implemenation in multiple languages☆65Updated last year
- ☆164Updated 8 months ago
- Dead Simple LLM Abliteration☆243Updated 9 months ago
- Advanced Python Function Debugging with MCP Integration.☆57Updated 5 months ago
- ☆72Updated last year
- Revealing example of self-attention, the building block of transformer AI models☆131Updated 2 years ago
- Praetor is a lightweight finetuning data and prompt management tool☆67Updated last year
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Graphical interface for Self-Supervised SISR for Sentinel-2 L1B Imagery☆28Updated 4 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆286Updated 2 months ago
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆281Updated last month
- This project visualizes 100,000 real galaxies in blue and 100,000 randomly distributed galaxies in red. The data is sourced from the GPU …☆88Updated 2 months ago
- Hierarchical topic segmentation of meeting transcripts using embeddings and divisive clustering.☆54Updated last year
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆222Updated 11 months ago
- A Kurtosis package for Python data engineers, deploying a Jupyter notebook along with a configurable set of databases, and a visualizatio…☆109Updated 2 years ago
- ai for jq☆246Updated last year
- Heirarchical Navigable Small Worlds☆101Updated 4 months ago
- Command-line interface for the Arcane Engine☆44Updated last year
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆254Updated 2 years ago
- Ask questions, let GPT do the SQL.☆133Updated 2 years ago
- High-Performance Implementation of OpenAI's TikToken.☆464Updated 5 months ago
- ☆199Updated 7 months ago
- Physical AI Assistant that illuminates your life☆189Updated 2 months ago
- Build data processing and data analysis pipelines that leverage the power of LLMs 🧠☆243Updated 2 weeks ago
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆125Updated 7 months ago
- GUI for selecting text files for concatenation and submission to LLMs☆180Updated 3 weeks ago
- Better Bookmarks Search w/ Transformers☆198Updated last year
- ☆127Updated 2 years ago