twerkmeister / tokenfloodLinks
Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs
☆43Updated 3 weeks ago
Alternatives and similar repositories for tokenflood
Users that are interested in tokenflood are comparing it to the libraries listed below
Sorting:
- Implement recursion using English as the programming language and an LLM as the runtime.☆238Updated 2 years ago
- Dead Simple LLM Abliteration☆245Updated 10 months ago
- A CLI to manage install and configure llama inference implemenation in multiple languages☆65Updated 2 years ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated 2 years ago
- Mistral7B playing DOOM☆138Updated last year
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆287Updated 3 months ago
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆125Updated 8 months ago
- Build Secure and Compliant AI agents and MCP Servers. YC W23☆155Updated 7 months ago
- ☆164Updated 9 months ago
- ai for jq☆249Updated last year
- ☆199Updated 8 months ago
- Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so yo…☆104Updated 2 years ago
- GUI for selecting text files for concatenation and submission to LLMs☆180Updated last month
- Advanced Python Function Debugging with MCP Integration.☆57Updated 6 months ago
- Heirarchical Navigable Small Worlds☆101Updated 4 months ago
- ☆166Updated last year
- Command-line interface for the Arcane Engine☆44Updated last year
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆222Updated last year
- Pivotal Token Search☆142Updated 2 weeks ago
- Praetor is a lightweight finetuning data and prompt management tool☆67Updated last year
- Revealing example of self-attention, the building block of transformer AI models☆131Updated 2 years ago
- Agent accuracy measurements for LLMs☆204Updated last year
- Hierarchical topic segmentation of meeting transcripts using embeddings and divisive clustering.☆54Updated last year
- AI-to-AI Testing | Simulation framework for LLM-based applications☆136Updated 2 years ago
- ☆72Updated last year
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆281Updated last week
- Ask GPT to run a command☆195Updated 3 months ago
- The creative suite for character-driven AI experiences.☆190Updated last year
- Neurox control helm chart details☆30Updated 8 months ago