twerkmeister / tokenfloodLinks
Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs
☆44Updated 3 weeks ago
Alternatives and similar repositories for tokenflood
Users that are interested in tokenflood are comparing it to the libraries listed below
Sorting:
- Implement recursion using English as the programming language and an LLM as the runtime.☆240Updated 2 years ago
- A CLI to manage install and configure llama inference implemenation in multiple languages☆65Updated 2 years ago
- ☆164Updated 10 months ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆281Updated last month
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated 2 years ago
- ☆72Updated last year
- Hierarchical topic segmentation of meeting transcripts using embeddings and divisive clustering.☆54Updated last year
- Advanced Python Function Debugging with MCP Integration.☆58Updated 7 months ago
- Revealing example of self-attention, the building block of transformer AI models☆131Updated 2 years ago
- A playground to make it easy to try crazy things☆33Updated 2 months ago
- Build Secure and Compliant AI agents and MCP Servers. YC W23☆157Updated 7 months ago
- Dead Simple LLM Abliteration☆247Updated 11 months ago
- ☆200Updated 8 months ago
- ☆166Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆125Updated 9 months ago
- Mistral7B playing DOOM☆139Updated last year
- Heirarchical Navigable Small Worlds☆101Updated 5 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆222Updated last year
- Visual inference exploration & experimentation playground☆97Updated last year
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆288Updated 2 weeks ago
- Praetor is a lightweight finetuning data and prompt management tool☆67Updated last year
- Command-line interface for the Arcane Engine☆44Updated last year
- ☆255Updated 2 years ago
- A GPU Accelerated Binary Vector Store☆47Updated 11 months ago
- Compression suite for data frames and tabular data files, csv, excel etc. Using LZHW algorithm.☆30Updated last year
- ai for jq☆249Updated last year
- Physical AI Assistant that illuminates your life☆191Updated 3 months ago
- Your AI research assistant☆79Updated 10 months ago
- Applying the ideas of Deepseek R1 to computer use☆221Updated 11 months ago