anarchy-ai / llm-speed-benchmarkLinks
Benchmarking tool for assessing LLM models' performance across different hardwares
☆16Updated last year
Alternatives and similar repositories for llm-speed-benchmark
Users that are interested in llm-speed-benchmark are comparing it to the libraries listed below
Sorting:
- LLM code editor for backend services☆14Updated 7 months ago
- Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub☆17Updated last year
- Tensor library for machine learning☆17Updated last year
- CaptureFlow - LLM-powered code maintenance that delivers reliable results.☆43Updated 10 months ago
- The AI-powered CLI Assistant☆26Updated last year
- Web Interface for Vision Language Models Including InternVLM2☆22Updated 10 months ago
- Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch☆65Updated this week
- Supervised fine-tuning of Google's open-source Gemma-2B model to optimize writing Python code☆21Updated last year
- Search a JSON path and get the value fast☆22Updated 3 months ago
- ☆19Updated last year
- A QT GUI for large language models☆34Updated last year
- StarListify is a Python package that classifies GitHub stars history into organized category lists based on user-defined criteria.☆23Updated 7 months ago
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆26Updated 2 months ago
- Blueprint by Mozilla.ai for answering questions about structured documents☆33Updated 2 months ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated last year
- convert natural language into technical diagrams☆14Updated 5 months ago
- AI aware proxy☆18Updated 8 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- GraphRag vs Embeddings☆13Updated 10 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆37Updated this week
- An open source MCP proxy.☆12Updated 5 months ago
- ☆18Updated 8 months ago
- ☆24Updated 4 months ago
- Experimental wasm32-unknown-wasi runtime for Python code execution☆37Updated 6 months ago
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆29Updated last year
- Guards and protection agnostic to your model or provider☆36Updated 6 months ago
- ☆23Updated 6 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 6 months ago
- A framework for collecting a large human-sourced chain-of-thoughts dataset☆22Updated 10 months ago
- ☆20Updated last month