anarchy-ai / llm-speed-benchmark
Benchmarking tool for assessing LLM models' performance across different hardwares
☆15Updated last year
Alternatives and similar repositories for llm-speed-benchmark:
Users that are interested in llm-speed-benchmark are comparing it to the libraries listed below
- LLM code editor for backend services☆14Updated 4 months ago
- The backend behind the LLM-Perf Leaderboard☆10Updated 9 months ago
- Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub☆17Updated last year
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated 8 months ago
- CaptureFlow - LLM-powered code maintenance that delivers reliable results.☆43Updated 6 months ago
- ☆24Updated 3 weeks ago
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆14Updated last month
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆44Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆29Updated 8 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 10 months ago
- Augment AI agents with long-term memory through knowledge graph 🧠☆51Updated 4 months ago
- Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch☆58Updated this week
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆36Updated 5 months ago
- GraphRag vs Embeddings☆13Updated 7 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated 9 months ago
- Transformer GPU VRAM estimator☆50Updated 10 months ago
- Query databases and tables with AI assistance☆16Updated 10 months ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆29Updated last month
- Pragmatic framework to build LLM Copilots☆17Updated last month
- ☆15Updated 11 months ago
- The AI-powered CLI Assistant☆26Updated 8 months ago
- Access different AI models in a one place☆22Updated last year
- ☆27Updated 5 months ago
- ☆74Updated last year
- watch your screen while doing sales and fill your crm automatically☆15Updated 8 months ago
- AI-powered bullet point language / IDE☆12Updated this week
- One command automated macOS/Linux laptop/VM/container bootstrapper.☆10Updated this week
- Large-Language-Model to Machine Interface project.☆17Updated last year
- ☆22Updated 8 months ago