Alternatives and similar repositories for benchmarking-llms

Users that are interested in benchmarking-llms are comparing it to the libraries listed below

• lethain / llm-explorer
  Experimentation with Streamlit for personal LLM tool
  ☆15Updated 2 years ago
• mify-io / mify-llm-editor
  LLM code editor for backend services
  ☆15Updated 8 months ago
• simonw / llm-rag
  Answer questions against collections stored in LLM using Retrieval Augmented Generation
  ☆27Updated last year
• isuckatcs / advent-of-code
  Advent of Code solutions in C++, Rust, Java, Kotlin, Swift, Go, Ruby and Mojo 🔥
  ☆19Updated last month
• sensoris / semcache
  Semantic caching layer for your LLM applications. Reuse responses and reduce token usage.
  ☆83Updated 3 weeks ago
• repollo / llm_data_parser
  This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.
  ☆29Updated 2 years ago
• simonw / llm-mlx-llama
  Run Llama 2 using MLX on macOS
  ☆34Updated last year
• superseoworld / mcp-spotify
  ☆12Updated 4 months ago
• S-HARI-S / Aether
  A simple rag based plugin for obsidian
  ☆10Updated 8 months ago
• nhtlongcs / StarListify
  StarListify is a Python package that classifies GitHub stars history into organized category lists based on user-defined criteria.
  ☆25Updated 8 months ago
• Lightning-Universe / Echo
  Production-ready audio and video transcription app that can run on your laptop or in the cloud.
  ☆72Updated last year
• simonw / llm-embed-onnx
  Run embedding models using ONNX
  ☆34Updated last year
• ErikKaum / runner
  Experimental wasm32-unknown-wasi runtime for Python code execution
  ☆37Updated 7 months ago
• blankenshipz / clerk
  LLM based file organizer
  ☆26Updated 2 years ago
• Vaibhavs10 / github-issue-generator-webgpu
  ☆38Updated 7 months ago
• mowa-ai / sql-copilot
  ☆26Updated last year
• haile01 / github-starred-list
  cuz sometimes github didn't care enuf
  ☆26Updated 8 months ago
• r2d4 / blog-embeddings
  Script to generate embeddings from a blog and use GPT-3.5 to categorize the embedding space
  ☆11Updated last year
• levrofin / toolhub
  A collection of tools that can be used for LLM function calling
  ☆34Updated last month
• LamoomAI / lamoom-python
  Open source library for production prompt engineering and load balancing of AI Models
  ☆82Updated 3 weeks ago
• simonw / llm-llama-cpp
  LLM plugin for running models using llama.cpp
  ☆143Updated last year
• simonw / llm-whisper-api
  Run transcriptions using the OpenAI Whisper API
  ☆24Updated 8 months ago
• ngshiheng / burplist
  Web crawler for Burplist, a search engine for craft beers in Singapore
  ☆14Updated 2 weeks ago
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• simonw / llm-plugins
  The LLM plugins directory
  ☆42Updated last year
• simonw / llm-clip
  Generate embeddings for images and text using CLIP with LLM
  ☆70Updated last year
• xetdata / pyxet
  Python SDK for XetHub
  ☆51Updated 9 months ago
• KompleteAI / xllm
  🦖 X—LLM: Simple & Cutting Edge LLM Finetuning
  ☆11Updated last year
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆82Updated last year
• simonw / datasette-faiss
  Maintain a FAISS index for specified Datasette tables
  ☆36Updated last year