philschmid / llmperf

Related projects ⓘ

Alternatives and complementary repositories for llmperf

• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆78Updated 3 weeks ago
• aws-samples / evaluating-large-language-models-using-llm-as-a-judge
  ☆12Updated 6 months ago
• aws-samples / aws-do-kubeflow
  A do-framework project to simplify deployment of Kubeflow on Amazon EKS
  ☆18Updated 7 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆72Updated 2 months ago
• arunprsh / multi-turn-chatbot-gpt-sagemaker
  Multi-Turn Chatbot with GPT-Neo and SageMaker: A conversational AI system for engaging and informative interactions with users.
  ☆7Updated last year
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆209Updated this week
• awslabs / extending-the-context-length-of-open-source-llms
  ☆48Updated 2 weeks ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆93Updated 5 months ago
• aws-samples / llm-based-advanced-summarization
  ☆37Updated 2 weeks ago
• swj0419 / detect-pretrain-code-contamination
  ☆73Updated 10 months ago
• aws-samples / aws-samples-for-ray
  ☆64Updated 4 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆74Updated last week
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆41Updated 9 months ago
• aniketmaurya / agents
  Build Agentic workflows with function calling
  ☆20Updated this week
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆56Updated 6 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆105Updated 5 months ago
• aws-neuron / transformers-neuronx
  ☆100Updated 2 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆94Updated last month
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆25Updated 10 months ago
• aws-samples / generative-ai-workshop-build-a-multifunctional-chatbot-on-sagemaker
  ☆41Updated 9 months ago
• datacommonsorg / llm-tools
  ☆47Updated 2 months ago
• plaggy / rag-containers
  Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.
  ☆50Updated 8 months ago
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆108Updated last month
• philschmid / text-generation-inference-tests
  ☆20Updated 10 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: Structured Outputs in Retrieval-Augmented Generation
  ☆94Updated this week
• davanstrien / data-for-fine-tuning-llms
  ☆75Updated 5 months ago
• ai-hero / llm-research-fine-tuning
  ☆15Updated 5 months ago
• JGalego / RAGmap
  A simple Streamlit application that helps visualize document chunks and queries in embedding space 🗺️🔍
  ☆12Updated 2 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆64Updated last month
• ianhohoho / auto-hyde
  🔎 A deep-dive into HyDE for Advanced LLM RAG + 💡 Introducing AutoHyDE, a semi-supervised framework to improve the effectiveness, covera…
  ☆29Updated 7 months ago