philschmid / text-generation-inference-tests

Related projects: ⓘ

• cognitivecomputations / spectrum
  ☆75Updated 3 weeks ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆128Updated this week
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆41Updated 6 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆112Updated last month
• davanstrien / data-for-fine-tuning-llms
  ☆71Updated 3 months ago
• cognitivecomputations / SystemChat
  ☆31Updated 2 months ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆27Updated 3 weeks ago
• substratusai / vllm-docker
  ☆43Updated 3 weeks ago
• teknium1 / transformers-gptq-quant
  ☆48Updated 11 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆62Updated this week
• pacman100 / peft-codegen-25
  ☆24Updated last year
• ai-hero / llm-research-fine-tuning
  ☆15Updated 3 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆73Updated 6 months ago
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆113Updated 7 months ago
• voyage-ai / voyageai-python
  Voyage AI Official Python Library
  ☆37Updated 3 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆93Updated 5 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆99Updated 8 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆33Updated 5 months ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆51Updated last week
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 2 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆58Updated 2 weeks ago
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆67Updated 2 months ago
• cognitivecomputations / kraken
  ☆64Updated 3 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆145Updated 2 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆26Updated last year
• weaviate / t2v-transformers-models
  This is the repo for the container that holds the models for the text2vec-transformers module
  ☆38Updated 3 weeks ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆106Updated 3 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆34Updated last month
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆62Updated this week