IlyasMoutawwakil / llm-perf-backend

Related projects ⓘ

Alternatives and complementary repositories for llm-perf-backend

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated this week
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆57Updated 4 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆25Updated 10 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 4 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆21Updated last week
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆36Updated 7 months ago
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆19Updated 2 months ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆27Updated 2 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆28Updated 2 months ago
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated 10 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆36Updated last week
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆54Updated 7 months ago
• PrithivirajDamodaran / blitz-embed
  C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…
  ☆20Updated 8 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆105Updated 5 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆43Updated 8 months ago
• raga-ai-hub / ragaai-catalyst
  ☆18Updated this week
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆37Updated 7 months ago
• arcee-ai / DAM
  ☆41Updated 2 weeks ago
• aniketmaurya / agents
  Build Agentic workflows with function calling
  ☆20Updated this week
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆26Updated last year
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆30Updated this week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆74Updated last week
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆43Updated 10 months ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆29Updated 6 months ago