Alternatives and similar repositories for leaderboard-backend:

Users that are interested in leaderboard-backend are comparing it to the libraries listed below

• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 3 months ago
• xlang-ai / batch-prompting
  [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.
  ☆72Updated 10 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated last month
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆75Updated this week
• xhan77 / in-context-alignment
  In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning
  ☆33Updated last year
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆23Updated this week
• kevinwu23 / StanfordFineTuneBench
  ☆27Updated 2 months ago
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated 10 months ago
• LAION-AI / riverbed
  Tools for content datamining and NLP at scale
  ☆42Updated 6 months ago
• pygongnlp / CoSearchAgent
  [SIGIR 2024 (Demo)] CoSearchAgent: A Lightweight Collborative Search Agent with Large Language Models
  ☆22Updated 11 months ago
• Zyphra / Zyda_processing
  ☆31Updated 6 months ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆27Updated last year
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• lucy3 / whos_filtered
  ☆14Updated 3 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆40Updated 9 months ago
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆53Updated this week
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆54Updated 9 months ago