Alternatives and similar repositories for lm-evaluation-harness-de

Users that are interested in lm-evaluation-harness-de are comparing it to the libraries listed below

• bjoernpl / GermanBenchmark
  A repository containing the code for translating popular LLM benchmarks to German.
  ☆25Updated last year
• cognitivecomputations / spectrum
  ☆121Updated 2 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆258Updated 10 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated 10 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆259Updated 5 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆136Updated 2 weeks ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆124Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• embeddings-benchmark / arena
  Code for the MTEB Arena
  ☆19Updated 8 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆221Updated 7 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆63Updated last year
• LEL-A / GerAlpacaDataCleaned
  German Alpaca Dataset (Cleaned + Translated)
  ☆24Updated 2 years ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆172Updated 4 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆38Updated 10 months ago
• google-research / metricx
  ☆95Updated 5 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆76Updated last year
• writer / writing-in-the-margins
  ☆118Updated 9 months ago
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 7 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆128Updated 2 weeks ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆202Updated last month
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 7 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆279Updated 3 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆256Updated last week
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 8 months ago