malhajar17 / lm-evaluation-harness_turkish
A framework for few-shot evaluation of language models. including Turkish sets used in TurkishopenLLM leadboard on huggingface
β13Updated 2 months ago
Related projects β
Alternatives and complementary repositories for lm-evaluation-harness_turkish
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backendsβ794Updated this week
- Evaluate your LLM's response with Prometheus and GPT4 π―β795Updated 2 months ago
- ReFT: Representation Finetuning for Language Modelsβ1,149Updated last week
- Easily embed, cluster and semantically label text datasetsβ460Updated 7 months ago
- β526Updated 2 weeks ago
- Automatically evaluate your LLMs in Google Colabβ557Updated 6 months ago
- Best practices for distilling large language models.β392Updated 9 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifiβ¦β1,617Updated this week
- awesome synthetic (text) datasetsβ239Updated 2 weeks ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard aβ¦β771Updated last week
- β447Updated 2 weeks ago
- An Open Source Toolkit For LLM Distillationβ354Updated last month
- Minimalistic large language model 3D-parallelism trainingβ1,229Updated last week
- Interpretability for sequence generation models π πβ375Updated this week
- The repository for the code of the UltraFastBERT paperβ514Updated 7 months ago
- Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'β1,262Updated last month
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMsβ2,186Updated this week
- Let's build better datasets, together!β202Updated 3 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipyβ875Updated last week
- Automated Evaluation of RAG Systemsβ482Updated last week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.β2,030Updated last week
- List of papers on hallucination detection in LLMs.β671Updated last week
- Chat Templates for π€ HuggingFace Large Language Modelsβ530Updated last week
- Recipes for shrinking, optimizing, customizing cutting edge vision models. πβ872Updated 2 months ago
- Data and tools for generating and inspecting OLMo pre-training data.β981Updated this week
- Doing simple retrieval from LLM models at various context lengths to measure accuracyβ1,554Updated 2 months ago
- β680Updated last month
- β207Updated this week
- Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.β315Updated 3 months ago
- Enforce the output format (JSON Schema, Regex etc) of a language modelβ1,525Updated 3 weeks ago