IBM / unitxt

Related projects ⓘ

Alternatives and complementary repositories for unitxt

• IBM / ensemble-instruct
  codebase release for EMNLP2023 paper publication
  ☆19Updated 8 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆52Updated 3 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆105Updated last week
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆237Updated 3 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆92Updated last month
• IBM / data-prep-kit
  Open source project for data preparation of LLM application builders
  ☆264Updated this week
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆122Updated 7 months ago
• cognitivecomputations / spectrum
  ☆91Updated last month
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆64Updated 2 weeks ago
• cohere-ai / magikarp
  ☆127Updated last month
• jakespringer / echo-embeddings
  ☆123Updated 6 months ago
• SALT-NLP / demonstrated-feedback
  ☆111Updated last month
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆202Updated 3 months ago
• writer / writing-in-the-margins
  ☆102Updated 2 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆128Updated this week
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆105Updated last month
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆184Updated last month
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆114Updated 6 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆239Updated last week
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆81Updated 3 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆105Updated last week
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆194Updated last week
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆40Updated 8 months ago
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆196Updated last week
• google-deepmind / mishax
  ☆99Updated 3 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆57Updated last month
• FSoft-AI4Code / RepoHyper
  Graph-based method for end-to-end code completion with context awareness on repository
  ☆44Updated 2 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆141Updated 5 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆73Updated last month