McGill-NLP / llm2vec

Related projects ⓘ

Alternatives and complementary repositories for llm2vec

• stanfordnlp / pyreft
  ReFT: Representation Finetuning for Language Models
  ☆1,159Updated 2 weeks ago
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆567Updated this week
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆1,634Updated this week
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆899Updated last week
• SeanLee97 / AnglE
  Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
  ☆485Updated last week
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,045Updated this week
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,095Updated last week
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆744Updated this week
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,391Updated 8 months ago
• AkariAsai / self-rag
  This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…
  ☆1,836Updated 5 months ago
• embeddings-benchmark / mteb
  MTEB: Massive Text Embedding Benchmark
  ☆1,954Updated this week
• IntelLabs / fastRAG
  Efficient Retrieval Augmentation and Generation Framework
  ☆1,341Updated last week
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆811Updated this week
• zjunlp / EasyEdit
  [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
  ☆1,943Updated this week
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,353Updated 7 months ago
• facebookresearch / contriever
  Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning
  ☆685Updated last year
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆797Updated 2 months ago
• S-LoRA / S-LoRA
  S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  ☆1,755Updated 10 months ago
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,565Updated 3 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,260Updated this week
• nomic-ai / contrastors
  Train Models Contrastively in Pytorch
  ☆546Updated this week
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆774Updated 6 months ago
• allenai / open-instruct
  ☆1,271Updated this week
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,336Updated 7 months ago
• huggingface / cosmopedia
  ☆451Updated 3 weeks ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆462Updated 7 months ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆2,205Updated this week
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆647Updated last month
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,620Updated 3 months ago
• zou-group / textgrad
  TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.
  ☆1,824Updated 2 weeks ago