Alternatives and similar repositories for extending-the-context-length-of-open-source-llms:

Users that are interested in extending-the-context-length-of-open-source-llms are comparing it to the libraries listed below

• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 8 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆103Updated 4 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 8 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 10 months ago
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆64Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆53Updated 4 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 8 months ago
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆12Updated last year
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆54Updated this week
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆53Updated this week
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated 5 months ago
• rosewang2008 / backtracing
  Backtracing: Retrieving the Cause of the Query, EACL 2024 Long Paper, Findings.
  ☆89Updated 8 months ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆40Updated 2 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last week
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆68Updated this week
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 6 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆69Updated 7 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year