richawo / chain-of-density
Implementing the Chain Of Density text summarisation technique from recent NLP research by researchers at Salesforce, MIT, Columbia, etc. Takes a long text input and iteratively generates increasingly concise, entity-dense summaries using LLMs (default: OpenAI's GPT-4). Feedback and contributions welcome!
☆73Updated last year
Alternatives and similar repositories for chain-of-density:
Users that are interested in chain-of-density are comparing it to the libraries listed below
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆69Updated 3 months ago
- Synthetic Data for LLM Fine-Tuning☆108Updated last year
- ☆57Updated last year
- Official homepage for "Self-Harmonized Chain of Thought"☆89Updated last week
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆58Updated 6 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated 9 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆99Updated last year
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- autologic is a Python package that implements the SELF-DISCOVER framework proposed in the paper SELF-DISCOVER: Large Language Models Self…☆57Updated 11 months ago
- ☆48Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 9 months ago
- A framework for evaluating function calls made by LLMs☆36Updated 6 months ago
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆79Updated 10 months ago
- Routing on Random Forest (RoRF)☆100Updated 4 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆82Updated 3 weeks ago
- A re-implementation of Meta-Prompt in LangChain for building self-improving agents.☆63Updated last year
- ☆109Updated last month
- ☆87Updated 11 months ago
- auto fine tune of models with synthetic data☆74Updated 11 months ago
- 🔓 The open-source autonomous agent LLM initiative 🔓☆90Updated 11 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆68Updated last month
- ☆91Updated last year
- ☆136Updated last year
- ☆70Updated last week
- ☆75Updated last year
- clean up your LLM datasets☆113Updated last year
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆61Updated this week
- Just a bunch of benchmark logs for different LLMs☆117Updated 6 months ago
- Full finetuning of large language models without large memory requirements☆93Updated last year