Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
☆44Aug 20, 2024Updated 2 years ago
Alternatives and similar repositories for long-context-icl
Users that are interested in long-context-icl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Create a QnA bot on a pdf☆16May 27, 2023Updated 3 years ago
- ☆11Oct 2, 2023Updated 3 years ago
- ☆13Jun 4, 2024Updated 2 years ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆34Jan 23, 2025Updated last year
- Forcing Diffuse Distributions out of Language Models☆18Sep 10, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆21May 2, 2024Updated 2 years ago
- zero-vocab or low-vocab embeddings☆18Jul 17, 2022Updated 4 years ago
- ☆19Feb 25, 2024Updated 2 years ago
- Official repository for RePro: Training Language Models to Faithfully Recycle the Web for Pretraining☆11Feb 18, 2026Updated 8 months ago
- ☆17Feb 4, 2025Updated last year
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆80Nov 14, 2024Updated last year
- ☆147May 23, 2024Updated 2 years ago
- ☆18Mar 3, 2025Updated last year
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆62May 9, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆113Feb 20, 2025Updated last year
- An implementation of online data mixing for the Pile dataset, based on the GPT-NeoX library.☆15Jan 9, 2024Updated 2 years ago
- [AAAI 2025] Augmenting Math Word Problems via Iterative Question Composing (https://arxiv.org/abs/2401.09003)☆23Oct 2, 2025Updated last year
- Download, parse, and filter data PubMed, data-ready for The-Pile☆23Dec 16, 2021Updated 4 years ago
- ICML 2024 Paper "Adversarial Robustness Limits via Scaling-Law and Human-Alignment Studies"☆18Jul 10, 2024Updated 2 years ago
- [EMNLP 2026] SGSD: Skill-Conditioned Gated Self-Distillation for LLM Reasoning☆14Aug 21, 2026Updated 2 months ago
- A new algorithm that formulates jailbreaking as a reasoning problem.☆26Jul 2, 2025Updated last year
- ☆14Aug 30, 2023Updated 3 years ago
- War Games measures whether frontier models can sustain long-horizon planning and adaptation in complex, non-stationary real-time games, w…☆15May 5, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆40Dec 27, 2022Updated 3 years ago
- To assess the longtext capabilities more comprehensively, we propose Needle-in-a-Haystack PLUS, which shifts the focus from simple fact r…☆13Mar 4, 2024Updated 2 years ago
- Website for MathVista☆21Jun 9, 2025Updated last year
- Official repository of: Attention Sinks in Diffusion Language Models☆12Dec 10, 2025Updated 10 months ago
- ☆12Jul 4, 2024Updated 2 years ago
- Code for Representation Bending Paper☆16Jul 15, 2025Updated last year
- ☆57Apr 11, 2024Updated 2 years ago
- Competition of Mechanisms: Tracing How Language Models Handle Facts and Counterfactuals; ACL 2024☆13May 24, 2024Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆171Oct 9, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆37Oct 11, 2023Updated 3 years ago
- [NeurIPS'25] Beyond Accuracy: Dissecting Mathematical Reasoning for LLMs Under Reinforcement Learning☆17Dec 12, 2025Updated 10 months ago
- A toolkit to assess data privacy in LLMs (under development)☆76Jan 2, 2025Updated last year
- Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888☆37Jun 10, 2024Updated 2 years ago
- Integrate ChatGPT into your own discord bot using langchain☆12May 22, 2023Updated 3 years ago
- ☆14Oct 6, 2026Updated 3 weeks ago
- [Preprint] TPPO: Tracking-Value PPO for Language Model Reasoning☆25Oct 10, 2026Updated 3 weeks ago