anyscale / long-context-fine-tuning-blogpostLinks
☆17Updated last year
Alternatives and similar repositories for long-context-fine-tuning-blogpost
Users that are interested in long-context-fine-tuning-blogpost are comparing it to the libraries listed below
Sorting:
- [TACL] Code, datasets, and checkpoints for the paper "CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retri…☆31Updated last year
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆39Updated 11 months ago
- ☆50Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- ☆31Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- Data preparation code for Amber 7B LLM☆93Updated last year
- Official Repository for Paper "BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Compet…☆18Updated last year
- ☆20Updated 6 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆56Updated this week
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆64Updated last year
- ☆55Updated 11 months ago
- Truly flash T5 realization!☆70Updated last year
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- [ICLR 2025]ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoning https://arxiv.org/abs/2501.06590☆69Updated 2 months ago
- ☆18Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆44Updated last year
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆27Updated 4 months ago
- Linear Attention Sequence Parallelism (LASP)☆87Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆26Updated 2 years ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated 11 months ago
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆33Updated last year
- Verifiers for LLM Reinforcement Learning☆74Updated 5 months ago
- Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]☆85Updated 8 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆41Updated last year
- The open source implementation of "Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers"☆18Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 3 weeks ago
- Source code for GreaTer ICLR 2025 - Gradient Over Reasoning makes Smaller Language Models Strong Prompt Optimizers☆32Updated 5 months ago