anyscale / long-context-fine-tuning-blogpost

Related projects: ⓘ

• Zyphra / Zyda_processing
  ☆22Updated 3 months ago
• RUCAIBox / ChainLM
  ☆21Updated 5 months ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆54Updated last month
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆29Updated 6 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆32Updated 8 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆42Updated 4 months ago
• Percent-BFD / neurips_submission
  ☆12Updated 9 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆34Updated 5 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 6 months ago
• codefuse-ai / D2LLM
  ☆21Updated last month
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆29Updated 7 months ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆42Updated last week
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆67Updated 2 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆38Updated 4 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆71Updated 3 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆48Updated last week
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆52Updated 5 months ago
• TableBench / TableBench
  Official repository for paper "TableBench: A Comprehensive and Complex Benchmark for Table Question Answering"
  ☆27Updated 3 weeks ago
• conceptofmind / SemDeDup
  ☆18Updated this week
• Bui1dMySea / MemLong
  ☆57Updated 3 weeks ago
• austrian-code-wizard / c3po
  ☆27Updated 5 months ago
• lfsszd / CS-Drafting
  Cascade Speculative Drafting
  ☆23Updated 5 months ago
• DunZhang / Stella
  ☆35Updated last month
• princeton-nlp / LitSearch
  A Retrieval Benchmark for Scientific Literature Search
  ☆53Updated 2 months ago
• GreenBitAI / bitorch-engine
  A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.
  ☆24Updated 2 months ago
• cchan / nanoGPT-fp8
  ☆12Updated last year
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆27Updated 8 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆42Updated 3 weeks ago
• BaichuanSEED / BaichuanSEED.github.io
  Official Repository for Paper "BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Compet…
  ☆15Updated 3 weeks ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 8 months ago