bigcode-project / bigcode-analysis

Related projects: ⓘ

• bigcode-project / the-stack-v2
  Code for the curation of The Stack v2 and StarCoder2 training data
  ☆85Updated 5 months ago
• keirp / OpenWebMath
  ☆110Updated 4 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆141Updated 4 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆98Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆195Updated 3 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆174Updated last week
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆204Updated 8 months ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆177Updated last year
• bigcode-project / bigcode-encoder
  ☆29Updated last year
• AI21Labs / Parallel-Context-Windows
  ☆99Updated last year
• forhaoliu / chain-of-hindsight
  Chain-of-Hindsight, A Scalable RLHF Method
  ☆213Updated 11 months ago
• Langboat / mengzi-retrieval-lm
  An experimental implementation of the retrieval-enhanced language model
  ☆75Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆201Updated 10 months ago
• bhargaviparanjape / language-programmes
  ☆166Updated last year
• orhonovich / unnatural-instructions
  ☆174Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆310Updated this week
• theblackcat102 / evol-dataset
  evol augment any dataset online
  ☆55Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆72Updated 8 months ago
• wenhuchen / TheoremQA
  The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset
  ☆153Updated 4 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆221Updated 5 months ago
• bigcode-project / bigcode-dataset
  ☆357Updated last month
• Zyq-scut / RLTF
  Accepted by Transactions on Machine Learning Research (TMLR)
  ☆115Updated 8 months ago
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆74Updated 9 months ago
• facebookresearch / cruxeval
  CRUXEval: Code Reasoning, Understanding, and Execution Evaluation
  ☆99Updated last month
• young-geng / koala_data_pipeline
  The data processing pipeline for the Koala chatbot language model
  ☆115Updated last year
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆170Updated last month
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆24Updated last year
• nyu-mll / ILF-for-code-generation
  ☆73Updated last year
• tianjunz / HIR
  ☆158Updated last year
• openai / human-eval-infilling
  Code for the paper "Efficient Training of Language Models to Fill in the Middle"
  ☆162Updated last year