epochxero / project-proposals

Related projects ⓘ

Alternatives and complementary repositories for project-proposals

• sholtodouglas / scalingExperiments
  ☆57Updated 2 years ago
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆237Updated last year
• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated last year
• google-research / cascades
  Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…
  ☆197Updated 5 months ago
• HomebrewNLP / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆46Updated 10 months ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆195Updated last year
• openai / ai-and-efficiency
  Submissions for AI and Efficiency SOTA's
  ☆56Updated 4 years ago
• huggingface / simulate
  🎢 Creating and sharing simulation environments for embodied and synthetic data research
  ☆190Updated last year
• davisyoshida / easy-lora-and-gptq
  JAX notebook showing how to LoRA + GPTQ arbitrary models
  ☆10Updated last year
• clemkoa / ntm
  Neural Turing Machines in pytorch
  ☆47Updated 2 years ago
• augustwester / transformer-xl
  A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)
  ☆35Updated last year
• aidangomez / weblm
  Drive a browser with Cohere
  ☆72Updated last year
• facebookresearch / GraphLog
  API for accessing the GraphLog dataset
  ☆89Updated 6 months ago
• andyljones / boardlaw
  Scaling scaling laws with board games.
  ☆43Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year
• moirage / alignment-research-dataset
  A dataset of alignment research and code to reproduce it
  ☆69Updated last year
• google-deepmind / neural_testbed
  ☆191Updated 6 months ago
• n2cholas / shapecheck
  Framework-agnostic library for checking array/tensor shapes at runtime.
  ☆47Updated 3 years ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆95Updated 6 months ago
• EleutherAI / pyfra
  Python Research Framework
  ☆107Updated 2 years ago
• microsoft / greenlands
  Platform to run interactive Reinforcement Learning agents in a Minecraft Server
  ☆48Updated 4 months ago
• yifding / hetseq
  HetSeq: Distributed GPU Training on Heterogeneous Infrastructure
  ☆106Updated last year
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆26Updated 3 weeks ago
• ssokota / mec
  Code for minimum-entropy coupling.
  ☆30Updated 4 months ago
• srihari-humbarwadi / tpu_index
  TPU index is a package for fast similarity search over large collections of high dimension vectors on TPUs
  ☆17Updated 3 years ago
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆124Updated 3 years ago
• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated last year
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆185Updated 2 years ago