tunib-ai / oslo

Related projects ⓘ

Alternatives and complementary repositories for oslo

• EleutherAI / oslo
  OSLO: Open Source for Large-scale Optimization
  ☆174Updated last year
• tunib-ai / large-scale-lm-tutorials
  Large-scale language modeling tutorials with PyTorch
  ☆287Updated 3 years ago
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆778Updated last year
• lassl / lassl
  Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets
  ☆127Updated 2 years ago
• kakaobrain / trident
  A performance library for machine learning applications.
  ☆180Updated last year
• friendliai / FAI-Model
  FriendliAI Model Hub
  ☆89Updated 2 years ago
• EleutherAI / dps
  Data processing system for polyglot
  ☆90Updated last year
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 2 years ago
• microsoft / varuna
  ☆236Updated 3 months ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆249Updated 2 years ago
• luyug / GradCache
  Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
  ☆361Updated 7 months ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆111Updated last year
• AminRezaei0x443 / memory-efficient-attention
  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
  ☆179Updated last year
• huggingface / nn_pruning
  Prune a model while finetuning or training.
  ☆394Updated 2 years ago
• rosinality / ml-papers
  My collection of machine learning papers
  ☆269Updated last year
• jaketae / koclip
  KoCLIP: Korean port of OpenAI CLIP, in Flax
  ☆142Updated last year
• EleutherAI / polyglot
  Polyglot: Large Language Models of Well-balanced Competence in Multi-languages
  ☆475Updated last year
• navervision / KELIP
  Official PyTorch implementation of "Large-scale Bilingual Language-Image Contrastive Learning" (ICLRW 2022)
  ☆95Updated 2 years ago
• snuspl / nimble
  Lightweight and Parallel Deep Learning Framework
  ☆263Updated last year
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆185Updated 2 years ago
• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆309Updated last year
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆225Updated 2 months ago
• tunib-ai / KMWP
  Korean Math Word Problems
  ☆57Updated 2 years ago
• facebookresearch / diffq
  DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …
  ☆234Updated last year
• gyunggyung / MLLMArxivTalk
  [Google Meet] MLLM Arxiv Casual Talk
  ☆55Updated last year
• kakaobrain / kortok
  The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
  ☆116Updated 4 years ago
• google / flaxformer
  ☆334Updated 7 months ago
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆192Updated last year
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆507Updated last year