kuprel / minbpe-pytorch

Related projects: ⓘ

• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆57Updated 3 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 5 months ago
• euclaise / supertrainer2000
  ☆48Updated 6 months ago
• catid / lllm
  Latent Large Language Models
  ☆16Updated 3 weeks ago
• xjdr-alt / muzero_sketch
  ☆19Updated last month
• Shopify / torch-grammar
  ☆65Updated 2 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆51Updated 7 months ago
• LAION-AI / AIW
  Alice in Wonderland code base for experiments and raw experiments data
  ☆96Updated last week
• abetlen / program-constrained-language-model-sampling
  ☆34Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆63Updated 9 months ago
• NolanoOrg / SpectraSuite
  ☆40Updated 2 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• armed-gpt / gpt-blazing
  ☆25Updated this week
• ahmed-moubtahij / TokenHealer
  ☆21Updated 3 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆62Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆39Updated 8 months ago
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆21Updated 2 months ago
• UmerHA / triton_util
  Make triton easier
  ☆39Updated 3 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆40Updated 2 weeks ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA
  ☆48Updated this week
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆43Updated 3 weeks ago
• Aleph-Alpha / trigrams
  ☆29Updated 3 weeks ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆44Updated 10 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆117Updated 8 months ago
• facebookresearch / dual-system-for-visual-language-reasoning
  Github repo for Peifeng's internship project
  ☆12Updated 10 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆94Updated 2 weeks ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆19Updated 2 months ago
• Narsil / bloomserver
  ☆36Updated last year
• CERC-AAI / Robin
  ☆62Updated 5 months ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year