clankur / einygpt

Related projects: ⓘ

• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated 9 months ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆15Updated 2 weeks ago
• fattorib / Little-GPT
  GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!
  ☆23Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆62Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• TheoCoombes / crawlingathome
  A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.
  ☆31Updated last year
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆36Updated last month
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆15Updated 3 months ago
• mukhal / intrinsic-source-citation
  [COLM '24] Source-Aware Training Enables Knowledge Attribution in Language Models
  ☆13Updated last month
• ScottPeterJohnson / gpt2-discord
  Discord bot that generates messages using GPT-2
  ☆20Updated 5 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆30Updated 3 years ago
• minimaxir / pokemon-embeddings
  Jupyter Notebooks and an R Notebook for encoding Pokémon embeddings and creating data visualizations.
  ☆16Updated 2 months ago
• dvruette / concept-guidance
  Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…
  ☆16Updated 6 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆29Updated last year
• NolanoOrg / InstructLLaMa.cpp
  Fast inference of Instruct tuned LLaMa on your personal devices.
  ☆22Updated last year
• tensorpro / tpu_rwkv
  JAX implementations of RWKV
  ☆18Updated 11 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆25Updated 11 months ago
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated last year
• Watchfulio / dataset-generator
  A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …
  ☆19Updated last month
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆30Updated this week
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆19Updated 2 months ago
• kuprel / minbpe-pytorch
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA
  ☆35Updated 6 months ago
• ngoyal2707 / Megatron-LM
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆18Updated last year
• catid / lllm
  Latent Large Language Models
  ☆16Updated 3 weeks ago
• HiroakiMikami / mlprogram
  PyTorch library for synthesizing programs from natural language
  ☆18Updated last month
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆13Updated last year
• huggingface / spm_precompiled
  Highly specialized crate to parse and use `google/sentencepiece` 's precompiled_charsmap in `tokenizers`
  ☆18Updated 2 years ago
• simonw / llm-embed-onnx
  Run embedding models using ONNX
  ☆23Updated 7 months ago